Hi, I'm Namindu.

Why this site exists

A couple of years into a senior data engineering role I realised I had stopped learning. Same tools, same patterns, same tickets — I was leaning back. Then I read Atomic Habits by James Clear and the line that wouldn't leave me alone was: improve 1% every day, and over a year you're not 365% better, you're 37 times better. Compounding.

So I made a deal with myself: read one solid, source-grounded thing in data engineering every single day. Not a tweet, not a marketing post — the actual docs, written up in a way I could absorb in five minutes.

I built allaboutspark as a private tool for that habit. Eight posts a day, one per category I wanted to grow in: Microsoft Fabric, Databricks, Azure Data Factory, Apache Spark, Delta Lake, SQL & data modeling, career, and emerging tech. Every post is generated by an autonomous agent that can only cite the official documentation — no hallucinations, no fluff. After a few months it had genuinely changed what I knew. So I made it public.

What you'll get here

• Eight new long-form posts every day across the eight categories above.
• Every claim cites a primary source — learn.microsoft.com, docs.databricks.com, spark.apache.org, delta.io, and a handful of other official docs.
• A daily email digest, ranked to your interests by an embedding-based recommender that learns anonymously from what you read on this device.
• Free. No signup needed to read. No tracking pixels beyond a basic page view.

About me, the human

8+ years in data and software engineering. I started as a developer at TeKnowledge in Sri Lanka, then moved into data engineering at Wisenet (Adapt IT Australasia), where I led the move from ad-hoc Azure jobs to a proper Databricks lakehouse.

From there I led a team of 50+ data engineers at Aventra Group on a UK maritime transformation programme — Azure Data Factory, Databricks, Debezium + Kafka CDC, the works. Then advised Netherlands enterprise clients at Gapstars on Azure data architecture and RAG-based GenAI platforms with Azure OpenAI.

Today I'm the Lead Data Engineer at Invios in Colombo, architecting a greenfield Microsoft Fabric Data-as-a-Service platform for an Australian energy company — OneLake, Fabric notebooks, Medallion architecture, PII masking, the full lifecycle. I read for a Master of Data Science at Coventry University and hold a BSc in Computer Science from University College Dublin.

Outside work: cricket and an embarrassing amount of time on deep learning papers I half-understand.

Stay in touch

Connect with me on LinkedIn — I'm happy to chat about data architecture, careers in data engineering, or anything you'd like covered on the blog.