About
Kirk Sweeney
Hi, I'm Kirk. I build data platforms and data solutions for a living. I have built these across leading cloud platforms and worked with technologies such as Spark, Databricks, Kafka, Pulsar, Kubernetes, Apache Beam, and more.
I love to learn new things, and I created this blog as a place to share some of my learnings. Feel free to ask questions below each blog post, or send a message via LinkedIn.
Topics covered
- Data platform paradigms: lakehouses, data mesh, and related approaches
- Data engineering: SQL, Spark, Flink, and more
- Software development: Python, Java, Rust, and more
- DevOps workflows: Kubernetes, CI/CD, Terraform, Argo CD, and more
Working principles
- We must be customer- and people-obsessed.
- To understand our customers' problems, we must work closely with them.
- Investing in tooling is necessary to continuously release working software.
- We should minimize processes that slow our response to change.
- The best teams are built on trust, both within the team and from management.