Engineering blog by the ZeroToOne team — deep dives into architecture, data engineering, and the tools we build.https://blog.platform.zerotoone.ai/https://blog.platform.zerotoone.ai/blog/airflow-dag-bundles-without-helm-upgrades/https://blog.platform.zerotoone.ai/blog/airflow-dag-bundles-without-helm-upgrades/How we use S3 DAG bundles, a sidecar sync pattern, and the bundle watcher to onboard new pipelines with zero downtime.Wed, 15 Apr 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/building-a-composable-etl-framework/https://blog.platform.zerotoone.ai/blog/building-a-composable-etl-framework/How we replaced bespoke PySpark scripts with a config-driven, hook-based framework inspired by Rust's composition model.Thu, 02 Apr 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/building-our-lakehouse-with-iceberg/https://blog.platform.zerotoone.ai/blog/building-our-lakehouse-with-iceberg/How we designed a modern lakehouse architecture using Iceberg, Lakekeeper, and Spark on AWS.Sun, 15 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/debugging-a-spark-job-with-dataflint/https://blog.platform.zerotoone.ai/blog/debugging-a-spark-job-with-dataflint/How an open-source Spark UI replacement helped us find data skew, partition bloat, and shuffle spill.Fri, 27 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/how-dataflint-helped-us-optimize-spark-jobs/https://blog.platform.zerotoone.ai/blog/how-dataflint-helped-us-optimize-spark-jobs/A quick look at how DataFlint's Spark UI pointed us to the exact bottlenecks in our daily ETL.Fri, 27 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/how-we-built-our-blog/https://blog.platform.zerotoone.ai/blog/how-we-built-our-blog/A walkthrough of our engineering blog stack — Astro, MDX, Tailwind, and a Git-based workflow.Mon, 16 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/running-spark-on-kubernetes/https://blog.platform.zerotoone.ai/blog/running-spark-on-kubernetes/How we run production Spark jobs on Kubernetes with one SparkApp YAML, pre-baked images, and sub-10-second warm starts.Thu, 19 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/spark-merge-optimization-from-60-to-4-minutes/https://blog.platform.zerotoone.ai/blog/spark-merge-optimization-from-60-to-4-minutes/How we cut our daily upsert pipeline from an hour to under 4 minutes using storage partition joins and shuffle hash hints.Thu, 19 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/spark-on-spot-with-s3-shuffle/https://blog.platform.zerotoone.ai/blog/spark-on-spot-with-s3-shuffle/How S3 shuffle lets us run Spark executors 100% on spot instances with Karpenter, cutting compute costs 70-85%.Wed, 25 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/taming-s3-shuffle-at-scale/https://blog.platform.zerotoone.ai/blog/taming-s3-shuffle-at-scale/How we fixed the GET request explosion, prefix throttling, and threading edge cases that emerge when S3 shuffle meets production scale.Mon, 30 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/welcome-to-zerotoone-engineering/https://blog.platform.zerotoone.ai/blog/welcome-to-zerotoone-engineering/We're launching our engineering blog to share how we build, scale, and operate our data platform.Mon, 16 Mar 2026 00:00:00 GMThttps://blog.platform.zerotoone.ai/blog/what-we-learned-building-our-ml-platform/https://blog.platform.zerotoone.ai/blog/what-we-learned-building-our-ml-platform/Six ideas about feature stores, AST-generated ETLs, content-addressed artifacts, and control planes — distilled from building a semantic layer for ML.Thu, 23 Apr 2026 00:00:00 GMT