Staff Software Engineer - Databases

P-375

At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical services.

What You’ll Do

As a Staff Software Engineer, you’ll lead the design, development, and reliability of our global platform that manages schema and data changes at scale:

• Schema Migration Platform: Architecting and maintaining automated schema change infrastructure for MySQL and TiDB, while implementing versioning, rollback, validation, and auditing for safe, predictable, and fast migrations.
• Scale, Reliability & Test Harness: Ensuring the platform operates across thousands of global databases with zero downtime, enhancing resilience, observability, and recovery, and building a test harness for migration and deployment validation.
• Developer Experience & CI/CD Integration: Designing intuitive tools and APIs for seamless schema and data change management, and embedding migration workflows into CI/CD pipelines to increase velocity and reduce friction.
• Schema & Data management: Designing infrastructure for safe, large-scale schema and data operations like backfills and purging. This includes ensuring backfill operations are monitored, retryable, minimally disruptive, and automated to align with schema/data evolution and maintain data integrity.

Your role will be crucial in:

• Ensuring the scalability and reliability of schema and data operations across Databricks’ global footprint.
• Driving predictable deployments by architecting robust test harnesses and automation.
• Elevating the developer experience by building accessible, resilient tools that make complex migrations feel simple.
• Guaranteeing the integrity of both schema and data through safe, efficient backfill strategies.

What we look for:

• 12+ years of professional experience in backend systems or platform engineering.
• Experience in building platforms, infrastructure, or database engineering, especially with MySQL, TiDB.
• Track record of building and scaling mission-critical platforms supporting high-throughput, global services.
• Experience with schema migration frameworks, CI/CD automation and developer tooling.
• Champion of developer experience, creating clear, reliable, and user-friendly workflows.

About Databricks</