Databricks Engineer & AI Enablement Architect - Data Engineer III

About the role

Deloitte's AI & Engineering team is looking for a Data Engineer III to lead the governance, architecture, reliability and operation of secure, scalable Databricks environments supporting the Data Aggregation Contract (CDAC). The role sits within the Government & Public Services practice, serving federal, state and local government clients and public higher education institutions, and is open to three locations: Baltimore, Rosslyn and Washington.

Key responsibilities

• Establish workspace governance, Unity Catalog structures, access controls, service principals and policies protecting protected health information and sensitive healthcare data.
• Define medallion architecture standards and build reusable ingestion and transformation frameworks for CMS claims, clinical, provider, quality and oncology data.
• Improve data quality and production reliability through validation, reconciliation, lineage, observability, SLA monitoring, dashboards and proactive alerts.
• Establish CI/CD standards, review code, data models and pipeline designs, and assess GenAI and LLM use cases for production readiness.

Required profile

• Bachelor's degree.
• Ability to obtain and maintain the required clearance for the role.
• 4+ years of Databricks engineering experience and 2+ years in Databricks architecture.
• 4+ years of experience with Python, PySpark, SQL, Delta Lake and Medallion Architecture.
• Able to travel 10-15% on average and legally authorized to work in the United States without employer sponsorship.
• Preferred: experience with federal healthcare clients or CMS, Medicaid or Medicare claims, clinical and provider data, and Databricks certifications.

Required skills

• Python, PySpark, SQL, Delta Lake and Medallion Architecture
• Databricks platform administration, including Unity Catalog, cluster policies, service principals, secrets management and role-based access controls
• Implementing Databricks Asset Bundles and Git-based CI/CD

The stated wage range is $113,000 to $188,400, and candidates may also be eligible for a discretionary annual incentive program.