Databricks Engineer - Data Engineer II

About the role

Deloitte's AI & Engineering team is hiring a Databricks Engineer (Data Engineer II) to design, develop and operate data and AI platforms for government and public services clients. The role is open in Baltimore, Rosslyn and Washington, DC, and involves building and optimizing data pipelines and tuning Databricks workloads.

Key responsibilities

• Develop and optimize data pipelines using Python, PySpark and SQL within the Databricks Lakehouse platform
• Apply Medallion architecture patterns to organize, transform and manage data across data layers
• Tune performance of Databricks workloads and SQL queries
• Configure row-level and column-level security, and manage data lineage and sharing in Unity Catalog
• Set up CI/CD and testing processes for Databricks workflows

Required profile

• Bachelor's degree
• 2+ years of Databricks engineering experience
• 2+ years of experience with Python, PySpark and SQL
• Ability to obtain and maintain the required clearance for the role
• Able to travel 10-15% on average, depending on clients and sectors
• Legally authorized to work in the United States without employer sponsorship

Required skills

• Preferred: Medallion architecture in the Databricks Lakehouse
• Preferred: Unity Catalog security, lineage and sharing configuration
• Preferred: CI/CD and testing for Databricks
• Preferred: Databricks performance tuning

The stated wage range is $97,700 to $162,800, and candidates may also be eligible for a discretionary annual incentive program. Deloitte offers professional development, mentoring and a broad range of employee benefits.