Senior Databricks Engineer

About the role

HIKE2 is seeking a Senior Databricks Engineer to design and build enterprise‑grade data platforms for Fortune 500 clients. This hands‑on position combines architecture, delivery, and mentorship in a remote, full‑time setting.

Key responsibilities

• Design and build large‑scale data platforms on Databricks (Delta Lake, Spark, Unity Catalog) in Azure.
• Develop and maintain batch and streaming pipelines for high‑volume, complex data sources.
• Implement medallion/lakehouse architectures from the ground up in greenfield environments.
• Optimize data models to support analytics, reporting, and downstream applications.
• Integrate Databricks with enterprise systems, APIs, event streams, data warehouses, and ML workflows.
• Tune Spark jobs for performance, reliability, and cost efficiency at scale.
• Support production deployments, including CI/CD pipelines, testing, and release management.

Required profile

• Partner directly with enterprise clients to translate business requirements into technical solutions.
• Collaborate with architects, engineers, and data scientists across multiple workstreams.
• Balance speed and quality, making pragmatic decisions in ambiguous, evolving environments.
• Mentor and guide data engineers and analysts, fostering technical growth within the team.

Required skills

• Databricks (Delta Lake, Spark, Unity Catalog, Delta Live Tables)
• Azure cloud platform
• Infrastructure‑as‑code tools (Terraform, Bicep)
• CI/CD automation (GitHub, Azure DevOps)
• Modern cloud data warehouses (Snowflake, BigQuery, Redshift)
• Orchestration frameworks (Airflow, Astronomer)
• Transformation tools (dbt)
• Streaming platforms (Kafka, Kinesis)

What we offer

• Medical, dental, and vision insurance
• 401(k) retirement plan
• Holiday pay, vacation, and personal/family sick leave
• Competitive salary range