Senior Data Engineer, Data Platform

About the role

Virtasant is seeking a Senior Data Engineer to join a leading healthcare technology client’s Data Platform team. You will design and build core services, automation tools, and integrations that power the client’s data ecosystem, improving reliability, observability, and developer experience.

Key responsibilities

• Develop scalable backend services, APIs, and internal tools to automate data platform workflows such as onboarding, validation, pipeline orchestration, schema tracking, and quality monitoring.
• Integrate tools with core data infrastructure, building pipelines using Airflow, Spark, dbt, Kafka, Snowflake or similar technologies and expose capabilities via APIs and UI.
• Create visualization and monitoring components for data lineage, job health, and quality metrics.
• Collaborate cross‑functionally with data engineering, product, and DevOps teams to define requirements and deliver end‑to‑end solutions.

Required profile

• Must reside in the contiguous United States and be eligible to work under an independent contractor agreement (US citizen, Green Card holder, or LLC owner).
• 7+ years of data engineering or software development experience, with at least 5 years building production‑grade data or platform services.
• Strong programming skills in Python and SQL, and experience with a major cloud data platform (Snowflake, BigQuery, Redshift, etc.).
• Deep experience with streaming, distributed compute, or S3‑based table formats (Spark, Kafka, Iceberg, Delta, Hudi).

Required skills

• Python
• SQL
• Snowflake / BigQuery / Redshift
• Airflow
• Spark
• dbt
• Kafka
• Iceberg, Delta, Hudi
• API development
• Data pipeline orchestration
• Schema evolution and data contracts
• Data lineage visualization and monitoring