Data Engineer

About the role

Join OneDigital’s cutting‑edge, AI‑native data engineering team built on Azure and Snowflake. As a Data Engineer you will own the full data lifecycle—from ingestion to modeling and governance—and deliver production‑ready pipelines from day one. This role is ideal for early‑career professionals eager to grow quickly in an environment where AI tooling is the default.

Key responsibilities

• Design, build, and maintain ingestion pipelines into Snowflake from sources such as Dataverse, SQL Server, APIs, and files using Azure Data Factory.
• Develop transformation logic following a medallion architecture (bronze → silver → gold) with orchestrated SQL in Snowflake.
• Write clean, modular Python code for orchestration, automation, custom connectors, and lightweight services.
• Collaborate daily with AI coding agents (e.g., GitHub Copilot, Claude Code, Cortex) to enhance productivity.
• Apply data‑governance and lineage standards using Atlan.
• Participate in code reviews, CI/CD pipelines via Azure DevOps, and on‑call rotations for production pipelines.
• Document processes, runbooks, and internal knowledge bases.

Required profile

• 0–2+ years of experience or a strong foundational background in data engineering.
• Demonstrated ability to learn quickly and work effectively with AI‑assisted development tools.
• Comfortable writing clean Python code and constructing efficient SQL queries.
• Hands‑on experience with Azure Data Factory and Snowflake data warehouses.
• Familiarity with source‑control workflows (Git) and CI/CD practices.

Required skills

• Python (pandas, requests, OOP, virtual environments)
• SQL (joins, window functions, CTEs, query optimization)
• Azure Data Factory
• Azure Storage (Blob/ADLS) and Key Vault
• Azure DevOps (pipelines, repos)
• Snowflake (warehouse design, roles, micro‑partitions)
• Git source‑control workflows
• Atlan data‑governance platform