AI Data Engineer

About the role

The client is seeking an AI Data Engineer to design, build, and maintain data pipelines and AI‑enabled analytics platforms. You will work with cross‑functional teams to deliver scalable, high‑quality data solutions in a fast‑paced environment.

Key responsibilities

• Design, develop, test, and maintain ETL pipelines using SQL, R, Python, and PySpark.
• Build and optimise data architectures on Azure, including Azure Functions, Docker, and Kubernetes.
• Implement CI/CD pipelines with Git/GitHub and Azure DevOps for data workflows.
• Collaborate with DBAs and developers to create data models, stored procedures, and RESTful/SOAP APIs.
• Ensure data quality through validation, monitoring, and logging, and document data flows for compliance.

Required profile

• Bachelor’s degree and ability to obtain a Public Trust clearance.
• At least five years of experience in data engineering, software development, or related roles.
• Hands‑on experience with AI concepts such as prompt engineering, machine learning, agentic AI, and RAG.
• Proven ability to work in Agile environments and present technical status updates.

Required skills

• Programming: Python, Java, SQL, R, PySpark.
• Databases: MySQL, PostgreSQL, SQL Server, MongoDB.
• Cloud & DevOps: Azure Functions, Docker, Kubernetes, Git, GitHub, Azure DevOps, CI/CD pipelines.
• Tools: Databricks, Co‑Pilot, CodeX.
• API development: RESTful, SOAP.