Software Engineer II – AI Engineer (Deployment Skills)

About the role

Robert Half is looking for a Software Engineer II – AI Engineer who will analyze, design, program, debug, test, implement, deploy and support software enhancements and new applications using Generative AI technologies. The role contributes to the development and production deployment of GenAI-enabled applications such as LLM-powered workflows, RAG pipelines and AI-driven user experiences, and supports SDLC documentation with a focus on deployment, evaluation, observability, safety and monitoring.

Key responsibilities

• Develop and modify application modules, including GenAI components, and build prompt workflows, retrieval layers, APIs and cloud services.
• Troubleshoot production issues such as latency, hallucinations and errors, and provide Level II production support.
• Design components including LLM integrations and RAG pipelines, and implement CI/CD pipelines, containerization and release processes.
• Evaluate models for accuracy, relevance and hallucination risk, and implement safety guardrails such as PII protection and prompt-injection defense.
• Run unit, integration and GenAI evaluation tests, and monitor production systems for latency, cost, usage and errors.
• Support incident management with fallback and recovery strategies.

Required profile

• 4+ years of experience in IT or a related field, with 2+ years of software engineering experience.
• 1+ year of experience in GenAI deployment and experience with AI coding agent-augmented development.
• Experience building and deploying applications, and strong communication and requirements-gathering skills.

Required skills

• Python, Java, C#, JavaScript or SQL.
• Cloud platforms, containers and CI/CD; knowledge of databases and data integration.
• LLM fundamentals, token behavior, LLMOps/MLOps, and RAG pipelines with embeddings and vector search.
• Prompt engineering, evaluation metrics, GenAI debugging and safety mechanisms, and observability (logging, tracing, monitoring).
• Preferred: LangChain, Semantic Kernel or AutoGen, model orchestration, embedding and semantic search design, A/B testing of prompts and models, conversational UX design, and incident handling.

What we offer

• Salary range of $85,000 to $124,000, negotiable, with eligibility for a discretionary annual bonus.
• Group health, vision and dental insurance, FSA and HSA accounts, life and accident insurance, adoption and fertility assistance, and paid parental leave of up to 6 weeks.
• Choice Time Off and up to 11 paid holidays, and a 401(k) plan with a 100% employer match on the first 3% of contributions.