Data Scientist II - Generative AI

About the role

Robert Half is recruiting a Data Scientist II focused on Generative AI in San Ramon. The role leads advanced analytics and agent development projects, combining data science expertise with hands-on machine learning experience to build intelligent agents that augment human workflows using Azure and Microsoft data services.

Key responsibilities

• Design and implement Gen AI-powered agents that solve real business challenges and streamline internal workflows.
• Extend and optimize the internal agent evaluation framework so agents are reliable, high-performing and explainable.
• Build benchmarking and monitoring systems to assess orchestration strategies and model performance in production.
• Run experiments to evaluate the impact of model or architecture changes, balancing performance, cost and scalability.
• Build on existing prompt engineering frameworks to standardize best practices and reduce "prompt debt".
• Mentor junior data scientists and software engineers on Gen AI techniques and frameworks.
• Partner with product managers to assess technical feasibility, estimate level of effort and prioritize development initiatives.
• Communicate complex AI concepts to non-technical stakeholders and lead roadshows and demos to promote Gen AI tools.

Required profile

• Master's or Ph.D. in Computer Science, Data Science, Machine Learning or a related field.
• 5+ years of experience in applied ML, AI development or advanced data science roles.
• Hands-on experience building and deploying LLM-based agents, RAG pipelines and multimodal Gen AI systems.
• Proven track record of mentoring team members and driving innovation in AI workflows.

Required skills

• Proficiency in Python and Gen AI frameworks.
• Understanding of agent orchestration frameworks such as LangGraph, LangChain, AutoGPT or equivalents.
• Expertise in benchmarking, A/B testing and model monitoring for AI systems.
• Experience developing and maintaining prompt engineering standards.
• Familiarity with internal experimentation, observability or AI governance tools is a plus.

What we offer

• Salary range of $119,000 to $180,000, negotiable, with eligibility for a discretionary annual bonus.
• Group health, vision and dental insurance, FSA and HSA accounts, life and accident insurance, adoption and fertility assistance.
• Paid parental leave of up to 6 weeks and short/long term disability coverage.
• Paid time off and up to 11 paid holidays per year.
• 401(k) or deferred compensation plan with a 100% employer match on the first 3% of contributions.