Senior Software Engineer II

About the role

This role involves designing, building, and deploying production AI systems such as agentic workflows, LLM‑powered pipelines, retrieval‑augmented generation (RAG) services, and structured extraction services. You will work closely with business users and cross‑functional teams to turn ambiguous problems into measurable AI solutions.

Key responsibilities

• Design, implement, and operate production AI systems across multiple business units.
• Collaborate with stakeholders to define use cases, success metrics, and requirements.
• Write technical specifications and architecture documents for complex AI components.
• Build evaluation harnesses, set accuracy, latency and cost baselines, and monitor them in production.
• Own cost and performance of LLM workloads, including model selection and usage attribution.
• Maintain CI/CD pipelines and automate deployments on AWS and Azure.
• Mentor junior engineers on AI system design and production readiness.

Required profile

• 5+ years of software engineering experience, with at least 2 years building LLM‑based or ML‑based systems in production.
• BS in Engineering/Computer Science or equivalent experience.
• Proven end‑to‑end ownership of AI features or services.
• Strong understanding of responsible AI practices and data handling.

Required skills

• TypeScript/Node.js and Python (C#/.NET a plus).
• Hands‑on experience with LLM platforms and APIs (e.g., Azure OpenAI).
• Building RAG pipelines: chunking, embedding, hybrid retrieval, reranking.
• Schema‑driven extraction using Zod, Pydantic, JSON Schema.
• SQL proficiency and experience with relational and vector stores (SQL Server, PostgreSQL, Elasticsearch).
• Working knowledge of AWS and Azure services, Docker, Kubernetes, CI/CD, and observability tools.

What we offer

• Comprehensive health, dental and vision benefits.
• 401(k) with match and Employee Share Purchase Plan.
• Wellness platform, Headspace subscription, Employee Assistance and time‑off programs.
• Disability, life, critical illness and hospital indemnity insurance.
• Family benefits including parental leave, adoption and surrogacy support.
• Health Savings, Dependent Care and Commuter Spending Accounts.
• Paid Time Off plus additional paid leave for employee resource groups and volunteering.