Staff Software Engineer – Data Platform

About the role

Cogent Security is building the next generation of AI agents for cybersecurity. As a Staff Software Engineer on the Data Platform team you will design and implement the core ingestion and transformation pipelines that turn massive enterprise data into a knowledge base for generative AI applications.

Key responsibilities

• Build robust data connectors and pipelines to ingest, normalize, and extract insights from diverse enterprise sources.
• Design high‑performance indexing and retrieval strategies that enable semantic search and retrieval‑augmented generation.
• Collaborate with Applied AI teams to taxonomize, deduplicate, and correlate data, shaping storage and query architectures for the data lake.
• Lead build‑vs‑buy decisions for the modern Gen‑AI data platform, integrating tools and services into the overall tech roadmap.
• Develop reusable design patterns and system components that scale integrations from one to thousands.

Required profile

• 5+ years of hands‑on engineering experience and technical leadership on multiple projects.
• Proven experience building data pipelines for information‑retrieval systems such as knowledge graphs or search engines.
• Hands‑on work with ETL orchestration tools (Temporal, Airflow) and batch/stream processing frameworks (Apache Kafka, Flink).
• Deep knowledge of database fundamentals, SQL, data reliability practices, and distributed computing.
• Fluent use of orchestration and deployment technologies like Kubernetes, Terraform, Docker, and Databricks across cloud environments.

Required skills

• Temporal
• Airflow
• Apache Kafka
• Flink
• SQL
• Kubernetes
• Terraform
• Docker
• Databricks