Backend Software Engineer (Python)

About the role

Scribd’s ML Data Engineering team is looking for a Backend Software Engineer with deep Python expertise to design and optimize large‑scale data and service pipelines on AWS. You will help power metadata extraction, enrichment, and content understanding across all Scribd brands, working on cutting‑edge generative AI and metadata enrichment problems at a global scale.

Key responsibilities

• Design and implement event‑driven, distributed, and scalable backend services in Python.
• Build and optimize large‑scale data pipelines using AWS services such as Lambda, ECS, SQS, and ElastiCache.
• Integrate machine‑learning models and LLM‑based components into production services.
• Collaborate with applied research, product, and other engineering teams to deliver reliable, high‑performance solutions.
• Use orchestration and observability tools (Airflow, Spark, Databricks, Terraform, Datadog) to monitor and maintain systems.

Required profile

• Proven experience building event‑driven, distributed systems with Python.
• Hands‑on experience with core AWS services (Lambda, ECS, SQS, ElastiCache).
• Familiarity with data‑pipeline tools such as Airflow, Spark, and Databricks.
• Experience using infrastructure‑as‑code (Terraform) and monitoring platforms (Datadog).
• Ability to work cross‑functionally and deliver production‑ready solutions.

Required skills

• Python
• AWS Lambda
• AWS ECS
• AWS SQS
• AWS ElastiCache
• Airflow
• Spark
• Databricks
• Terraform
• Datadog