Senior Software Engineer (Big Data)

About the role

Mastercard is looking for a Senior Software Engineer to join its AI&DPE Data Engineering platform team. You will build and evolve large‑scale backend data systems, real‑time and batch pipelines, and AI‑enabled services that power analytics, decisioning, and automation across the organization.

Key responsibilities

• Design, develop, and maintain backend services and data pipelines using Scala, Python and Java.
• Build and optimise batch and streaming workloads on Cloudera Data Platform (CDP) with Apache Spark.
• Configure, monitor and tune the platform using Cloudera Manager to ensure operational stability.
• Create high‑quality datamarts and curated datasets with a focus on data integrity and performance.
• Design and integrate AI‑powered agents for anomaly detection, workflow automation and generative‑AI driven tasks.
• Develop and support data and compute workloads in AWS, leveraging Databricks for large‑scale processing.
• Enable downstream consumers (analytics, reporting tools such as Qlik) through reliable backend data interfaces.

Required profile

• Several years of experience in backend software engineering.
• Proven expertise with big‑data platforms and distributed processing.
• Experience building AI‑enabled automation and intelligent agents.
• Ability to work with massive transactional datasets at global scale.

Required skills

• Scala
• Python
• Java
• Apache Spark
• Cloudera Data Platform / Cloudera Manager
• AWS cloud services
• Databricks
• AI/ML integration (e.g., generative AI, anomaly detection)

What we offer

• Opportunity to impact a leading global payments network.
• Access to cutting‑edge big‑data and AI technologies.
• Collaborative environment with cross‑functional teams.