Data Engineer – PySpark and Apache

About the role

Infosys' Data and Analytics (DNA) unit is seeking a Data Engineer with strong expertise in PySpark and Apache technologies to help transform data into actionable insights. The role is based in Atlanta, GA and will involve working on cutting‑edge AI and analytics projects that drive business growth.

Key responsibilities

• Document and contribute to business requirements during the elicitation phase.
• Facilitate design discussions and capture architectural decisions for software solutions.
• Develop, test, and integrate new features or updates into existing data pipelines, ensuring system stability.
• Perform code reviews, maintain code repositories, and implement version‑control best practices.
• Design and execute test strategies, analyze results, and coordinate bug‑fixes.
• Create user training materials, documentation, and support frameworks for smooth application roll‑outs.
• Diagnose and resolve production issues, recommending preventive measures to improve reliability.
• Maintain detailed records of code changes, testing procedures, and support activities for knowledge‑base enrichment.

Required profile

• Collaborative mindset with the ability to work effectively in cross‑functional teams.
• Strong analytical and problem‑solving skills.
• Excellent written and verbal communication for documenting designs and training users.

Required skills

• PySpark
• Apache Spark (or related Apache big‑data frameworks)
• AWS cloud services
• Python programming
• Big Data processing concepts

What we offer

• Opportunity to work with cutting‑edge AI and analytics technologies.
• Collaboration with industry experts on transformative projects.
• Continuous learning environment and career growth within a global leader.