Hadoop and PySpark Data Engineer

About the role

Infosys' Data and Analytics (DNA) unit is seeking a Hadoop and PySpark Data Engineer to join its Technology Consultant team in Charlotte, NC. The role focuses on building and maintaining big‑data pipelines that turn raw data into actionable insights for clients.

Key responsibilities

• Conduct targeted interviews and workshops to capture user needs and document stakeholder requirements.
• Participate in design discussions, capture software specifications, and create process documentation.
• Develop, refine, and document code for new applications using Hadoop and PySpark, following detailed design specifications.
• Execute test plans, analyze outcomes, report defects, and support software performance enhancements.
• Assist with the integration of new software features and ensure smooth transitions within existing systems.
• Monitor and troubleshoot live applications, providing prompt issue resolution and comprehensive maintenance documentation.
• Systematically document coding practices, testing methodologies, and technical solutions to enrich the team’s knowledge base.

Required profile

• Agile mindset with strong communication and problem‑solving abilities.
• Ability to work collaboratively in cross‑functional teams and adapt to evolving project requirements.

Required skills

• PySpark
• Hadoop
• Big Data processing