Lead, Big Data Administrator

About the role

Epsilon, a global leader in data and identity positioned at the center of Publicis Groupe, is hiring a Lead, Big Data Administrator in Irving, Texas. The role covers deploying and managing large-scale distributed systems, with telecommuting available from anywhere in the US.

Key responsibilities

• Deploy and manage large-scale distributed systems, keeping them performant, available and scalable
• Oversee installation, configuration and maintenance of Hadoop ecosystems (HDFS, Yarn, Hive, Spark) and Kafka clusters
• Implement high-availability and disaster recovery strategies for Hadoop and Kafka environments
• Tune performance through resource allocation, cluster optimization and monitoring
• Orchestrate data pipelines and integrate Kafka producers, consumers and downstream frameworks
• Protect data with encryption, access control and auditing
• Troubleshoot cluster health, data loss and Kafka offset issues with minimal downtime
• Automate repetitive tasks with Ansible and shell scripting
• Collaborate with development, data engineering and analytics teams and stay current with emerging big data and streaming technologies

Required profile

• Bachelor's degree in Computer Applications or a related field, followed by eight years of progressive post-baccalaureate experience in the job or in another occupation where the experience was gained
• Ability to diagnose and resolve complex cluster issues, tune configurations and optimize job performance

Required skills

• Hadoop components (HDFS, Yarn, Hive, Spark) and Kafka clusters, with ZooKeeper for coordination
• Kerberos, LDAP, SSL/TLS, Hadoop KMS, Ranger, Atlas or custom audit tools
• Prometheus and Grafana for metrics visualization and alerting
• Bash and Python for automation of backups, logs and maintenance

What we offer

• Pay range of USD 138,715 to 182,000 per year, depending on skills and experience
• Flexible time off, 14 paid holidays and paid sick time
• Parental/new child leave, childcare and elder care assistance, adoption assistance
• Health coverage, 401(k), tuition assistance, commuter benefits and professional development