Principal, Data Engineering (Data Ops)
Hut 8 · Miami
Job description
About the role
Hut 8 is hiring a Principal Data Operations engineer in Miami, Florida, to build and operate the systems that move the company's business and operational data from source systems into reliable, secure, analytics-ready data products. The role covers source integrations, API and SFTP ingestion, Airflow orchestration, data transformation, warehousing, cloud infrastructure, monitoring, data quality and production support. It is an individual-contributor position where candidates deliver work within established patterns and grow their ownership of production systems; senior candidates also lead complex technical initiatives, improve standards and give technical guidance through design and code review.
Key responsibilities
- Translate business and stakeholder requirements into documented data pipelines and services.
- Build and maintain ingestion from APIs, SFTP endpoints, files, databases and cloud services, coordinating with external providers.
- Develop and operate Airflow and Google Cloud Composer workflows, including dependencies, retries, backfills and alerting.
- Model and deliver data across BigQuery, Snowflake, Cloud SQL/PostgreSQL and Google Cloud Storage using dbt, data marts and semantic-layer objects.
- Support the cloud infrastructure behind data products, including Cloud Run, container images, Artifact Registry, IAM, service accounts and Secret Manager.
- Design pipelines for idempotency, safe reruns, recoverability and failure containment, with freshness, reconciliation, schema and completeness checks.
- Improve observability through logs, dashboards, alerts and runbooks, and validate downstream data accuracy.
- Own production support, resolve incidents by root-cause analysis and apply durable corrective actions.
- Apply least-privilege access, secure secrets management and data-governance practices, and support access reviews.
- Work within GitHub pull-request, testing, CI/CD and change-management practices; at the senior level, lead complex integrations, migrations and reliability initiatives.
Required profile
- 3+ years of experience in data engineering, software engineering, DataOps or a related field (5+ years for senior level).
- Bachelor's degree in Computer Science, Engineering, Information Systems or a related field, or equivalent experience.
- Experience operating production data pipelines and integrating REST APIs, SFTP, scheduled files or databases.
- Strong communication and cross-functional collaboration skills.
Required skills
- Strong Python and SQL.
- Airflow or Google Cloud Composer.
- BigQuery, Google Cloud Storage and Snowflake.
- Git, GitHub, pull requests, automated testing and CI/CD.
- Linux and Bash familiarity.
- Data quality, freshness, reconciliation, schema evolution and monitoring.
Nice to have: dbt, Cloud Run, Artifact Registry, IAM, Secret Manager, Docker, Cloud SQL/PostgreSQL, Grafana/Tableau/Metabase, data governance and access reviews, and mentoring experience for senior candidates. The role is based in the Brickell area of Miami, Florida.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
- Delivery Specialist 330
- Line Cook 264
- Restaurant Host 251
- Dishwasher 241
- Shift Supervisor 226
- Parts Specialist 208
- Retail Service Specialist 176
- Server - Red Robin 140
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 6 days ago
Expires 1 month from now
15 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Hut 8
Miami