Senior Data Engineer
About the Role
You will design, build, and maintain data pipelines and ETL processes that power the publicly available Hubble analytics dataset. You will perform ad hoc analysis to clean, transform, and distill insights from large blockchain datasets. You will improve observability, quality, and freshness of data marts and ensure data is accessible via dashboards, KPIs, and SQL interfaces. You will translate community and business priorities into production data products and support stakeholders by explaining complex data findings in clear, actionable ways.
Requirements
- 5+ years professional experience in data engineering, machine learning engineering, or software engineering
- Experience with modern data warehousing concepts and ETL frameworks such as dbt, Fivetran, Databricks, or Talend
- Proficiency in SQL for analyzing large datasets
- Experience with ETL schedulers such as Apache Airflow, Dagster, or AWS Glue
- Proficient programming in Python or Go
- Strong communication skills for explaining data insights to non-technical stakeholders
- Comfort working on a small, growing team with autonomy
- Preferred: cloud data stack experience, preferably Google Cloud Platform
- Preferred: experience with CI/CD pipelines
- Preferred: experience administering BI tools and building visualizations
- Preferred: knowledge of data governance practices including data cataloging and data quality
- Preferred: curiosity about blockchain and cryptocurrency fundamentals
Responsibilities
- Design data pipelines
- Build and orchestrate ETL workflows
- Maintain data marts and pipelines
- Perform ad hoc data analysis and transformation
- Improve data observability and freshness
- Translate priorities into data products
- Enable self-service analytics via dashboards and SQL interfaces
- Validate and ensure data quality
Benefits
- lumen-denominated grants