Senior Software Engineer, Data Platform
About the Role
You will build and operate mission-critical data systems that analyze blockchain transaction activity at petabyte scale. You will develop real-time ETL pipelines, design data models for sub-second query latency, and deploy and monitor large database clusters with a focus on performance and high availability. You will collaborate with data scientists, backend engineers, and product managers to implement data models and pipelines that power product features and analytics. You will also create automation and observability to make scaling and operational tasks repeatable and fast.
Requirements
- Bachelor's degree or equivalent in Computer Science or related field
- 5+ years of hands-on experience architecting distributed systems and delivering production deployments
- Strong programming skills in Python
- Proficiency in SQL or SparkSQL
- Experience with data stores such as Iceberg, Trino, BigQuery, StarRocks, and Citus
- Experience with pipeline and workflow orchestration tools such as Airflow and DBT
- Experience with data processing and streaming technologies such as Spark, Kafka, and Flink
- Experience deploying and monitoring infrastructure in public cloud using Docker, Terraform, Kubernetes, and Datadog
- Proven ability to load, query, and transform very large datasets
Responsibilities
- Build highly reliable data services to integrate with multiple blockchains
- Develop complex ETL pipelines to process petabyte-scale structured and unstructured data in real time
- Design and architect data models for optimal storage and sub-second query latency
- Deploy, scale, and monitor large database clusters with focus on performance and high availability
- Implement automation for operational tasks such as provisioning, scaling, and maintenance
- Collaborate with data scientists, backend engineers, and product managers to implement data models and pipelines
Benefits
- Equity plan
- Paid time off (PTO)
- Holidays
- Parental leave
- Remote-first work
- Offsites and regional meetups