Staff Data Platform Engineer

Staff Data Platform Engineer

Crystal Intelligence is seeking a talented and experienced Staff Data Engineer to join their Data Engineering team. This is a permanent, fully remote position, open to candidates located anywhere in Europe.

You will play a crucial role in developing and evolving data pipelines for blockchain data processing. This role offers the opportunity to drive technical direction, mentor engineers, and own team outcomes.

Key Responsibilities

• Design and evolve data pipeline architecture and storage systems, influencing technical direction across the team.
• Build and deliver high-quality data pipelines from initial design through production deployment.
• Mentor engineers, improve code quality through reviews, and assist teammates with complex technical challenges.
• Take ownership of team results, setting expectations, ensuring delivery quality, and being accountable for outcomes.

Requirements

• 8+ years of hands-on software engineering experience, with significant depth in data pipelines, backend services, or data platform engineering.
• Deep experience designing and operating data lakes, warehouses, or lakehouses at production scale.
• Proven experience in scaling data pipelines and a strong understanding of trade-offs (performance, resources).
• Expert-level Python skills, with the ability to write clean, performant, testable code and establish coding standards.
• Experience with modern data processing stacks, including technologies like Kafka or Redpanda, Flink or Spark, and Airflow or Dagster.
• Expert-level SQL skills, including complex joins, query planning, optimization, and schema design for both OLTP and OLAP systems.
• Strong database architecture skills.
• Solid distributed systems experience.
• Comfortable leading technical discussions, building consensus on architectural decisions, and serving as a go-to expert for complex issues.
• Team-oriented with good communication skills.
• Proficiency in English.

Nice to Have

• Experience working with a distributed ClickHouse cluster.
• Blockchain domain knowledge or the ability to quickly master complex technical domains.
• A track record of driving engineering standards and best practices across a team.

Note: No prior knowledge of Blockchain technology is required.

Tech Stack

• Languages & Frameworks: Python, FastAPI
• Databases: PostgreSQL, ClickHouse, Redis, Snowflake
• Infrastructure: Docker, Kubernetes, Terraform, AWS
• Data Processing: Kafka, Apache Iceberg, Spark
• Future Considerations: Airflow / Dagster / Redpanda

What We Offer

• Access to an AI tool of your choice: Cursor or Claude Code.