SmartBroker is seeking a skilled Senior Data Engineer to join our team in Berlin. You will design, build, and maintain scalable data pipelines to support our trading platform and business analytics.

Role Overview

As a Senior Data Engineer at SmartBroker, you will be the backbone of our data infrastructure, enabling real-time processing and analytics for our trading platform. You will collaborate with data scientists, backend engineers, and business stakeholders to design robust, scalable data pipelines that handle millions of transactions daily.

Key Responsibilities

• Design, build, and maintain ETL/ELT pipelines for both batch and streaming data.
• Optimize and manage data storage solutions (relational, NoSQL, data lakes).
• Ensure data quality, reliability, and security across all systems.
• Develop monitoring and alerting for data pipeline performance.
• Contribute to architecture decisions and mentor junior engineers.
• Work with cross-functional teams to define data requirements and implement solutions.

Tech Stack

• Python, SQL, Apache Spark, Apache Kafka, Airflow
• AWS (S3, Redshift, Glue) or GCP (BigQuery, Dataflow)
• Docker, Kubernetes, Terraform
• PostgreSQL, Cassandra, Elasticsearch

Requirements

• Experience: 4+ years in data engineering or similar role.
• Technical Skills:
  • Strong proficiency in Python and SQL.
  • Hands-on experience with Apache Spark and Kafka.
  • Expertise in cloud data services (AWS, GCP, or Azure).
  • Familiarity with orchestration tools like Airflow or Luigi.
• Data Modeling: Proven ability to design star/snowflake schemas and data lakes.
• Streaming: Experience with real-time data processing (Kafka Streams, Flink).
• Soft Skills: Excellent communication, problem-solving, and teamwork.
• Languages: Fluent English; German is a plus.
• Education: Bachelor’s or Master’s in Computer Science, Engineering, or related field.

Benefits

• Flexible Work Arrangements: Enjoy the freedom of remote work with occasional team meetups in Berlin.
• Competitive Compensation: Attractive monthly salary and performance bonuses.
• Professional Development: Access to learning budgets, conferences, and training.
• Modern Tech Stack: Work with cutting-edge tools like Apache Spark, Kafka, and cloud platforms (AWS/GCP).
• Health & Wellness: Company-sponsored health insurance and gym membership.
• Collaborative Culture: Flat hierarchies, agile teams, and regular hackathons.
• Relocation Support: Assistance with moving to Berlin if desired.
• Employee Perks: Stock options, free trading account, and subsidized lunch.