Senior Data Engineer needed for a remote contract role at Mistral AI. Design and build large-scale data pipelines for cutting-edge AI models.

Join Mistral AI as a Senior Data Engineer and play a pivotal role in building and maintaining the data infrastructure that powers our state-of-the-art language models. You will be responsible for architecting, implementing, and optimizing large-scale data pipelines that handle diverse datasets, ensuring data quality, reliability, and accessibility for our research and engineering teams. This is a remote contract position offering the opportunity to work on challenging problems at the forefront of AI.

Key Responsibilities

• Design and build robust, scalable data pipelines to collect, process, and store large volumes of structured and unstructured data.
• Develop and maintain ETL/ELT processes, ensuring data integrity, consistency, and availability.
• Collaborate with machine learning engineers and researchers to identify data requirements and implement efficient data solutions.
• Optimize data storage and retrieval systems for performance, cost-effectiveness, and reliability.
• Monitor pipeline health, troubleshoot issues, and ensure data quality through validation and testing.
• Contribute to data governance, security, and compliance best practices.
• Document data architecture, workflows, and procedures.
• Stay current with emerging technologies and recommend improvements to the data stack.

• Experience: 5+ years in data engineering or related field.
• Programming: Fluency in Python or Scala; experience with SQL.
• Big Data Tools: Hands-on experience with Apache Spark, Kafka, or Flink.
• Cloud Platforms: Proficiency with AWS, GCP, or Azure; experience with cloud-native data services.
• Data Warehousing: Strong knowledge of data warehousing concepts and technologies (e.g., Snowflake, BigQuery, Redshift).
• Orchestration: Experience with workflow orchestration tools like Airflow or Prefect.
• Databases: Familiarity with both relational (e.g., PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Version Control: Proficient in Git and CI/CD pipelines.
• Soft Skills: Excellent problem-solving skills, attention to detail, and ability to work independently in a remote environment.
• Language: Professional proficiency in English (French is a plus but not required).

• Contribute to cutting-edge AI technology development
• Work with a talented and passionate team
• Opportunities for professional growth and learning
• Flexible remote work environment
• Competitive compensation package