We are looking for a Senior Python Data Engineer to join a technical team responsible for modernizing a data platform. You will contribute to the migration of legacy ETL workloads to a modern architecture based on Python, Parquet, and Spark, while leveraging Artificial Intelligence to industrialize and optimize migration processes.
You will work in an innovative environment where AI supports software analysis, code generation, validation, and automation. You will collaborate closely with Data Engineers, Architects, and technical experts to deliver reliable, scalable, and high-quality data solutions.
Your Responsibilities
- Design, develop, and maintain Python-based data transformation solutions.
- Participate in the migration of legacy ETL processes to a modern data platform.
- Review, optimize, and enhance AI-generated Python code.
- Ensure code quality, performance, maintainability, and operational reliability.
- Implement data quality controls and manage data schemas.
- Develop data processing solutions using Pandas, Polars, PyArrow, Parquet, and PySpark when appropriate.
- Contribute to the improvement of AI-assisted workflows and multi-agent systems supporting the migration factory.
- Help develop validation, testing, and monitoring mechanisms for automated migration processes.
- Collaborate with cross-functional teams to improve platform performance, scalability, and automation.
- Support complex migration scenarios requiring advanced technical expertise.
Candidate Profile
We are looking for a professional with:
- At least 5 years of hands-on experience in Python Data Engineering.
- Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, and testing frameworks.
- Solid experience with ETL/ELT processes, data quality management, and schema management.
- Experience with PySpark is considered a strong advantage.
- Experience using AI-assisted development tools such as GitHub Copilot or similar solutions.
- Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and human-in-the-loop validation.
- Experience with SAS or the ability to understand legacy SAS programs is considered an asset.
- Strong analytical thinking, problem-solving abilities, and teamwork skills.
- Good working knowledge of French, Dutch, and English.
Why Join Us?
- Be part of an innovative project combining Data Engineering and Artificial Intelligence.
- Contribute to the modernization of a large-scale data platform.
- Work with cutting-edge technologies such as Python, Spark, Parquet, and AI-powered development tools.
- Collaborate with experienced professionals in a dynamic and supportive environment.
- Expand your expertise by working on technically challenging, high-impact projects.