- Creating and maintaining scalable data flows on Databricks integrated with AWS.
- Collaborating closely with cloud and frontend teams to unify data sources and establish a coherent data model.
- Ensuring availability, integrity, and performance of data pipelines.
- Proactively monitoring workflows to maintain high data quality.
- Working with cross-functional teams to identify opportunities for improvements and data-driven insights.
- Analyzing platform performance, identifying bottlenecks, and recommending improvements.
- Developing and maintaining comprehensive technical documentation for ETL implementations.
- Staying informed about the latest Databricks/Spark features and best practices, contributing to the continuous improvement of our data management capabilities.
- You have a Bachelor's degree in Computer Science, Information Technology, or a related field and a minimum of 3 years of experience as a Data Engineer, with proven experience in setting up pipelines on Databricks.
- You are experienced in the AWS cloud environment.
- You are proficient in the Python scripting language.
- Ideally, you have strong expertise in PySpark and SQL mastery.
- You possess excellent analytical and problem-solving skills.
- Ideally, you are familiar with industry-specific regulations and compliance requirements and have previous experience in the energy trading domain.
- You speak French and English.
Data Engineer - Geneva, Schweiz - Amaris Consulting
Beschreibung
Job description
As a member of the Data Engineering team, you will play a crucial role in overseeing the maintenance and optimization of data flows within the Databricks platform. Your main responsibilities will involve meeting the evolving needs of the company, refining ETL processes, and ensuring the smooth flow of energy data across our systems.
Your Responsibilities:
Designing, Developing, and Maintaining Robust Data Flows:
Ensuring Reliability and Performance of Data Pipelines:
Collaborating for Data-Driven Insights:
Documentation and Continuous Learning:
Your Profile:
Our Company Culture:
• Agility: Operating in a flexible, dynamic, and stimulating environment.
• Internationality: Benefiting from international collaborations and numerous mobility opportunities.
• Intrapreneurship: Involvement in parallel initiatives or developing your own Business Unit.
• Listening Management: Receiving personalized support throughout your professional journey.
Amaris Consulting is committed to diversity and inclusion. We encourage applications from all qualified individuals, regardless of gender, sexual orientation, race, ethnic origin, beliefs, age, marital status, disability, or any other characteristic.