Data Engineer (m/f/d), Esch-sur-Alzette

Your tasks

You will actively participate in our group wide energy data management initiative focusing on better understand our customer behaviours and needs, forecast the future energy demand, improve customer servicing, and innovate new business ideas in a fast-moving energy sector.

• You manage the data integration pipelines of the Enovos IT ecosystem to the target data lakes/data marts
• You work on test automation, environment anonymisation and refresh
• You optimize the current data lakes/marts and conceptualize the future data analytics backbone
• You investigate in the data structure required by business domains and setup these structure for further data analytics needs
• You work in tight collaboration with application analyst and business partners to extract insights from our data analyse, collect, organize, and store data with the necessary tool framework
• You define, design and execute reports using off-the-shelf tools like Tableau
• You assess business/market/customer needs and provide advise around data

For doing this, you will have the opportunity to use top notch technologies in our AWS Cloud:

• Exasol as our current in memory analytics data warehouse
• Apache Cassandra as our current NoSQL data lake
• Apache Spark as our data processing and analytics engine
• Apache Airflow for building, scheduling, and monitoring workflows
• Elastic stack as our log monitoring system
• Mule as our integration and API platform
• Tableau for data visualization

Your profile

• You hold a university degree in computer science/computer engineering, science, mathematics, or you have an equivalent working experience
• You have demonstrated abilities for complex problem analysis and resolution and have a hands-on mentality
• Experience with different data integrations techniques and data modelling is mandatory
• You are proficient with one or more of the following programming languages:
  • CQL, SQL, LUA
  • Scala, Python, Node.js
• You have a very good understanding of database technologies (NoSQL, Column-based)
• Experience with Cassandra is a strong asset
• You are aware of the good practices in continuous deployment/integration of applications
• Highly effective verbal and written communication skills in English. A good knowledge of German or French will be considered as an advantage