Data Engineer

Job Purpose/Mission

• This position will be part of the Global Data team. This is an incredible opportunity to join a high-performing team that is passionate about pioneering expanded financial services to off-grid customers at the base of the pyramid. Key responsibilities will include building and maintaining data pipelines between our main transactional and analytics databases, IoT data delivered from devices, PBX, and our in-house ticketing system. You would also be responsible for building pipelines to deliver data in realtime to our field team mobile application to allow data-informed decisions to be made in the field, as well as working with members of the data team to ensure high code quality and database design. Your work will make a meaningful impact by enabling Engie to continuously innovate on how we support our customers in their repayment journey.

Responsibilities
Data Modelling and Extract, Transform and Load (ETL):

• Design and implement robust data models to support analytics and reporting requirements.
• Develop and maintain scalable ETL processes from various sources, including multiple ERP systems, into a data warehouse.

Data Ingestion and Automation data pipelines

• Implement data validation and quality checks to ensure accuracy and completeness.
• Design, build, and maintain automated data pipelines to streamline data processing and transformation.
• Utilize orchestration tools to schedule and monitor pipeline workflows.
• Collaborate with data analysts to understand data requirements and support their analysis needs.
• Optimize data structures and queries to enhance performance and usability for analytical purposes.

Data Warehousing

• Design and optimize data warehousing solutions to support business intelligence and analytics needs.
• Implement data modelling techniques to organize and structure data for optimal querying and analysis.

Optimization and Performance Tuning of Data Dashboards

• Troubleshooting and fixing issues on existing reports/dashboards while also continuously building improvements.
• Optimize dashboard performance and ensure responsiveness for large datasets and complex queries.
• Design, Data Visualization and Dashboards

Experience :

• 5+ years of industry experience working on data engineering with a focus on data ingestion, data warehousing, pipeline automation, and ETL development
• Experience building infrastructure to support streaming or offline data.
• Extensive programming experience in Python/Scala/Java
• Experience with SQL in addition to one or more of Spark/Hadoop/Hive/HDFS
• Working knowledge of databases, data systems, and analytics solutions, including proficiency in SQL, NoSQL, Java, Spark and Amazon Redshift for reporting and dashboard building.
• Experience with implementing unit and integration testing.
• Ability to gather requirements and communicate with stakeholders across data, software, and platform teams.
• Ability to develop a strategic vision for data pipelining and infrastructure.
• Experience managing a team of mid-level engineers.
• Sense of adventure and willingness to dive in, think big, and execute with a team

Qualifications :

• Bachelors or master’s in computer science , machine learning, or related field

Language(s):

• English
• French is a plus.

Technology :

• Python, Java, SQL, NoSQL, Amazon Redshift, Kafka, Apache Beam, Apache Airflow, Apache Spark