As a Data Engineer, you will play a key role preparing the infrastructure and data that will be used to deliver high quality data products. You will help us design, develop and maintain data pipelines that will deliver insights. By using a DevOps approach, you will make sure the overall system is running on all times by automating tasks so you can spend time on creating and not deploying. 

You will also make sure the system is appropriately tested and monitored by using adapted methods and tools. You will collaborate with the other data engineers and data scientists of the Advanced Analytics team to create the simplest possible effective data landscape to improve delivery speed of future AI use cases. 

Required Responsibilities:

• Execute ETL (extract/transform/load) processes from complex and/or large data sets
• Collaborate with machine learning engineers for the implementation, deployment, scheduling and monitoring of different solutions 
• Ensure robust CI/CD processes are in place 
• Promote DevOps best practices in the team
• Simplify & optimise existing pipelines if needed 
• Ensure data are easily accessible and that their exploitation is performing as requested, even in highly scalable circumstances 
• Conceive and build data architectures to support data scientists 
• Participate to the architecture and planning of the big data platform to optimise the ecosystem’s performances 
• Participate in the short/mid/long term vision of the overall system 
• Create large data warehouses fit for further reporting or advanced analytics 

Degree & Experience: 

• University degree in Computer Science, Mathematics, Engineering, Economics... or equivalent work experience with specialised training/certification 
• 3+ years of experience supporting or working in Data engineering environments 
• Experience with an agile way of working is a plus 

Technical skills: 

• Data pipeline management (sqoop, hive, nifi) 
• Cluster management (Cloudera) 
• Workflow management (Oozie, Airflow) 
• Database management of SQL and NoSQL databases 
• Large file storage (HDFS, Data Lake, S3, Blob storage,..) 
• Data science environment setup (conda, jupyter) 
• Strong knowledge of Scala and Python 
• Strong knowledge & experience in Spark (Scala and Pyspark) 
• Strong knowledge of CI/CD concepts 
• Strong knowledge of SQL (Teradata /Oracle) 
• High level understanding of data science concepts 
• Knowledge of Linux / Windows server (connection, folder creation, software installation, creation of ODBC connections, work in client-server environment, IT infrastructure (support groups, admin rights, ) 
• Stream processing such as Kafka, Kinesis, Elasticsearch is a plus 
• Experience with AWS is a plus 

Attitudes/Behavior: 

• You’re quality oriented 
• You are an excellent problem analyser and solver 
• You’re open minded, collaborative, team player, ready to adapt to the changing needs 
• You are curious about new techniques and tools, eagerness to always keep learning 
• You are convinced having a good infrastructure is essential & you can motivate and drive changes if needed
• You’re committed to deliver, pragmatic and solution oriented. 

Languages: 

Very good knowledge of English and French or Dutch

Our Offer: 

• A personalized salary package: we know that everyone has different needs, so you have the chance to supplement your salary with benefits that you need most today. A car, additional insurance, a leased bike,... the choice is yours thanks to our Flex Income Plan!
• Personal guidance: we believe in the power of human connections, so we'll assign you a dedicated talent manager who will always have your back. Whether you need support during challenging projects or just a friendly ear to listen, your talent manager is here for you. 
• Career planning and professional development: our learning and development team is here to help you create your dream career. Think of them as your fairy godparents - but with less bibbidi-bobbidi-boo.
• Team events: a team that plays together, stays together. From an after work drink to a quiz night, we'll make sure you feel like part of the family.
• We care, we grow, we recognize: we invest in these 3 pillars in order to build a sustainable career for you. We have lots of initiatives in place to help you stay healthy and happy so that you can take on every challenge that comes your way and feel appreciated. 
• Challenging projects and an entrepreneurial culture: get ready to flex your muscles on some seriously impressive projects. It's like the Olympics, but without the lycra.
• Learning from peers: as a technical expert, you will be part of our chapters: vibrant communities filled with colleagues who are passionate about a particular area of expertise. our chapters are all about promoting learning within your area of expertise - in a fun and informal way!