As a data engineer, you are responsible for designing, developing, testing, and maintaining ETL (extract-transform-load) programs.
These programs are used every day to handle a large amount of data coming from our products worldwide. Your work will influence users of our products as well as internal staffs from other departments.
You will work collaboratively with other colleagues to make decisions on technologies and product features.
Design and develop data pipelines to process a large amount of data from our products worldwide
Update and maintain existing data pipelines
Work with modern technology like Scala and Spark
Collaborate with other data engineers, web developers and data analysts on designing data models and product features
In-depth understanding of data structures and other computer science fundamentals
Master at least one of the following programming languages : Python, Scala, Java
Experience with one or more of these technologies : Spark, Hadoop, Oozie, MySQL
Experience with Linux and Shell scripting
Passionate about programming and new technologies in the field