The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies.
we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.
Job Description :
Design and grow the Shopee data platform to support a variety of big data applications using open-source technologies including Kafka, Hadoop, Presto, HBase, Spark, Hive, Druid, and our own creations.
Some examples include a real-time data streaming platform, a unified query platform, a cluster management system, and a machine learning platform
Dig into the source code of some open-source big data system to get the whole control and familiar with the details, configurations, designs and source code.
Develop and maintain the internal release of big data systems and components as the business requirements.
Keep close and overall monitoring for all the deployments of the systems, maintain the system's stability, improve the performance, discover the performance bottlenecks, tracking and troubleshooting, cost optimisation.
B. Sci. / Ms / PhD in Computer Science or a related technical field
Familiar with at least one of these languages : Java, Scala, Python, Bash under Linux / Unix. Scala is a plus
Familiar with the use and compute logical of SQL
Knowledge about the Big Data Infrastructure system technology like Distributed File System, Distributed Computing, Distributed Database will be a plus
Hands-on experiences Hadoop, Spark, Kafka, and / or Presto will be a plus
Love to use and develop open-source technologies
Passionate, self-motivated, and takes ownership