Data Infrastructure Engineer
Shopee Singapore
4d ago
source : Jobg8

The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies.

  • Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do;
  • we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.

    Job Description :

    Design and grow the Shopee data platform to support a variety of big data applications using open-source technologies including Kafka, Hadoop, Presto, HBase, Spark, Hive, Druid, and our own creations.

    Some examples include a real-time data streaming platform, a unified query platform, a cluster management system, and a machine learning platform

    Dig into the source code of some open-source big data system to get the whole control and familiar with the details, configurations, designs and source code.

    Develop and maintain the internal release of big data systems and components as the business requirements.

    Keep close and overall monitoring for all the deployments of the systems, maintain the system's stability, improve the performance, discover the performance bottlenecks, tracking and troubleshooting, cost optimisation.

    Requirements :

    B. Sci. / Ms / PhD in Computer Science or a related technical field

    Familiar with at least one of these languages : Java, Scala, Python, Bash under Linux / Unix. Scala is a plus

    Familiar with the use and compute logical of SQL

    Knowledge about the Big Data Infrastructure system technology like Distributed File System, Distributed Computing, Distributed Database will be a plus

    Hands-on experiences Hadoop, Spark, Kafka, and / or Presto will be a plus

    Love to use and develop open-source technologies

    Passionate, self-motivated, and takes ownership

    Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form