Data Engineer - Processing & Analysis
Shopee
Singapore, SG
3d ago

Job Description :

  • Design,build and maintain the ingestion system to support various types of data(e.g. User behavior, RDS, NoSQL db and others) to be ingested to the data warehouse more timely and accurately
  • Translate data requirements into scalable technical data service with low latency and high concurrency
  • Design,build and maintain the batch or real time data pipeline in production using Hadoop big data technology
  • Analyze and improve efficiency, scalability, and stability of the system
  • Define and manage SLA,Data quality for all data sets in allocated areas of ownership
  • Requirements :

  • Minimum B.S. degree in Computer Science or a related technical field
  • Less than 1 year of experience welcomed
  • Working experience in programming languages,such as Java,Scala,Python
  • Familiar with Hadoop, Spark and Flink data processing, experience of TB data processing experience is a plus
  • Familiar designing and operating of a robust distributed system is a plus
  • Understand data mining or machine learning
  • Excited to work intimately with data
  • Passionate, self-motivated, and takes ownership
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form