Senior Software/ Data Engineer (Hybrid Work)

KKLab is seeking a talented senior data engineer to build systems that collect and convert raw data into usable information for our AI systems, including recommendation engines, data analytics platforms, as well as systems that manage the data workflows among different components.  

KKLab has two complex AI products in the market, KKRaaS and Lyricist.ai. KKRaaS is a generic recommendation platform and Lyricist.ai is a lyrics generator. KKLab also incubates several AI projects. Our systems handle large amounts of customer-defined data of various types everyday. The data is ingested and used in both retraining AI models and analytic platforms automatically. Hence the data pipeline automation, quality monitoring, anomaly detection, fault recovery and computation efficiency are crucial to our system operation.

We are looking for a candidate who is self-motivated with strong coding skills and passionate about engineering excellence. We build our system by combining our in-house solutions with AWS cloud services and open source software. The candidate should be also familiar with the open source data engineering ecosystem.

Responsibility

• Working with cross disciplinary teams including product managers, machine learning engineers, service engineers to develop enterprise-grade AI systems.
• Design, implement and optimize automated workflows to minimize human effort required in running machine learning processes, ETL processes, etc.
• Design and implement internal developer tool chains to facilitate the progress of product development..
• Design and implement data analytic tools to help data scientists generate insights.

Minimum Qualifications:

• 3+ years of experience in data engineering.
• Expert in Python, Java, Scala, shell script. 
• Working experience with developing software utilizing AWS, GCP or Azure services.
• Working experience with tools that can help cloud service development, e.g. Kubernetes, Ansible, Terraform, Docker, etc.
• Familiarity with relational databases and NoSQL DB.
• Familiarity with big data technologies, such as Hive, Hadoop, Presto, Spark.
• Familiarity with open source search solutions such as elastic search.

1. Hiring manager / 15~30m / phone
2. Team, bar raiser / 60~90m / Google Meet, Codility
3. GM, hiring manager / 60~90m / Google Meet