Big Data - Hadoop Engineer (up to 4000Usd)

Salary up to 4000USD with JOINING BONUS 30,000,000VND
As a Hadoop big data engineer, you will develop, operate and drive scalable and resilient data platform based on Hadoop ecosystem to address the business requirements:
• Design and implement business-specific large-scale data processing pipelines
• Responsible to Ingest data from files, streams, and databases. Process the data with PySpark, Kafka, Hive, Hive LLAP…
• Develop efficient software code for multiple use cases leveraging Spark and Big Data Technologies for various use cases built on the platform
• Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
• Work with complex data structures, manipulate, cleanse data, and perform transformations to make insights from data.
• Provide high operational excellence guaranteeing high availability and platform stability.

• Experience with Apache Kafka
• Experience with Apache Beam
• Good in programming language Python, Java
• Good to have cloud Skills and Experience, SQL/NoSQL database on Cloud, especially GCP
• Experience with Hadoop distributions such as Cloudera, HortonWorks, GCP…
• Experience with Apache Spark using PySpark
• Experience with SRE, Patching & Automation: Kubernetes or Docker & Containerization
• Experience in Hadoop ecosystem including HDFS, MapReduce, YARN, HBase, Zookeeper, Pig, Hive…
• Experience in building large-scale data processing (batch-processing, stream processing)
Candidate Data Privacy Notice: www.hcltech.com/candidate-privacy-notice

100% salary in probation period

Premium Health Insurance service for Employee and Family

18 leaves per year

Cập nhật gần nhất lúc: 2021-10-28 18:52:03