HCLTech & ANZ - Big Data Engineer (Hadoop)

INTRODUCTION
This is an exciting project in which employees get the opportunity to experience the most modern data tool stack. Project is delivered in Agile ways of working, an excellent opportunity to work for a global leader. Joining us, you are the ones who create this innovative journey, you will have many chances to learn & work with the latest Cloud and Data Analytics technologies.
HCL Technologies, as the leader in Cloud & Digital Analytics services, are proud to be the key technology partner for our customer in this digital transformation journey. HCL is setting up large delivery centers for digital transformation projects in Vietnam and as part of that we are starting a delivery center in Ho Chi Minh City for Data transformation initiative of a major Global Bank. Work involves transforming legacy data into modern digital data technology and hosting it in Google Cloud Platform.
DUTY & RESPONSIBILITIES
As a Hadoop Big Data Engineer, you will operate and monitor scalable and resilient data platform based on Hadoop ecosystem, on production phase
Major Tasks (80%)

Work on small enhancements (Analysis, Build/test, Deployment/Release support)
Technical analysis, trouble shooting and fixing the Production Incidents, Problem tickets andChanges
Take ownership of (Data processing/Batch Jobs) applications from a Support & Maintenance perspective
Responsible for production environment, build, deploy, monitor and bug fix on production environment.
Provide high operational excellence guaranteeing high availability and platform stability.

Other Tasks (20%)

Engineer reliable data pipelines for sourcing, processing, transforming, enriching and storing data in different ways, using data platform infrastructure effectively
Focus on ingesting, storing, processing, and analyzing large datasets
Ingest and transform data sets from a variety of data sources
Create scalable, high- performance web services for tracking data

Yêu cầu công việc

Must requirements:

Experience debugging and deploying application on Big Data platform
Must have 3+ years of experience at a similar role
Good experience in automating manual activities using python or unix scripts
Strong Linux/Unix skills
Understanding of SLA and meeting Timelines for SRE activities
Good experience in log analysis and management in distributed Hadoop platform along with dashboarding and automated monitoring of applications health.
Having hands on experience in Hadoop ecosystem (on- prem) including Spark, HDFS, MapReduce, YARN, Hive, Kafka,
Expertise in at least one commercial distribution of Hadoop

Good to Have:

Exposure to any CI/CD tools such as Jenkins, Bamboo or Github actions
Experience with Data warehouse and Data management: Data Quality, Data integration
Experience in Data API
Experience in ETL, SQL and NoSQL Database
Good in programming language Python, Java, etc

• 18 paid leaves/year (12 annual leaves and 6 personal leaves)
• Insurance plan based on full salary + 13th month salary + Performance bonus
• Meal allowance of 730,000 VND/month
• 100% full salary and benefits as an official employee from the 1st day of working
• Medical benefit for employee and family
• Working in a fast- paced, flexible, and multinational working environment. Chance to travel onsite (in 53 countries)
• Free snacks, refreshment, and parking
• Internal training (Technical & Functional & English)
• Working time: 8:30 AM- 6:00 PM from Mondays to Fridays

Cập nhật gần nhất lúc: 2024-06-02 19:50:04