Google Cloud Platform (GCP) – Cloud Data Engineer

INTRODUCTION
Our customer is one of the leading Australian banks in the Asia-Pacific region. In recent years, the customer was investing in digital-led business transformation to continue to stay ahead of the competition and also meet emerging customer needs.
DUTY & RESPONSIBILITIES
The customer was looking for a digital transformation to respond quickly to changing market conditions while being resilient and scalable. Among technology initiatives Cloud and Big Data Analytics are two key strategies that our customer focus on.
You will be responsible for building and running the data processing pipeline on Google cloud platform for one of Australia&039;s largest financial institutions:
• Integrate massive datasets from multiple data sources for data modelling
• Formulate business problems as technical data problems while ensuring key business drivers are captured in collaboration with product management
• Work with data team to efficiently use GCP to analyze data, build data models, and generate reports/visualizations
• Implement methods for Devops automation of all parts of the build data pipelines to deploy from development to production
• Design pipelines and architectures for data processing
• Extract, load, transform, clean and validate data
• Work with implementation teams from concept to operations, providing deep technical expertise for successfully deploying large scale data solutions in the enterprise, using modern data/analytics technologies on GCP cloud

Yêu cầu công việc

Must requirements:
• At least 3 years of experience in Cloud Platform, prefer GCP (Google Cloud Platform)
• Good at CI/CD Pipeline.
• Good at Tools & Ecosystem - Kafka or Beam or Cloud native ETL
• Proficient in Python or Java preferred for Patching & Automation
• Experience in Automation: Kubernetes or Docker & Containerization
• Have a strong engineering mindset to automate tasks, identify use cases, test cases, improve the system, PR/Incident resolution and deployments
Good to Have:
• Knowledge or Experience in Hadoop – MapReduce, Hortonworks, Cloudera comparison and feasibility
• Knowledge or Experience in Cloud SQL, No SQL, R, SRE,
• Knowledge or Experience in Big Data - Hadoop - Architecture in general or Cloudera - Architecture and usage
• Knowledge or Experience in Spark, Hive, Hbase or general architecture and comparison,
• Knowledge or Experience in DataFlow/AirFlow
• DBT tool experience preferred

• Meal allowance 730,000/month
• Medical Benefit (Bao Viet Insurance Package) for Employee and Family
• Insurance based on full base salary
• Working in a fast paced, flexible, and multinational working environment with opportunity to travel onsite (in 49 countries)
• Working time: 8:30 am-6:00 pm from Mondays to Fridays
• Attractive package including base salary + 13th month salary + Performance Bonus
• Internal Training (Technical & Functional & English)
• 100% of full salary and benefits as an official employee from the 1st day of working

Cập nhật gần nhất lúc: 2021-06-14 09:02:02