Data Engineer

* Role Description

- The data architect will provide specialist capability in developing fit-for-purpose data stores

advise on the data modelling for projects across the organization.

(database, data warehouse and data lake); assess the business strategy, and design and

* Responsibilities

- Prepare data users by conducting training, providing data model support, and resolving

problems

- Liaise with data engineer and project teams to ensure that data modelling standards and

- Design, maintains and enhance Enterprise Common Data Model and data catalogue

principles are followed consistently

- Responsible for designing processes for enhancing data processing performance, data

quality, data cleansing and data publishing

- Develop data and analytics frameworks to track data performance & quality issues

- Provide specialist support to projects and strategy shifts; and lead the development and

testing of new data solution designs

- Work with complex data structures, manipulate, cleanse data, and perform transformations to make insights from data.
- Responsible to ingest data from files, streams, and databases. Process the data with PySpark.
- Ensure industry best practices around data quality, data monitor

* Benefit package:

- Team building activity

- PVI Health care insurance

- Annual leave: 16 Annual leave, 6 Paid Sick Leave with 100% salary

- Allowance for personal interest: birthday, wedding, childbirth, funeral, ...

- Discount when using service of Pizza Hut

- Insurance based on full salary

- Annual health check

- Development opportunities provided by Innovate Jardines

- Attractive salary & bonus

* Qualifications and Requirements

- Experience with Apache Spark preferably in PySpark
- Having at least 1 year of experience working as a Data Engineer role
- Bachelor’s degree in computer science, engineering, mathematics, or a related technical discipline.
- Experience in Hadoop ecosystem including HDFS, MapReduce, YARN, Hive...
- Experience in building large-scale data processing (batch-processing, stream processing)

Good to have:

-Experience in Data API
-Experience with data warehouse and data management (data architecture, data modelling, data quality, data integration)
-Experience with Cloud (Google Cloud, AWS, Azure)
-Experience with relational SQL and NoSQL databases
-Good at programming languages: Python
-Experience working with Big Data
-Experience in Airflow pipelines

- Chăm sóc sức khỏe
- Công tác phí
- Đào tạo
- Phụ cấp
- Chế độ thưởng
- Phụ cấp thâm niên
- Du Lịch
- Chế độ bảo hiểm
- Laptop
- Tăng lương

Cập nhật gần nhất lúc: 2022-07-05 19:22:04