Data Engineer (Hadoop, Spark, Kafka)

Evaluate current complex data architecture in the organization and identify mandatory improvements
Define strategies for data infrastructure to fulfill data analytic and utilization needs of the organization
Design and deliver data infrastructure and functionalities with the most suitable technologies for data analysts, data scientists, and other business roles to monetize data and fulfill the strategy of VNPAY
Ensure data assets are organized and stored most efficiently for mining purposes
Proactively collaborate with data users to understand data requirements, build and deploy optimized data solutions
Strategically explore and obtain data and information from various sources within the ecosystem and external partners into VNPAY’s core platform
Design, build and maintain optimized data pipelines and ETL/ELT solutions as business support tools in providing analysis and real- time analytics platform for critical decision making.
Manage and drive the upgrades to systems and storage to accommodate business and product requirements for data operations

Yêu cầu công việc

Deep experiences in optimizing ETL tasks, designing and building dimensional data models
Understanding of Information Security principles to ensure compliantly
Experience working in Agile teams to lead successful innovative projects with a cross- functional team
Good at 1 of these 3 programming languages: Java, Scala, Python
Worked with Docker, Kubernetes, Google Bigquery, Cassandra is a plus
Worked with NOSQL databases: Mongo, Redis and SQL databases: oracle, Postgres
Workded with HyperLogLog algorithm is a plus
Experience architecting, coding, and delivering high- performance microservices and/or delivering solutions serving millions of users
Basic knowledge of searching and sorting algorithms.
Worked with bigdata eco- system: Hadoop, Spark, Kafka, Nifi, Airflow, Flink, Kafka, Hive, Delta Lake

Time work: Mon- Fri (8:00- 17:30)
Comfortable working conditions
Negotiable salary according to qualification + Performance Bonus
Good career growth opportunities with interesting and challenging projects;
Free breakfast, Lunch allowance, Beauty allowance
Healthcare: Annual health check- up, Premium Health Insurance for Employee and Family
Outdoor activities with company support: sports clubs, team building, year end party
Performance review each year and salary adjustment based on job performance

Cập nhật gần nhất lúc: 2024-07-03 09:35:03