Middle - Senior Data Engineer (Azure, Databricks)

The position requires a deep understanding of data engineering principles and the ability to apply them effectively in a dynamic environment.
We are looking for a skilled Data Engineer with expertise in Python, Pytest, and Databricks. This role involves designing, developing, and maintaining data processing systems and pipelines, utilizing Python’s full capabilities and Databricks’ cloud- based analytics platform.
RESPONSIBILITIES

Build data warehouses and data lakes to store and manage data
Work with the infrastructure team to build data warehouse or data lake to support customers for data driven decisions.
Stay up- to- date on the latest data technologies
Develop and deploy data processing and analytics tools
Cooperate with the infrastructure team to design, develop, and maintain the customers’ data platform.
Build data pipelines to extract, transform, and load data from a variety of sources

Yêu cầu công việc

Capacity to work both independently and collaboratively within a team, showcasing strong problem- solving skills and initiative.
Proficiency in SQL and excellent programming skills in Python (pandas, polars, pyspark) or Scala, including unit testing with tools like pytest.
Minimum of 3 years of hands- on experience in data engineering, demonstrating practical proficiency.
Proven experience with a variety of data technologies, including Databricks and Azure Data Factory (ADF), AWS Glue or similar cloud services
Strong understanding of data engineering principles and practices, with a focus on real- world application.
Demonstrated ability to learn and apply new technologies in a hands- on manner quickly.
Experience with cloud computing platforms such as Azure/AWS/GCP, with preference given to candidates holding relevant cloud data certifications (Azure Data Engineer Associate, AWS Certified Data Engineer, Google Professional Data Engineer)..
Experience with data visualization tools like PowerBI or Tableau is a plus.
Familiarity with big data technologies, such as Hadoop, Spark, and Hive, is highly desirable.
Bachelor’s degree in computer science, data science, or a related field.

Participate in exciting company outings, events, and team- building activities.
Receive your full salary during the probation period.
Thrive in an open, friendly, professional work environment with a values- driven, agile culture.
Take advantage of sponsorship for training courses and professional certifications.
Enjoy a 13th- month salary as an annual bonus.
Maintain a healthy work- life balance with a 40- hour work week, Monday through Friday.
Embark on an attractive career path with a strong personal and professional development focus.
The company covers parking allowances.
Comprehensive insurance coverage in line with Vietnamese labor law, plus premium healthcare.
Benefit from annual salary reviews for potential increases.

Cập nhật gần nhất lúc: 2024-09-25 12:05:03