Senior Data Engineer SQL, AWS, Python

We are seeking a
Senior Data Engineer
to play a pivotal role in building our data platform from the ground up. You will be responsible for designing, developing, and deploying a scalable, secure, and open- source based data platform on the
AWS cloud
. This is a unique opportunity to shape the future of our data infrastructure and empower data- driven decision making across the organization.

Ensure data quality and consistency throughout the data lifecycle.
Evaluate and select appropriate open- source tools and services for data ingestion, transformation, storage, and analytics.
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and translate them into technical requirements.
Monitor and troubleshoot data platform performance to identify and resolve issues proactively.
Implement data security best practices to protect sensitive information.
Develop and maintain data pipelines for efficient movement and processing of large datasets.
Document data platform design, architecture, and processes for future reference.
Stay up- to- date on the latest trends and technologies in the data engineering space.
Design and implement a robust data platform architecture on AWS, leveraging open- source technologies whenever possible.
Automate data platform tasks and processes for improved efficiency and reliability.

Yêu cầu công việc

Experience with cloud platforms, preferably AWS.
Expertise in designing and building scalable data pipelines.
Excellent written and verbal communication skills.
Proficient in working with open- source data technologies (e.g., Apache Spark, Apache Airflow, Kafka, etc.).
Solid knowledge of SQL and experience with relational databases.
Ability to work independently and as part of a cross- functional team.
Strong understanding of data engineering principles and best practices.
Proven experience 4+ years as a Senior Data Engineer or similar role.

Bonus Points

Experience building data platforms for similar industries.
Experience with data governance and data security frameworks.
Experience with machine learning and data science workflows.
Experience with DevOps principles and practices.

Other rewards: 5- star, employee of the month (EOTM), employee of the year (EOTY), loyalty employee (3- year, 5- year, 8- year, etc.)
Good chance to study and develop career path stably with internal promotion and rotation.
Bao Viet Healthcare insurance.
Annual bonus: depending on business & individual performance.
Annual salary review.
Working time from Monday to Friday (09:00 am- 18:00 pm).
100% gross salary in probation.
12 Annual Leave (AL) per year + extra 1 AL per extra working year.
Internal Activities: General Meeting, Company Trip, International Women&039;s Day, Vietnamese Women&039;s Day Mid- Autumn Festival, Family Day, Christmas, Year- end Party, etc.
100% statutory insurance contribution as per the labor law.

Cập nhật gần nhất lúc: 2024-12-05 19:45:03