Senior Data Engineer (Python/ Data integration)

Develop and implement data architecture and data management best practices
Implement data governance and security measures
Design, build, and maintain scalable data pipelines and systems
Maintain the CI/CD pipeline, monitor logging for data- related projects
Manage and administer data integration tools such as dbt (data build tool) to transform and model data
Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver high- quality data solutions
Optimize and improve data systems and processes for better performance and scalability
Integrate third- party services and APIs
Ensure data quality through validation, testing, and monitoring

Yêu cầu công việc

Must Have:

Strong experience with data integration tools, especially Airflow, dbt, Dagster...
Over 5 years of experience in data engineering or a similar role
Strong problem- solving skills and attention to detail
Knowledge of CI/CD practices and tools
Experience with data modeling and database design
Hands- on experience with cloud data warehouses such as Snowflake, BigQuery, or Redshift
Familiarity with Docker for containerization
Knowledge of ETL processes and tools like Airflow or similar
Experience with additional Python back- end frameworks such as Django, Flask and FastAPI, SQL Alchemy
Excellent communication skills and the ability to work collaboratively in a team environment.

Nice to have:

Experience in a SaaS company or working with large- scale data systems
Familiarity with other data orchestration tools.

Full social insurance coverage and premium healthcare benefits
Competitive salary
Encouragement of a self- driven, results- oriented work culture
15 days of annual leave
Annual health check- up
13th- month salary
Monthly Team Outing, Company Trip, Year End Party and Events

Cập nhật gần nhất lúc: 2024-08-08 14:00:03