Senior Data Engineer

Develop efficient software code for multiple use cases leveraging big data technologies for various use cases built on the platform
Communicate effectively with Developers and Business users to understand and clarify requirements.
Design and maintain optimal data and machine learning pipeline architecture.
Support internal training and proper documentation ensuring the successful onboarding of new team members
Assemble large, complex data sets to build data marts that meet functional/non- functional business requirements.
Implement internal process improvements: automating manual processes, optimizing data delivery, re- designing infrastructure for greater scalability, etc.
Possess an understanding of the data structures and governance.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.

Yêu cầu công việc

Obsessed with Data Quality and Data Observability. Experience in data lineage and data testing processes
3+ years’ experience working as a Data Engineer role, ETL with large amounts of data.
Experience with software engineering best practice in version control and CI/CD
Experience with using the following software/tool in the big data field.
Experience with data warehousing architecture and data modeling, ETL data pipeline in both batch and real- time applications
Bachelor’s degree in computer science, engineering, management information system or a related technical discipline.

○ Big data technology: Apache Spark, Apache Beam, Presto, Kafka, Redis, etc.
○ Linux and command line interfaces
○ ETL/Reverse tools: Talend, CDAP, Azure Data Factory, Airbyte/ Matillion, Census, dbt, etc.
○ NoSQL and OLAP database: MongoDB, Elastic search, Clickhouse/Druid, Prometheus, InfluxDB, etc.
○ Monitoring tools: Grafana, Kibana, etc.
○ Workflow management tools: Airflow, Prefect, Dagster, etc.

Good at programming languages: Python, Java, etc.
Experience in performing root cause analysis, identify problems and propose recommendations for improvement.
Strong organizational and multitasking skills with the ability to balance competing priorities
Experience modern cloud computing platforms and concepts is a plus (Azure/GCP)

Who we are looking for
“Attitude eats skills for breakfast”: we greatly value people who possess the 3 personal traits:

Curiosity
Growth mindset
Automation

Attractive 13th- month salary and high performance bonus in the year.
Internal activities, sport, and social clubs, gym, yoga, swimming…
Premium private insurance with a discount for family members.
Competitive salary and benefits on Top in VietNam.
Opportunity to train both technical and soft skills to develop your career path.
Annual performance review for salary raise and promotion.
Company trips and team buildings.
Gifts on special accession: individual /company birthday, Tet, and Holidays.
Annual health check.

Cập nhật gần nhất lúc: 2024-12-09 07:10:03