Senior/Leader Data Engineer (Database, MySQL, SQL)

To be successful in this role, you have to be an experienced Data Engineer with demonstrated knowledge and experience within data delivery, ETL/ELT, data management, solution design and delivery. Critical to success will be strong communication skills, analytical mindset, excellent documentation skills and have demonstrable experience in working with a variety of business stakeholders.
The Data Engineer is responsible for day- to- day technical development and delivery of data pipelines into StorAI data. You will ensure delivery of solutions based on the backbone of good architecture, best data engineering practises around operational efficiencies, security, reliability, performance and cost optimisation.
We are looking for a Senior/Leader DataOps Engineer to join our team.
Core Responsibilities

Design enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories, and models for structured/unstructured data.
Create and maintain documentation on data pipelines
Work with customer service, devops, and quality assurance teams to move software through the pipeline to the customer
Build the infrastructure required for optimal acquisition, transformation, and provisioning of data from a variety of data sources.
Design, implement and maintain a robust, efficient and compliant data pipeline architecture.
Engage with our software engineering team to ensure precise data points per application specifications
Help the team to maintain an overall position of strong data governance with great data observability (data monitoring & alerting, CI/CD pipelines).
Develop ETL/ELT solutions using Azure Bob Storage, Data Factory), Spark, and Python to load data across multiple sources into Azure Snowflake.
Support various components of the data pipelines, including ingestion, validation, cleansing and curation.
Manage and ensure the success of ongoing data pipeline routines.

Yêu cầu công việc

Experience with relational SQL and NoSQL databases, including Postgres and MSSQL Server.
Expertise with ETL/ELT and the development of automated validation and data pipelines
Experience working within hybrid cloud environment; Azure experience is a plus
Experience with basics of search engines/indexing (e.g. Elasticsearch, Lucene)
Ability to work on high performing teams supporting multiple projects and personnel.
Expert Understanding of CI/CD and DevOps methodologies
Experience with the managing team.
Experience with common distributed data tools in a production setting (Spark, Kafka, etc)
Bachelor&039;s or master&039;s degree in computer science, information systems, engineering, or equivalent
Good English verbal communication.
Experience with Linux, Docker and Bash scripting.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience with object- oriented/object function scripting languages: .Net Core, C, Python, Scala,etc

Salary & Allowances

Annual leave: 12 days/year and other leaves/public holidays in accordance with the Labor Law of Vietnam
Be provided with high performance laptop and screen
Competitive income with 13th month salary and attractive performance bonus.
Periodic medical checkup, Health/Social Insurances. Especially, Health Insurance after 10 months of employment

Career Growth

Opportunity to experience a great workplace where young & world- class talents work together passionately
Clear and flexible career path
Very diverse offline and online seminars & workshop provided by company, supervisors, mentors and buddies

Working Environment

Working in a progressive and international environment.
Team building, company trip and monthly internal events.
Complimentary snacks, fruits, drinks everyday.

Cập nhật gần nhất lúc: 2024-06-14 02:20:02