Senior Data Engineer Python, SQL

Overall Job Purpose

The Senior Data Engineer will be part of Data Engineering team which is creating, maintaining, scaling and improving the enterprise data platform providing the data for AI/Data Science solutions, applications/tools, and other digital use cases.

Core Responsibilities

Implement data quality frameworks and ensure data governance best practices, including data lineage, data documentation, and data security.
Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.
Work closely with Data Analysts and Data Architect to support their data needs and enable advanced analytics and machine learning initiatives.
Identify and implement data quality monitoring and validation processes to ensure data integrity.
Design, develop, and maintain robust, scalable and sustainable data products and build & optimize data pipeline and infrastructure.
Build out the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Synapse, ADF, Spark, Kafka, or similar technologies.
Contribute to the development of the organization&039;s data strategy, including evaluating new technologies, tools, and frameworks to enhance the data engineering ecosystem.

Yêu cầu công việc

Educational Qualification & Experience

2+ years&039; experience in creating and deploying docker containers on Kubernetes.
Knowledge of Agile methodologies and software development lifecycle processes
2+ years&039; experience with CI/CD pipelines toll such as Jenkins and GitHub Actions
4+ years of experience in scripting and automation using languages such as Bash, Python, or Go2+ years of experience with infrastructure- as code tools such as Terraform, Ansible, or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).
2+ years&039; experience in supporting development teams on Kubernetes best practices, troubleshooting, and performance optimization.
2+ years&039; experience with Synapse data warehousing and data lake solutions
4+ years&039; experience with Azure services including IAM, Synapse, DataLake, SQL Server, ADF etc.
BA/BS degree in Computer Science, Computer Engineering, Electrical Engineering or related technical field
4- 8 years to total IT experience preferably in field of data engineering
Proven experience in designing and implementing large- scale data solutions, including data pipelines and ETL processes on Azure.
Strong programming skill in Python, PySpark and SQL

Required Knowledge:

Strong understanding of data architecture principles, data modelling techniques, and data integration patterns.
Troubleshoot and resolve data- related issues, performance bottlenecks, and scalability challenges on Azure
Work closely with stakeholders to understand business requirements and translate them into data solution designs.
Solid understanding of DevOps principles and experience with infrastructure automation using tools like Terraform or CloudFormation.
Hands- on experience with cloud platforms- Azure, and related services (e.g., Synapse, Data Lake, etc.).
Understandings of data warehousing concepts and best practices

Language(s) and Software:

Excellent in English (speaking and writing)

Key Behaviors:
Soft Skills (Professional) List maximum 3
Excellent analytical abilities.
Excellent communication skills with a strong technology focus.
Problem Solving – providing sustainable solutions.

Annual medical check- up program
Mobile phone allowance
13th month salary
Working equipment: new laptop
Retention bonus/ Discretionary bonus
16 days of annual leave for 1st one year of service.
Personal accident & term- life insurance for immediate family member (legal spouse/children)
Medical treatment expenses as per Company’s Healthcare plan
Annual salary review

Cập nhật gần nhất lúc: 2025-07-08 21:50:03