Data Engineer (AWS, Azure, Python)

Prepare go- live documents required by client following their deployment checklist
Monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them (new technologies, upgrades etc.)
Follow client&039;s technology stack in development of modules using PySpark, Python, SQL, AWS (S3, Lambda, Glue, Glue Catalog) but not limited to these technologies
Design, develop and implement complex data structures and data pipelines on AWS
Designing and developing data models, integrating data from multiple sources, data flow Design, building data pipelines for data platform- data lake, data warehouse, data Extraction, data Transformation and data Loading
Advise and suggest right architecture pattern and provide solution- ing guidance aligning with client&039;s architecture
Support go- live activities and post deployment verification and checks after go- live
Troubleshoot issues and provide fixes to bugs following coding guidelines from client
Support testing in SIT and UAT environments and provide guidance to testers when required
Data pipelines could follow either batch or streaming data processing

Yêu cầu công việc

Past experience of at least 2 years working in a client facing environment
Knowledge of data mining and segmentation techniques
Strong technical experience as data engineer
In- depth understanding of database structure principles
Has past experience in working in fast paced environment
Able to articulate the issue effectively with solutions and it&039;s pros and cons
Comes with a can- do attitude and has Problem- solving skills
Strong past experience with working on cloud technologies using AWS, Azure

Đặc quyền: Kế hoạch về sức khỏe và nghỉ hưu toàn diện.
Môi trường: Hợp tác, sáng tạo, định hướng phát triển.

Cập nhật gần nhất lúc: 2024-07-16 09:45:03