Lead Data Engineer (AWS/Python/SQL) - ANZ Bank

Able to influence solution / architecture design.
Able to define, design, build, test and maintain the AWS data architecture and supporting services.
Extensive experience in Data & Analytic Platform setup.

Yêu cầu công việc

Proven experience with integrating multiple heterogeneous data sources, and building a robust, cost- effective, flexible, and large- scale data and analytics platform.
8+ years of experience in data engineering or related fields.
Solid understanding and working with big data and associated concerns (data governance, scalability, security, observability, reliability, etc.).
Deep experience in building large- scale data management and processing platforms, using AWS technologies like Lake Formation, MWAA, EMR, S3, and Athena.
Data modelling experience to support business requirements for data usage (Data Lake, Data warehouse)
Good skill in communicating.
Strong proficiency in Python programming, with advanced SQL knowledge.
Good working experience with IaC and CI/CD tools (Terraform, Codefresh)
Experience with data warehousing technologies (AWS Redshift) and data storage formats (Parquet, Avro, JSON) and table formats (governed tables, Iceberg).
Successful track record in managing or leading a team of data engineers.
Experience with data transformation and testing tools and frameworks (dbt, Great Expectations, Soda)
Experience developing data visualisations using tools such as Tableau, Qlik, or similar.

Nice to have

Tertiary qualification with a focus on software development, and the relevant AWS Cloud Certifications (Data speciality preferred)
Have consulting and influencing skills.
Rust, Golang or Java programming

Internal training (Technical & Functional & English)
100% full salary and benefits as an official employee from the 1st day of working
Insurance plan based on full salary + 13th month salary + Performance bonus
Meal allowance
Free snacks, refreshment, and parking
Working in a fast- paced, flexible, and multinational working environment. Chance to travel onsite (in 53 countries)
Medical benefit for employee and family (no limit children)
18 paid leaves/year (12 annual leaves and 6 personal leaves)

Cập nhật gần nhất lúc: 2023-11-23 12:15:21