Data Engineering Manager (Python, Scala)

Collaborating with the Data Architect team on regular basis to design/review data models, and application architectures
Designing and implementing a Big Data management system by leveraging Lambda/Delta/Kappa Architecture concept
Implementing data replication/projection lag from Techcombank on- premises to Techcombank Data lake on Cloud in real- time processing or batch model with high performance- scalable AWS services like Kinesis, Firehose, Glue (Spark), Lambda,...
Managing scrum team and working with upper managers to address business problems
Guiding new members, interfacing with business to understand needs, and providing valuable feedback
Building a Cloud sourcing system that pulls data from tens of thousands tables on- premises, and hundreds of data source systems (RDBMS, file server, Kafka,...) Designing change data capture method for each source system
Serving analytics data of ten million Techcombank customers to other Techcombank internal teams, providing hundreds of millions of data elements daily through high throughput, low latency protocols (WebSocket, message queue, REST, GraphQL,...)
Providing data features infrastructure to empower ML engineering in various bank businesses
Maintaining software clean architecture, clean code, and high quality. Participating in code reviews, pair programming, mob programming, and coaching other members

Yêu cầu công việc

Must have:

Good at communication & team working
Strong experience in systems architecture – particularly in complex, scalable, and fault- tolerant distributed systems
Understand designs of resilience, fault- tolerance, high availability, and high scalability, ...
Being open- minded, willing to learn new things
Extremely proficient in at least 1 programming language (Java, Scala, Python)
Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical field
English proficiency requirements are pursuant to Techcombank&039;s policy (550+ Toeic)
Tools: CI/CD, Gitlab, …
Have 5+ years of working experience including at least 2 years of direct people management experience (with 5+ direct reports)
Good at multi- threading, atomic operations, computation framework: Spark (Dataframe, SQL, ...), distributed storage, distributed computing
Practices data- driven decision making
Demonstrable experience as a system owner with operational responsibility
Bonus points:
Having knowledge of distributed query engines: Presto, Hive, ...
Experience in performance tuning/optimizing Big Data programs
Cloud experience (AWS, GCP, etc), AWS is a plus

Have the opportunity to work directly with foreign experts, use frequently English
Working hours are flexible
Have a clear career development path in the direction of Expert or in the direction of Manager
If you are interested in this position, please do not hesitate to send your CV via email
Join Techcombank Care with Bao Viet insurance package
13 months salary/year and with a performance bonus
Participate in many annual activities such as Team building, Active Saturday, Year- end party, ...
Agile environment, dynamic and international standards
Participating in the preferential loan program for employees
Competitive salary; Two- month probationary period with 100% salary, including basic insurance payment
Working Location: Hanoi, Vietnam

Cập nhật gần nhất lúc: 2024-08-06 07:30:02