Data Engineer

• Design, develop and maintain new data pipeline architecture to support multiple purposes from Analytics, Data Warehouse.
• Identify, review, and re-design data infrastructure to improve data acquisition, data processing, and data visualization processes.
• Manipulate and analyze complex data sets on different and data sources (databases, data marts, change capture, backup, …) to meet business requirements.
• Design and build analytics tools to provide real-time and non-real-time insights into customers’ origination, operation, and systems executions.
• Develop a new feature from a user story using Python and PostgreSQL and Big Query.
• Collaborate with Head of BI to define clear requirements, deliverables, and milestones.
• Work with stakeholders including the Executive, Product, Data and Software Development teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centers and Google regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

• More than 02 years of hands-on experience, preferably in big data infrastructure.
• Experienced with data-lake, data warehouse, data mart.
• Have experience with a programming language (Python/Go/JavaScript) for data processing and analysis.
• Experience designing SQL tables, indexing, tuning queries, and optimizations across different functional environments.
• Have experience writing complex SQL queries, Big Query and using BI tools & libraries, such as Airbyte, Airflow, DBT, Supserset, Kafka, Prefect etc.
• Having experience with Google services.
• Fluent written and spoken English.

Cập nhật gần nhất lúc: 2023-02-05 02:06:03