Senior Data Engineer

Data Architecture:

Evaluate various data architectures in the market and utilize them to develop data solutions to meet business requirements.
Architects, Designs, Builds, Develops, Maintains, and Implements new data systems where needed, the Architecture with best practices and data infrastructure reliable and scalable.
Drive the delivery of data products and services into systems and business processes in compliance with internal regulatory requirements.
Oversee the review of internal and external business and product requirements for data operations and activity and suggest changes and upgrades to systems and storage to accommodate ongoing needs
Responsible for deploying secure and well- tested software that meets privacy and compliance requirements, and maintains and improves CI / CD pipeline.
Proactively drive the effort of identifying opportunities to manage data and provide data solutions.

Data Integration:

Ensure data assets are organized and stored efficiently so that information is high quality, reliable, flexible, and efficient.
Ensure data is accessible to the required personnel to ensure the ease of understanding and access to the data needed to make informed business decisions.
Manage and enhance to ensure that DWH, Data mart and BI tools work stably through aligned business/ system/ and data processes.
Design, build, and maintain optimized data pipelines and ETL solutions as business support tools in providing analysis and real- time analytics platforms for critical decision- making, support of data and analytics projects, integrating new sources of data into our central data warehouse to meet business requirements, and experience building and optimizing ‘big data’ architectures for read- and- write performance.
Monitoring and quality assurance within the system (Server/ Services/ETL /Networking/Security).
Review and analyze existing data systems, and make recommendations on improvement, maintenance, or other factors to improve the system, automate manual processes, optimize data delivery, and re- design infrastructure for scale and performance and greater scalability
Experience with building reports and data visualizations, using data from the data warehouse or other sources and mapping are helpful (but not required)

Experience with big data tools: Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend, Azkaban, Luigi, Airflow etc
Experience designing and implementing large- scale distributed data pipelines and working with cloud infrastructure services like AWS/GCP/Azure (preferably AWS), (Big Query, Data Flow, Amazon EKS, EMR, Docker/ECS, and Redshift.)
At least 3 years experience (typically 5+ years) in Data Engineering and ETL and Analytics tools (R, Python, Pentaho, dbt…) and BI&A Visualization systems (Metabase, Power BI, OBIEE, SAS VA, IBM, Yellowfin, Tableau, Qlik …), and In- depth knowledge of BI technologies, methodologies, and their application like Metabase, PowerBI, Tableau, Looker etc
Good at math and Advanced SQL knowledge and experience working with relational databases as well as working familiarity with a variety of databases is a big plus.
Bachelor’s degree (or higher) in Computer Science, Software Engineering or Information Technology, MIS, Economics, Finance, Statistics, Mathematics, or a related field (Financial Services, Banking, Insurance, Securities).
Experience with building data pipelines from various business applications like Salesforce, Marketo, NetSuite, Workday, Odoo,… and databases (MsSQL, Oracle, IBM, SAP, MySQL, AWS Redshift).
Experience with the LAN or VLAN, and digital organizing tools, like Active Directory Action Network, ActionKit, or Blue State Digital, is a plus (but not required).
Ability to communicate in English.

Chế độ bảo hiểm, Du Lịch, Chăm sóc sức khỏe, Đào tạo, Nghỉ phép năm, CLB thể thao

Cập nhật gần nhất lúc: 2024-04-30 14:05:42