Yêu cầu công việc
Experience: Minimum of 1- 2 years of experience as a Data Engineer, BI Developer, or similar role, with practical experience in developing BI solutions and managing data.
Technical Skills:
Core Technical Skill:
AWS: Familiarity with services like Amazon S3 (storage), Amazon Redshift (data warehousing), AWS Glue (ETL processes), and AWS Lambda (serverless computing) is crucial.
Azure: Knowledge of Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory for data integration and ETL tasks, and Azure Databricks for big data processing, Microsoft Fabric
Cloud Platforms Proficiency: Candidate should be required one of these working experienced
Databricks: Proficiency in using Databricks for big data processing and analytics. This includes understanding how to use Apache Spark within Databricks for data transformation and machine learning tasks
Data Modeling and Database Management
Strong understanding of both SQL and NoSQL databases.
Experience with data warehousing solutions and optimizing databases for performance and scalability
Data Integration and ETL Processes:
Proficiency in designing and managing ETL pipelines to integrate data from various sources
Programming Skills:
Proficiency in languages like Python, Spark notebook, or Scala for data manipulation and automation
Additional Skills
Data Security and Compliance:
Understanding of data governance, security best practices, and compliance requirements.
DevOps and Automation:
Familiarity with CI/CD pipelines
Machine Learning and Analytics:
Basic knowledge of machine learning principles and tools for data analysis.
Soft Skills:
Excellent presentation skills with the ability to explain complex issues clearly and understandably.
Strong problem- solving abilities, effective communication, and teamwork skills.
Strong analytical and problem- solving skills with the ability to optimize system performance and processes.
Excellent communication skills with the ability to work effectively with both technical and non- technical teams.
Education:
Bachelor’s degree in a related field such as Computer Science, Engineering, Mathematics, or equivalent.