Experience: Minimum of 1- 2 years of experience as a Data Engineer, BI Developer, or similar role, with practical experience in developing BI solutions and managing data.
Core Technical Skill:
Databricks: Proficiency in using Databricks for big data processing and analytics. This includes understanding how to use Apache Spark within Databricks for data transformation and machine learning tasks
AWS: Familiarity with services like Amazon S3 (storage), Amazon Redshift (data warehousing), AWS Glue (ETL processes), and AWS Lambda (serverless computing) is crucial.
Cloud Platforms Proficiency: Candidate should be required one of these working experienced
Azure: Knowledge of Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory for data integration and ETL tasks, and Azure Databricks for big data processing, Microsoft Fabric
Data Modeling and Database Management:
+Experience with data warehousing solutions and optimizing databases for performance and scalability
+Strong understanding of both SQL and NoSQL databases.
Data Integration and ETL Processes: Proficiency in designing and managing ETL pipelines to integrate data from various sources
Programming Skills: Proficiency in languages like Python, Spark notebook, or Scala for data manipulation and automation
Additional Skills:
Data Security and Compliance:
Understanding of data governance, security best practices, and compliance requirements.
DevOps and Automation:
Familiarity with CI/CD pipelines
Machine Learning and Analytics:
Basic knowledge of machine learning principles and tools for data analysis.
Soft Skills:
Excellent communication skills with the ability to work effectively with both technical and non- technical teams.
Strong problem- solving abilities, effective communication, and teamwork skills.
Excellent presentation skills with the ability to explain complex issues clearly and understandably.
Strong analytical and problem- solving skills with the ability to optimize system performance and processes.
Education: Bachelor’s degree in a related field such as Computer Science, Engineering, Mathematics, or equivalent.