Mô tả công việc
At EATLAB, we envision a future in which restaurants are no longer limited by their lack of resources and given the access to opportunity. We envision a future where workforces are enhanced by AI. The AI we built will leave no one (with efforts) behind. We seek to provide easy access to useful AI technology, enabling companies (Medium going Large sizes) to become fully self- sufficient and reap the rewards of their hard work.
We&039;re seeking a highly skilled Mid- Level Data Engineer or a BackEnd Developer with a strong Python background, who has strong passion for building and optimizing complex systems. This individual will be responsible for streamlining our development and deployment processes, with a focus on Machine Learning operations (ML- Ops) and scaling our Python backend infrastructure.
Key Responsibilities
Responsibilities
Continuous Improvement : Continuously improve existing data workflows and processes to enhance performance and reliability.
Docker Expertise : Containerize applications and services for seamless deployment and portability.
Bitbucket Pipelines: Automate build, test, and deployment workflows using Bitbucket Pipelines.
ETL : Design, develop, and maintain robust ETL pipelines to extract, transform, and load data from various sources.
Database Optimization: Implement scaling and sharding strategies for our databases to handle increasing data volumes. Optimize and scale data storage solutions to handle large volumes of data efficiently.
Monitoring and Alerting: Monitor data quality and integrity, as well as implement data validation and error- handling mechanisms.
Data Security : Implement data security and compliance measures to protect sensitive information.
Data Processing : Develop processes for data pipelining, cleaning, modeling, mining, production, and monitoring
ML- Ops : Build and maintain CI/CD pipelines for Machine Learning models, including data management, model training, model deployment, and model performance monitoring on production environments.
