Data Engineer (Python, Golang, Linux, Cloud, Agile)

Take the initiative to bypass obstacles from anti- crawling system/captcha for platforms
Test the data from API and the scraping to ensure accuracy and quality
Design, and develop crawler system, data pipelines, data governance compliance, procedures, and tooling to scrape Login required & Open API from e- commerce websites.
Work closely with the team leader and follow the guidelines to accomplish assigned tasks
Own the creation and maintenance processes of these tools, services, and workflows to improve crawl/scrape analysis, reports, and data management.

Yêu cầu công việc

3- 5 years of hands- on experience of writing code, scripts and APIs (Python, Golang)
Experience with serverless compute components, BigQuery, Cloud Functions, Cloud Storage, Clickhouse
Familiarity with techniques and tools for crawling, extracting and processing data
Proficient understanding of code versioning tools, such as Git
Familiarity with Linux, HTTP, HTML, Javascript and Networking
Having knowledge and passion for reverse engine is an advantage
Diligence, hard work, carefulness and communication skills with the team are required.
Strong in Crawler, Backend, Linux
Experience with system monitoring/administration tools
Experience following Agile methodology
Good verbal, and written communication skills in English
Experience running large- scale web scrapes
Background in Information Technology, Software Engineering, Data Science
Experience or understanding marketing/ eCommerce (metrics) is a plus
Strong understanding of data flow and system integrations
Ability to dive into technical details and design analytics solutions to meet business needs

What we offer (Why us)

Competitive salary package with ample opportunities for professional growth.
2 performance review times per year
Up to 15 days off per year
Social, Health, and Unemployment Insurance will be based on full salary.
Annual Health check- up, Premium Healthcare Insurance
Team building monthly, company trip every year, 13th Salary
Make a great impact for millions of e- commerce businesses.
Free tea, coffee, snacks for member every day
Free Parking fee every month.
Opportunity to learn from smart managers with vast experience in e- commerce, product development, data management, and technical engineering
Super vibrant startup environment with a talented and very motivated team.
On- the- job training and coaching with smart and friendly experts
Union and other activities every month (8/3, 20/10, Mid- Autumn, Year- End Party, v.v...)

Cập nhật gần nhất lúc: 2024-03-11 15:35:36