Senior Data Engineer (Python, Java, SQL)

We are looking for versatile and experienced Senior Data Engineers to join our team. In this role, you will be responsible for design, development, and maintenance of our data infrastructure for the entire of data lifecycle. You will ensure data is ingested, processed, and made available in a reliable and efficient manner. You will work closely with our product team to understand requirements and deliver robust solutions. The ideal candidate will have a strong foundation in data and expertise in at least two programming languages such as Python, Scala, Java, or AI integration.
Your tasks:

Collaborate with cross- functional teams to troubleshoot and resolve data- related or technical issues.
Develop and maintain documentation for data processes, systems, and pipelines.
Perform other tasks assigned by the team.
Interact with business stakeholders and/or customers to understand requirements and to ensure workflows that support business processes in the best possible way.
Implement data encryption and access controls.
Ensure data security and compliance with relevant regulations and standards.
Design, develop, and maintain robust and scalable data pipelines and architectures to support various data- driven applications and analytics.
Ensure data quality and consistency through validation and transformation.
Optimize data models for transaction processing, reporting, and analytics.
Develop, maintain, and optimize ETL processes using tools (such as AWS Glue, Apache NiFi, Airflow, etc.) or data exchange platforms (such as flatfile or dromo) to ingest, clean, and transform data from various sources (CSV, excel, pdf, etc.).
Stay updated on emerging technologies and recommend innovative solutions to technical challenges.
Provide technical guidance and support as needed.
Automate data pipeline processes using CI/CD practices and tools.
Ensure data integrity and consistency by implementing data normalization, robust data validation and error handling mechanisms.
Monitor and optimize data pipeline for performance and reliability.

Yêu cầu công việc

MUST HAVE:

Strong problem- solving skills and attention to detail.
Familiarity with data warehousing solutions like Redshift, BigQuery, or Snowflake.
You are looking for a long- term position in a new young team.
Proficiency in programming languages such as Python, or Scala, or Java, or a similar language.
Proficiency in SQL and experience with relational database (Postgres, MySQL), and NoSQL.
Experience with big data technologies (e.g. Hadoop, Spark, Kafka, or Flink).
Solid understanding of data modeling, data architecture, and data governance principles.
Ability to thrive in a fast- paced, dynamic environment, with a focus on innovation and continuous improvement.
4+ years of experience in software development, and 3+ years of experience in data engineering or related field.
Experience with data modeling and data architecture design.
Bachelor’s degree in computer science, Engineering, or a related field.
Experience with ETL tools/frameworks like AWS Glue, Apache NiFi, Airflow, etc. and processes.
Can do attitude.
Good at English skills both in writing & verbally with the ability to work effectively in a team environment.

NICE TO HAVE:

Strong hands- on mentality.
Familiar with data visualization tools (e.g. Power BI, Tableau, etc.) is a plus.
Experience with CI/CD practices and tools is a plus.
You have a high sense of discipline and a serious attitude at work.
Enthusiasm, dedication to work and willingness to work in a new team and on a new product with big market potential.
Ability to identify with a product for the logistics sector.
Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) is a plus.
Willingness for continuous learning and personal development.
Diligent, honest, thorough, agile, inquisitive, hardworking.

Language skills:

German communication would be a plus.
Written and spoken English

Team Building / Excursions
13th salary included, with additional performance bonuses based on individual performance and the company&039;s revenue.
Social security systems such as health insurance, social security, unemployment insurance according to the Labour Code (based on your full gross salary).
Professional, enthusiastic, dynamic environment with learning opportunities in a new location with long- term commitment.
MacBook M3 pro and all other Apple devices (mouse, keyboard), headset provided by company.
Health Check- Up
Annual salary review
You will have the opportunity to contribute your own strengths to a new young team and help build up the location.
Opportunity to build an innovative product with disruption potential based on 20 years of domain experience and large amounts of data – strong backing by a well- established German company and highly dynamic team behind.

Cập nhật gần nhất lúc: 2024-08-08 14:00:03