OVERVIEW
Have you ever wanted to contribute to real open- source infrastructure software used at scale?
Are you curious about distributed systems, big data processing, and open standards?
Twake Mail (https://twake- mail.com) is part of a new generation of mail applications, that ensures superior security and performance by using the JMAP protocol (https://jmap.io). It integrates perfectly with Linagora’s collaborative suite, The Twake.AI https://twake.app (Contacts, Calendar, Chat and Drive). Its server is based on the Apache James project (https://james.apache.org) to which the team contributes. The server is both scalable by design and easy to customize. Twake Mail client is multi- platform, can be used on any device via mobile apps (android, ios) or a web interface.
WHAT WILL YOU DO?
Apache James is a heavily distributed server relying on NOSQL data. For performance it relies on a highly denormalized data model.
This project aims at providing a skeleton for Apache James tasks, being run outside of the Apache James server. We would provide both a CLI toolbox and Apache Spark scripts for running those denormalization checks. This would take the form of a public repository on gitHub that could then be, if relevant, contributed upstream.
Historically James allows running "tasks" locally to correct those denormalization. However the current implementation is subject to limitations: time to complete is bounded, being run locally the tasks are not scalable, and competes with live traffic.
During this internship, you will work on real production challenges, contribute to open- source repositories, and collaborate with experienced engineers through code reviews, design discussions, and documentation.
Project: Big data- implement Blob garbage collection with Apache Spark
We propose to address the following tasks as part of this proof of concept:
- Message denormalisation checks: `messageidtable content needs to be reconciliated with content of `imapuidtable`, without disrupting live traffic.
- Mailbox counter checks: Iterate `imapUidTable` and update the `mailboxcounters` table (count of email, and unseen) accordingly.
- Blobs deduplication: the storage identifier of email content is a hash of the content. This means that 2 blob with the same content will be stored once.
Skills: Spark (Java), Cassandra, S3, Bloom filters
But this also means deletion is a hard topic. To that end we implemented a cleanup task based on bloom filters to delete no longer referenced blobs.
OUR REQUIREMENTS:
- Knowledge of Flutter / dart is appreciated
- Having a basic usage of Git
- Passionate about OpenSource and Free Software
- Curious, and willing to learn, autonomous
- Speaking English
- Knowledge of Flutter is a plus
- Having a basic Java knowledge
- Experience with Flutter UI development is a plus
- Experience with Docker, Spark, or distributed systems is a plus
WHY YOU’LL LOVE WORKING WITH US?
- Opportunity to be an official member of LINAGORA after the internship period
- Gain hands- on experience with real product development and testing for a large- scale OpenSource project.
- Work in an international team with high skilled people
- Participate in OpenSource communities and conferences in Vietnam
- Flexible and balanced work- life environment.
- Modern working space, free coffee
