Data Engineer

PAR Paris

Dailymotion is seeking a Senior Software Engineer to join the Data Warehouse / Analytics team. The ideal candidate will dream about distributed systems for the parallel processing of massive quantities of data, be familiar with Hadoop/Pig/Cassandra/Spark/Oozie and MapReduce, and frequently think to themselves, 'Yeah, that works for 500 MB of data; what about 500 TB?' This position is full-time and based in our main office in Paris, France.

Description du job

- Develop reusable tools for the management and manipulation of hundreds of terabytes of data
- Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes
- Interface with other teams to incorporate their innovations and vice versa
- Work closely with data analysts to construct creative solutions for their analysis tasks
- Optimize our infrastructure at both the software and hardware level
- Focus on scaling horizontally rather than vertically

Compétences/expérience requises

- Extensive experience working with large data stores
- Strong experience in developing and maintaining reliable ETL processes
- Deep understanding of storage appliances and storage software internals
- Expert knowledge developing and debugging in Java, Scala, Python
- Experience with filesystems, server architectures, and distributed systems
- Experience / Knowledge in Cloud Architectures
- Experience with DevOps and agile development methodologies
- Good level of fluency in English (spoken, written)

Informations à propos du job

Location: Paris
Availibility: ASAP
Type of contract: full-time and permanent



Paris 17ème - Boulevard Malesherbes

Envoyer cette offre par e-mail