Dailymotion is seeking a Senior Software Engineer to join the Data Warehouse / Analytics team. The ideal candidate will dream about distributed systems for the parallel processing of massive quantities of data, be familiar with Hadoop/Pig/Cassandra/Spark/Oozie and MapReduce, and frequently think to themselves, 'Yeah, that works for 500 MB of data; what about 500 TB?' This position is full-time and based in our main office in Paris, France.
- Develop reusable tools for the management and manipulation of hundreds of terabytes of data - Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes - Interface with other teams to incorporate their innovations and vice versa - Work closely with data analysts to construct creative solutions for their analysis tasks - Optimize our infrastructure at both the software and hardware level - Focus on scaling horizontally rather than vertically
- Extensive experience working with large data stores - Strong experience in developing and maintaining reliable ETL processes - Deep understanding of storage appliances and storage software internals - Expert knowledge developing and debugging in Java, Scala, Python - Experience with filesystems, server architectures, and distributed systems - Experience / Knowledge in Cloud Architectures - Experience with DevOps and agile development methodologies - Good level of fluency in English (spoken, written)
Information about the job
Location: Paris Availibility: ASAP Type of contract: full-time and permanent