Brussels / 2 & 3 February 2019

schedule

Compute the QOS of your infrastructure with DEPC


DEPC is an open source tool written in Python 3.5+. We use it to compute the Quality Of Service (QoS) of our IT infrastructure and customers (several hundreds of thousands of servers and 1.4M customers in the WebHosting department).

To be able to do this we use some open source technologies : - TimeSeries databases and Pandas / Numpy for the QoS computing, - Neo4j to store the graph of our dependencies (a customer depends on several servers and some services, like databases, themselves depends on servers. If a server fails, several customers QOS are impacted), - Kafka consumer to update in real time the graph in Neo4j, - Apache Airflow to schedule the jobs used to compute the QOS of the whole infrastructure (the graph in Neo4j contains ~10M nodes).

The goal of this conference is to show you how do we assemble these technologies to construct DEPC in OVH.

Speakers

Nicolas Crocfer
Anthony Olea

Attachments

Links