Zero Downtime vs. Zero Data Loss: Insights from Large-Scale S3 Migrations
- Track: Software Defined Storage
- Room: K.3.401
- Day: Saturday
- Start: 10:30
- End: 11:00
- Video only: k3401
- Chat: Join the conversation!
Building upon previous work presented at FOSDEM, this talk provides updates on the Chorus project's advancements in large-scale S3 object storage migrations. We introduce key enhancements including the Chorus Agent, which enables proxy-free live migrations through bucket notifications, along with SWIFT API support and scheduled migrations. Drawing from real-world multi-petabyte migration experiences, we analyze two migration strategies through their disaster recovery metrics. The first achieves zero-downtime with optimal Recovery Time Objective (RTO) but variable Recovery Point Objective (RPO) during outages, while the second guarantees zero RPO at the cost of planned downtime. We present practical insights and recommendations for implementing large-scale S3 migrations while minimizing operational risks and disruptions.
Speakers
Sirisha Guduru | |
Artem Torubarov |