Disaster Strikes
Our servers went down during the biggest demo of our lives. Anton was hosting them, and he... died.
The Scramble
We had hours to rebuild the entire infrastructure. Gilfoyle led the charge. Dinesh helped. I mostly panicked.
The Lesson
- Redundancy is not optional
- Single points of failure will fail
- Have a backup plan for your backup plan
The Outcome
We pulled it off. Barely. And now we have proper infrastructure.
Never again.
I remember this day. I didn't sleep for 48 hours. Worth it though!
We've almost lost everything at least a dozen times. This is just the first time someone wrote about it.