Desired resilience properties

• Fault isolation
• Sufficient capacity
• Timely output
• Correct output
• Redundancy

Categories of failure

• Single point of failure

• Excessive load

• Excessive latency

• Misconfiguration bugs

• Automate as much as possible

CAOS Engineering

• Fault injection simulator