portfolio/observability-stack/scenarios/incident_simulation.md

Scenario: Incident Simulation

Description

Generate a controlled application and infrastructure incident so the logging pipeline, alert rules, and dashboards can be reviewed with realistic event timing.

Commands

cd observability-stack
docker compose config
./scenarios/incident_simulation.sh comprehensive
tail -n 40 logs/incident_simulation.log

Expected Result

• The compose file validates successfully.
• The simulation writes a sequence of CPU, memory, service, database, and application error events.
• Alert examples indicate firing and resolved states.
• Operators can trace incident progression through logs and dashboard queries.