I've got the service monitoring in place and now I want to run ad-hoc tests. How do we spoof fake alarms and see how the impact relationship within the service model change?
I figured the following two options:
- Used the stressors (Linux Stressor-ng https://www.mankier.com/1/stress-ng#Examples) on the servers to increase or decrease the resource consumption.
- This option is not so fast for customer demonstrations when it comes to break and fix things quickly.
- Ingest fake alarms using HEC towards the itsi_tracked_alerts index.
- I managed to get this working using curl, however, the event doesn’t seem to associate with the metrics.
Do you have any tips for achieving this use case? Are there any other options available?
