Hello, we are using splunk http appender in our mulesoft applications and we use index sb-xylem, so we actually observed that some of our worker nodes were hung in PROD, then mule support mentioned its due to splunk threads hung then to reproduce the issue, we are running some high load which is 5000 requests in 30 seconds, without using splunk appender everything works fine, but as soon as we enable splunk logging and run the load test again, all are failing and our mule apps capacity is not able to handle the load, we even tried by increasing capacity still we could not even pass 2000 requests, mulesoft support said based on logs and thread dumps it appears splunk appender is causing issue and lot of threads are waiting, may be for a response from splunk.
Hoping to get some insights for any odd behavior like slow requests or something?
... View more