I have a stack trace that looks like this:
ERROR - ErrorCode0123 at ... at ... at com.myorg.myproject.someclass.somefunction(some file.java:somelinenumber)
Unfortunately each line of the stack trace is showing up in splunk as a separate log event, not as one big log event. I can therefore search for the error code, but I'm having trouble using splunk searches/filters to automatically pull out the details of the class/method which is the source of the problem.
What I'd like to do is to run a search for ErrorCode0123, and then run a second search for the first instance of com.myorg.myproject following each search result.
Is there a way to do this?
@adonio - I attempted both solutions. Unfortunately neither one quite worked for me:
I wasn't able to use the transaction command as the log lines don't have any kind of UID to group them together.
I did attempt to use the localize/map search combination, but it seems to pick up quite a lot of secondary log events that don't match with the first one (i.e. lines from unrelated stack traces).
You can specify the number of lines or an ending keyword for the transaction and it will fetch everything in between. Something like
| transaction JSESSIONID clientip startswith="view" endswith="purchase" from here https://docs.splunk.com/Documentation/Splunk/7.2.6/SearchReference/Transaction. You can cheat and use the sourcetype as a common field.
I think you can do the original search and then do a localize to search again with the new criteria:
| localize timebefore=3s timeafter=3s
| map search="search sourcetype="?" source="?" starttimeu=$starttime$ endtimeu=$endtime$"
Did you try using props/transforms to make sure all the lines are in a single event ? This would make your life way easier.
You could also go for the transaction command, defining the first and last event you want to have and group them together. Its ressource intensive but it will do the trick if u cant group the events into one. See the reference here :