Hello Everyone, I'm trying to analyze data from a jboss server, http request and respons dumps. An "event" in the Jboss logs looks like this: ============================================================== 2022-04-29 11:42:54,280 INFO [io.undertow.request.dump] (default task-25) ----------------------------REQUEST--------------------------- URI=/auth/realms/XXXX/protocol/openid-connect/token characterEncoding=null contentLength=105 contentType=[application/x-www-form-urlencoded] header=Accept=application/json header=Front-End-Https=On header=Connection=Keep-Alive header=X-Forwarded-Proto=https header=RequestID=XXXXX-e05b-4a83-8a0b-2e6daf84b039 header=X-Forwarded-For=xx.46.xx.242 header=Content-Type=application/x-www-form-urlencoded header=Content-Length=105 header=Host=XXX.YYY.ZZ locale=[] method=POST protocol=HTTP/1.1 queryString= remoteAddr=/xx.46.xx.242:0 remoteHost=xxx.webhost.xxxx.com scheme=https host=xxx.yyy.zz serverPort=8443 isSecure=true body= grant_type=client_credentials scope=XYZ client_id=0XXXea client_secret=3XXXXXXXXXX85a64ba80059e0143ee --------------------------RESPONSE-------------------------- contentLength=1373 contentType=application/json header=Cache-Control=no-store header=Set-Cookie=KC_RESTART=; Version=1; Expires=Thu, 01-Jan-1970 00:00:10 GMT; Max-Age=0; Path=/auth/realms/XXXX/; Secure; HttpOnly header=X-XSS-Protection=1; mode=block header=Pragma=no-cache header=X-Frame-Options=ALLOW-FROM http://localhost:4200 header=Referrer-Policy=no-referrer header=Server-Timing=intid;desc=66e921155be4dfbd header=Date=Fri, 29 Apr 2022 09:41:39 GMT header=Connection=keep-alive header=Strict-Transport-Security=max-age=31536000; includeSubDomains header=X-Content-Type-Options=nosniff header=Content-Type=application/json header=Content-Length=1373 status=200 The problem I have, that this gets translated to 6-9 line of events by the time I see it in the Search: This makes it really difficult to search for particular Requests. For example if I want filter Requests with a specific "scope=" field. Or without any. I have no control over the forwarding of the data, so I have to make this work on the Search side. My idea so far is to group the events that happened in the same time, because every event corresponding one Request has the same timestamp. The closest I find about this is | transaction maxspan=1s which is not accurate enough, I could have multiple events in a second. Any better idea here? If I overcome this, my next problem is how to search in the resulted list. I cannot add the filters before the grouping like this: index=someindex_prod_events sourcetype=openshift_logs NOT "scope=xyz"| transaction maxspan=1s because the filter gets calculated first, then it gets grouped. My goal is the other way around. Any help would be appreciated !
... View more