Splunk Search

Combine RegEx with a condition

mkrauss1
Explorer

Assume the following squid log samples:

(squid-1): 1515606581.001 100 1.2.3.4 TCP_TUNNEL/200 500 CONNECT some.fqdn.com:443 - DIRECT/1.2.3.4
(squid-1): 1515606582.002 200 1.2.3.4 TCP_TUNNEL/200 2000 CONNECT some.fqdn.com:443 - DIRECT/1.2.3.4
(squid-1): 1515606583.003 200 1.2.3.4 TCP_TUNNEL/200 5000 CONNECT some.fqdn.com:443 - DIRECT/1.2.3.4

Example search with a regular expression to filter for TIME, SIZE and URL:

 squid-1  |rex field=_raw "squid-1\):\s+\d+\.\d+\s+(?<TIME>\d+).*TCP_TUNNEL\/200\s+(?<SIZE>.*)\s+CONNECT\s+(?<URL>.*)\:" 
|  top TIME,SIZE,URL

How can i set a condition for the size to list only for example SIZE>1000?

Many thanks

0 Karma
1 Solution

micahkemp
Champion

You would do that after using rex to extract the field:

  squid-1  |rex field=_raw "squid-1\):\s+\d+\.\d+\s+(?<TIME>\d+).*TCP_TUNNEL\/200\s+(?<SIZE>.*)\s+CONNECT\s+(?<URL>.*)\:"
 | search SIZE>1000
 |  top TIME,SIZE,URL

View solution in original post

0 Karma

mayurr98
Super Champion

hey try this

squid-1  |rex field=_raw "squid-1\):\s+\d+\.\d+\s+(?<TIME>\d+).*TCP_TUNNEL\/200\s+(?<SIZE>.*)\s+CONNECT\s+(?<URL>.*)\:" 
| where SIZE>1000  
|  top TIME,SIZE,URL

Let me know if this helps you!

0 Karma

micahkemp
Champion

You would do that after using rex to extract the field:

  squid-1  |rex field=_raw "squid-1\):\s+\d+\.\d+\s+(?<TIME>\d+).*TCP_TUNNEL\/200\s+(?<SIZE>.*)\s+CONNECT\s+(?<URL>.*)\:"
 | search SIZE>1000
 |  top TIME,SIZE,URL
0 Karma

mkrauss1
Explorer

Ah, it was the search command which was missing. THANK YOU!

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Thanks for the Memories: .conf26 Took Learning to New Heights

Thank you, Splunk Community, for making .conf26 in Denver one for the books. From packed Splunk University ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...