Getting Data In

Log events are being merged for few cases

mv059
Engager

Hi

I am facing a challenge with some of the splunk logs being merged as a one event.

I have tried breaking them by updating below in splunk forwarder config but doesnt't work.

can someone suggest what i am missing here

props.conf  in  local

########## APPLICATION SERVERS ######
[default]
SHOULD_LINEMERGE = false


[event_logservice]
SHOULD_LINEMERGE = false
LINE_BREAKER= (\d{4}-\d{2}-\d{2}\s+\d+:\d+:\d+.\d+\s+-\d+\s+Event)
MAX_TIMESTAMP_LOOKAHEAD = 75
TRUNCATE = 0

Additional details : Logs are being written to files by logstash and then forwarder is reading and pushing data

My log file :

2020-08-17 14:49:21.161 -0700 Event log_level="info" build_id="HEAD (d3b8457cc9)" bzdate="20200817" serial_no="KJST45HSS" register="ABC" sessionId="KJST45HSS_20200817_144739196_1" wid="H34-vx-841D6B9C-8158-4975-9AB3-FDB5E9FD80E8" component="Manager" message="adding "
2020-08-17 14:49:21.163 -0700 Event log_level="info" build_id="HEAD (d3b8457cc9)" bzdate="20200817" serial_no="KJST45HSS" register="ABC" sessionId="KJST45HSS_20200817_144739196_1" wid="H34-vx-841D6B9C-8158-4975-9AB3-FDB5E9FD80E8" component="Manager" message="adding completion "

** example above 2 rows and shown merged in splunk.. and it is happending randomly for other log events also.

 

Labels (1)
0 Karma
1 Solution

to4kawa
Ultra Champion


[event_logservice]
SHOULD_LINEMERGE = false
LINE_BREAKER= ([\r\n]+)\d{4}-\d{2}-\d{2}
MAX_TIMESTAMP_LOOKAHEAD = 75
TRUNCATE = 0

View solution in original post

to4kawa
Ultra Champion


[event_logservice]
SHOULD_LINEMERGE = false
LINE_BREAKER= ([\r\n]+)\d{4}-\d{2}-\d{2}
MAX_TIMESTAMP_LOOKAHEAD = 75
TRUNCATE = 0

mv059
Engager

Thanks for your input

so i was missing the start of line in my regex

 

0 Karma
Get Updates on the Splunk Community!

Building Reliable Asset and Identity Frameworks in Splunk ES

 Accurate asset and identity resolution is the backbone of security operations. Without it, alerts are ...

Cloud Monitoring Console - Unlocking Greater Visibility in SVC Usage Reporting

For Splunk Cloud customers, understanding and optimizing Splunk Virtual Compute (SVC) usage and resource ...

Automatic Discovery Part 3: Practical Use Cases

If you’ve enabled Automatic Discovery in your install of the Splunk Distribution of the OpenTelemetry ...