Splunk Search

Help with props.conf changes

vrmandadi
Builder

link textHello Experts,

Attached is the sample JSON file which I am trying to upload to Splunk.I have uploaded it by Splunk WEB and it broke the events successfully but when I am trying to upload via CLI it is taking all 8 events into a single event.Can you please help how to break those events(8).

0 Karma

somesoni2
Revered Legend

You can use this for your sourcetype definition in props.conf (on Indexer/Heavy forwarder). Do remember to restart/reload splunk instance after making this change.

[ YourSourceType ]
SHOULD_LINEMERGE=false
NO_BINARY_CHECK=true
LINE_BREAKER=([\r\n]+)\{\"TRL_ID
TIME_FORMAT=%Y-%m-%d %H:%M:%S.%N %z
TIME_PREFIX=TRL_DATETIME_LOCAL_TXN\":\"
MAX_TIMESTAMP_LOOKAHEAD=30

I've used TRL_DATETIME_LOCAL_TXN as the event timestamp field. Change as per your requirement.

Once you've this setup, you can upload a file from CLI like this

splunk add oneshot fullpathtothefiletobeuploaded -index nameofindex -sourcetype sourcetypecreatedabove 

vrmandadi
Builder

Somesh Thank You so much will try this and let you know

0 Karma

ngatchasandra
Builder

Hi vrmandadi,

Try to verify if your role have not the search restrictions and see explanation to monitor this by follow the link:

http://docs.splunk.com/Documentation/Splunk/6.2.1/Security/Addandeditroles

0 Karma

vrmandadi
Builder

hello ngatchasandra,

The problem is not with roles or permissions it is with the props configurations which need to be done

0 Karma

vrmandadi
Builder

I have selected the time stamp as auto, when tried using CLI it is taking the file but it is not breaking into events..so can we use the same props from splunk web in the CLI props file

0 Karma

somesoni2
Revered Legend

Are you using the correct time-range ( check the timestamp of the events in your file)? What is the retention period of the new index you created and are timestamp of events in your file older than the retention period?

0 Karma

vrmandadi
Builder

Hello somesh,

I am new to splunk what exactly does retention period mean?

0 Karma

somesoni2
Revered Legend

Hey Vineeth,

Please ignore my comments, seems like I posted my comments of some other post here.

You said you're able to successfully update and break events from Splunk Web. so you must've selected some sourcetype for it. Did you use the same sourcetype when you tried to upload it from CLI?? I'm guessing you used splunk add oneshot method.

0 Karma

gyslainlatsa
Motivator

what version SPLUNK that use?

0 Karma

vrmandadi
Builder

version 6.2.3

0 Karma

gyslainlatsa
Motivator

did you select the indexes when loading the file?
if so, try to post me a sample of your data here, I also try to indexing.

0 Karma

vrmandadi
Builder

I have attached the sample file,can you please try and let me know the props configuration in CLI..Thanks

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...