Getting Data In

Multiple Json types in one file. How do i get data into Splunk

robertlynch2020
Influencer

Hi

I have one file with multiple JSON types in it.
What is the best way to get this data into Splunk.
I dont think i can use a universal forwarder as i cant specify the sourcetype as i is multiple.

Someone said use a heavy forward and do the work of splitting the data into different source types before i send it.

Is this the correct approach?

Thanks
Robert Lynch

1 Solution

robertlynch2020
Influencer
0 Karma

robertlynch2020
Influencer
0 Karma

starcher
Influencer

If the source can be edited to write to different files per sourcetype that is most ideal.

Another option that doesn't involve the universal forwarder is ingest the file using python and send to Splunk HTTP Event collector. A bit more complex but more flexible than doing regex routing at indexers.

0 Karma

niketn
Legend

@robertlynch2020, your indexer can also do this job, but better approach like you have said is to use heavy forward to set different sourcetype based on different JSON from the same source through props.conf and transforms.conf for sourcetype override.

Refer to Splunk Documentation : http://docs.splunk.com/Documentation/Splunk/latest/Data/Advancedsourcetypeoverrides#Example:_Assign_...

And Splunk Blog: https://www.splunk.com/blog/2010/02/11/sourcetypes-gone-wild.html

____________________________________________
| makeresults | eval message= "Happy Splunking!!!"
0 Karma

robertlynch2020
Influencer

Hi

Thanks, this is the answer i went with 🙂

0 Karma

splunker12er
Motivator

spath command, it will do that for you, you may refer to the below link for using spath

http://docs.splunk.com/Documentation/Splunk/6.3.3/SearchReference/spath

0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...