Knowledge Management

How to upload large json format data into kv-store?

rashid47010
Communicator

Hi, everyone,

The customer shared one last JSON formatted file. there are more than 1000 records. Customers want it as a lookup. my thought process is saying that I should use the kV-store approach. but how can I upload a large amount of data into the kV store?

 

Labels (1)
Tags (2)
0 Karma

kamlesh_vaghela
SplunkTrust
SplunkTrust

@rashid47010 

You can store JSON data using KVStore REST API.

Please go through  https://dev.splunk.com/enterprise/docs/developapps/manageknowledge/kvstore/usetherestapitomanagekv and check the Run multiple save operations section.

I have tried the below JSON with my curl command. You can try it in a local machine and validate the data.

 

[{
	"id": "1",
	"name": "Splunk Sweden"
}, {
	"id": "2",
	"name": "Splunk Singapore"
}]

 

Curl

 

curl -k -u admin:admin123     https://localhost:8089/servicesNS/nobody/APP_NAME/storage/collections/data/KV_STORE_COLLECTION/batch_save     -H 'Content-Type: application/json'     -d 'VALID_JSON_DATA'

 

My example Curl.

curl -k -u admin:admin123     https://localhost:8089/servicesNS/nobody/search/storage/collections/data/kvstorecoll/batch_save     -H 'Content-Type: application/json'     -d '[{"id":"1","name": "Splunk Sweden"}, {"id":"2","name": "Splunk Singapore"}]'

 

I hope this will help you.

 

Thanks
KV


If any of my replies help you to solve the problem Or gain knowledge, an upvote would be appreciated.

0 Karma
Get Updates on the Splunk Community!

The All New Performance Insights for Splunk

Splunk gives you amazing tools to analyze system data and make business-critical decisions, react to issues, ...

Good Sourcetype Naming

When it comes to getting data in, one of the earliest decisions made is what to use as a sourcetype. Often, ...

See your relevant APM services, dashboards, and alerts in one place with the updated ...

As a Splunk Observability user, you have a lot of data you have to manage, prioritize, and troubleshoot on a ...