How to upload large json format data into kv-store?

rashid47010 — Mon, 25 Jul 2022 16:04:02 GMT

Hi, everyone,

The customer shared one last JSON formatted file. there are more than 1000 records. Customers want it as a lookup. my thought process is saying that I should use the kV-store approach. but how can I upload a large amount of data into the kV store?

Re: How to upload large json format data into kv-store?

kamlesh_vaghela — Mon, 25 Jul 2022 16:32:32 GMT

@rashid47010

You can store JSON data using KVStore REST API.

Please go through https://dev.splunk.com/enterprise/docs/developapps/manageknowledge/kvstore/usetherestapitomanagekv and check the Run multiple save operations section.

I have tried the below JSON with my curl command. You can try it in a local machine and validate the data.

[{ "id": "1", "name": "Splunk Sweden" }, { "id": "2", "name": "Splunk Singapore" }]

Curl

curl -k -u admin:admin123 https://localhost:8089/servicesNS/nobody/APP_NAME/storage/collections/data/KV_STORE_COLLECTION/batch_save -H 'Content-Type: application/json' -d 'VALID_JSON_DATA'

My example Curl.

curl -k -u admin:admin123 https://localhost:8089/servicesNS/nobody/search/storage/collections/data/kvstorecoll/batch_save -H 'Content-Type: application/json' -d '[{"id":"1","name": "Splunk Sweden"}, {"id":"2","name": "Splunk Singapore"}]'

I hope this will help you.

Thanks
KV

If any of my replies help you to solve the problem Or gain knowledge, an upvote would be appreciated.

topic How to upload large json format data into kv-store? in Knowledge Management

How to upload large json format data into kv-store?

Re: How to upload large json format data into kv-store?