Splunk Enterprise

Using collect command: Why is some data missing?

welcome
Engager

I am using collect command to transfer data data from one index to another index 
The query is like index=A source=sourceA sourcetype:sourcetypeA host=hostA | collect index=B source=sourceA sourcetype:sourcetypeA host=hostA.
But some data is missing why

Labels (1)
Tags (1)
0 Karma

welcome
Engager

Can we have any other command to transfer one index data into another index 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

Is it possible to re-ingest the data to the new index? Other than that, the collect command should do the trick.

 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

What sort of data is missing?

Have you tried using output_format=hec for the collect command 

https://docs.splunk.com/Documentation/Splunk/9.0.3/SearchReference/Collect#arg-options

 

0 Karma

welcome
Engager

I am getting events properly but the total number of A events not matching the B events 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

Can you find some information around the missing data - e.g. does it transfer a fixed number of events, but miss some others.

Are the time stamps the same and is the time window you are searching the same on both indexes?

 

 

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

All Work and No Play? Not at .conf26! Unwind at These Evening Events

Between hands-on technical sessions, keynote reveals, and diving into live architectures, .conf26 is packed ...

Join the Hackathon at .conf26 and build a No-Code AI agent

Join us for the AI Agent Buildathon, an in-person, three-hour hands-on Hackathon where you’ll use Splunk Agent ...

Level Up Your Workflow: Mastering Splunk Cloud Management via Terraform

Tech Talk Recap   From Chaos to Control: Scaling Splunk Cloud with Infrastructure as Code Managing apps in ...