Splunk Enterprise

Using collect command: Why is some data missing?

welcome
Engager

I am using collect command to transfer data data from one index to another index 
The query is like index=A source=sourceA sourcetype:sourcetypeA host=hostA | collect index=B source=sourceA sourcetype:sourcetypeA host=hostA.
But some data is missing why

Labels (1)
Tags (1)
0 Karma

welcome
Engager

Can we have any other command to transfer one index data into another index 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

Is it possible to re-ingest the data to the new index? Other than that, the collect command should do the trick.

 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

What sort of data is missing?

Have you tried using output_format=hec for the collect command 

https://docs.splunk.com/Documentation/Splunk/9.0.3/SearchReference/Collect#arg-options

 

0 Karma

welcome
Engager

I am getting events properly but the total number of A events not matching the B events 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

Can you find some information around the missing data - e.g. does it transfer a fixed number of events, but miss some others.

Are the time stamps the same and is the time window you are searching the same on both indexes?

 

 

0 Karma
Get Updates on the Splunk Community!

Developer Spotlight with Paul Stout

Welcome to our very first developer spotlight release series where we'll feature some awesome Splunk ...

State of Splunk Careers 2024: Maximizing Career Outcomes and the Continued Value of ...

For the past four years, Splunk has partnered with Enterprise Strategy Group to conduct a survey that gauges ...

Data-Driven Success: Splunk & Financial Services

Splunk streamlines the process of extracting insights from large volumes of data. In this fast-paced world, ...