Hi.
Just installed Splunk for the first time today. As a tes,t I took a CSV file and indexed it, and it worked fine. Then I created a new file in CSV format and gzip'ed it.
test.csv.gz
field,val
blah,whatever
It indexed fine. I then edited the file using vi, adding in a new line :
newfield,morestuff
I then and then searched the results again. Now the "newfield,morestuff" shows up once in the results, but "blah,whatever" shows up twice. I tried adding more lines and saw the same pattern - the most recent line shows up once, but the older lines are duplicated in the search results.
I then added | dedup _raw to the search and the duplicates went away. However, I'm looking for a more elegant solution.
By the way, I also tried unzipping the file, editing it, then gzipping it again, with the same results.
Thanks for your help!
... View more