Duplication of data in simple csv file

[Lambertus]

Hi,

new to Splunk. Had splunk engineer install simple set up of 3 csv files containing trading data (work in bank) one for each week in 2014. Worked fine until it started duplicating trades. (should be around 200k trades, now showing 398k trades)

• why is this happening?
• also seems that it is not picking up the right fields when I try and pivot the data?

any help would be appreciated, again, I am new to Splunk.

[ankireddy007]

Please check whether you have specified correct configurations (follow tail option) while importing.
Also type of indexing like indexing once or continuous monitor.
In you are case better to choose "indexing once" option as the files are not changing.