Splunk Search

I have duplicate entries in a CSV file. How to write a search that extracts the FIRST entry?

dbcase
Motivator

Hi,

I have a CSV file that looks like this

Date,Version
01-24-2017 12:09:26,7_3_10_000500_3851898
01-25-2017 12:09:26,7_3_10_000500_3851898
01-26-2017 12:09:26,7_3_10_000500_3851898
01-27-2017 12:09:26,7_3_10_000500_3851899
01-28-2017 12:09:26,7_3_10_000500_3851899
01-29-2017 12:09:26,7_3_10_000500_3851899
01-30-2017 12:09:26,7_3_10_000500_3851899

How can I write a search that extracts the FIRST entry so the final results would look like this

 Date,Version
 01-24-2017 12:09:26,7_3_10_000500_3851898
 01-27-2017 12:09:26,7_3_10_000500_3851899

Thank you!!!

0 Karma
1 Solution

dbcase
Motivator

Found it.....

dedup Version sortby +_time

View solution in original post

0 Karma

gokadroid
Motivator

How about using the last which returns the last seen (oldest) version as search is in reverse chronological order, something like this:

| inputlookup your csv name
| stats last(Date) by Version
| sort Version

Alternatively you can use first to reverse the affect:

| inputlookup your csv name
| stats first(Date) by Version
| sort Version
0 Karma

dbcase
Motivator

Found it.....

dedup Version sortby +_time
0 Karma

dbcase
Motivator

Final query looks like this

(index=allmsos  source=*Beta.csv*) |dedup Version sortby +_time|where Date!="Date" and Version!="Version"|eval newdatefield=strftime(strptime(Date, "%m-%d-%Y %H:%M:%S"), "%m-%d-%Y %a")|stats values(newdatefield) as Date values(Version) as Version
0 Karma

DalJeanis
Legend

Well done. Please mark your answer accepted.

0 Karma

dbcase
Motivator

Note the version number change betweeen the 24th and the 27th

0 Karma
Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...