Splunk Search

Daily/Weekly/Monthly Span on CSV dATA

reverse
Contributor

I have data in CSV like below -
How can I put span=1w on this after pulling into splunk?
I tried assigning this date to _time ->didn't work 😞
Please help.

5/1/2019    0
5/2/2019    0
5/3/2019    0
5/4/2019    0
5/5/2019    0
5/6/2019    0
5/7/2019    0
5/8/2019    136
5/9/2019    62208
5/10/2019   56432
5/11/2019   618
5/12/2019   5604
5/13/2019   130244
5/14/2019   152660
5/15/2019   137472
5/16/2019   147968
Tags (1)
0 Karma
1 Solution

denzelchung
Path Finder

You will need to convert your CSV data's date into epoch format first in order to filter by 1 week ago.

The following example takes in a date (e.g. today, 16/07/2019), format it using strptime, then filter the date within now and 1 week ago.

source=*
| eval date="16/07/2019"  
| eval formattedDate=strptime(date, "%d/%m/%Y") 
| where formattedDate > relative_time(now(), "-1w@w") 
| table date formattedDate

View solution in original post

0 Karma

denzelchung
Path Finder

You will need to convert your CSV data's date into epoch format first in order to filter by 1 week ago.

The following example takes in a date (e.g. today, 16/07/2019), format it using strptime, then filter the date within now and 1 week ago.

source=*
| eval date="16/07/2019"  
| eval formattedDate=strptime(date, "%d/%m/%Y") 
| where formattedDate > relative_time(now(), "-1w@w") 
| table date formattedDate
0 Karma

reverse
Contributor

Thanks for the help @denzelchung .. seems half done..

so now i have 3 columns where date is the CSV date | eval formattedDate=strptime(Date, "%Y-%m-%d")

| table Date formattedDate XXX

How can I timechart XXX over 7d or 1w

0 Karma

denzelchung
Path Finder

What is XXX? You can filter formattedDate to the past 1 week, then replace _time since timechart span relies on _time.

| where formattedDate > relative_time(now(), "-1w")
| eval _time=formattedDate
| timechart count span=7d

reverse
Contributor

right now it is starting Thursday for unknown reason
@denzelchung

0 Karma

reverse
Contributor

@denzelchung

why there is break of 4 days .. please observe last 4 entries..

| eval formattedDate=strptime(Date, "%Y-%m-%d")
| where formattedDate > relative_time(now(), "-10w@w")
| eval _time=formattedDate
| timechart sum(xxx) span=1w@w4
| eval avgCount = round(avgCount,0)

Date    xxx
2019-05-05T00:00:00.000-0400    119394
2019-05-12T00:00:00.000-0400    705593
2019-05-19T00:00:00.000-0400    724051
2019-05-26T00:00:00.000-0400    622243
2019-06-02T00:00:00.000-0400    923656
2019-06-09T00:00:00.000-0400    1040106
2019-06-16T00:00:00.000-0400    1117687
2019-06-23T00:00:00.000-0400    1331860
2019-06-30T00:00:00.000-0400    779990
2019-07-07T00:00:00.000-0400    838488
2019-07-11T00:00:00.000-0400    884224
0 Karma

reverse
Contributor

You are amazing ! @denzelchung
It worked!!!

One more help please .. how can I choose start of the week - sunday/monday in 7d span ?

0 Karma

denzelchung
Path Finder

Currently we're using "span=1w", which is 1 week from today. If we run the same search tomorrow, it would probably start on Friday for you.

To start from the start of the week, use "1w@w". The additional "@w" would snap the time to the beginning of the week. Take a look at https://answers.splunk.com/answers/5350/possible-to-redefine-w-to-start-on-different-day.html for more details.
You can also specify which day you want to start on (e.g. w0 = Sunday, w1 = Monday, etc.)

reverse
Contributor

it worked!

0 Karma

reverse
Contributor
Date        XXX
 5/1/2019    0
 5/2/2019    0
 5/3/2019    0
 5/4/2019    0
 5/5/2019    0
 5/6/2019    0
 5/7/2019    0
 5/8/2019    136
 5/9/2019    62208
 5/10/2019    56432
 5/11/2019    618
 5/12/2019    5604
 5/13/2019    130244
 5/14/2019    152660
 5/15/2019    137472
 5/16/2019    147968

In CSV i have data since feb 2019 .. I want to timechart avg(xxx) span=1w

0 Karma

reverse
Contributor

Please guide. @jnudell_2 @Vijeta

0 Karma

reverse
Contributor

@renjith.nair -Please guide

0 Karma
Get Updates on the Splunk Community!

More Ways To Control Your Costs With Archived Metrics | Register for Tech Talk

Tuesday, May 14, 2024  |  11AM PT / 2PM ET Register to Attend Join us for this Tech Talk and learn how to ...

.conf24 | Personalize your .conf experience with Learning Paths!

Personalize your .conf24 Experience Learning paths allow you to level up your skill sets and dive deeper ...

Threat Hunting Unlocked: How to Uplevel Your Threat Hunting With the PEAK Framework ...

WATCH NOWAs AI starts tackling low level alerts, it's more critical than ever to uplevel your threat hunting ...