Splunk Search

How to exclude a row with respect to certain timestamp using outlier

Srubhi
Path Finder

Hi, 

i have the below table data where i have timecharted for 1hr time span i want to remove the row which is in red colour as it is coming with different time when compare to other data. 

can i be using outlier command to perform this operation and how i can achieve this requirement.

Thank you in advance, 

_timeBCDEF
2023-10-06 22:00       
2023-10-07 22:00       
2023-10-08 22:00       
2023-10-09 09:00       
2023-10-09 22:00       
2023-10-10 09:00      
2023-10-10 22:00       
2023-10-11 22:00       
Labels (1)
Tags (1)
0 Karma

Srubhi
Path Finder

Hi  @ITWhisperer

Sorry for the delay.
my expectation is, suppose everyday we have data at 22:00 we need to keep that data and ignore the rest other data.

can outlier be the option to ignore the data coming with different timestamp?
please note: it is not always 22:00 data it can we any time but we have to ignore the other timestamp data apart from the usual one.
 
base search:

| mstats sum(Entity.InMessageCount.count.Sum) as count span=1h where index=cloudwatch_metrics AND Namespace=Entity AND Environment=prod AND EntityName="Order.SupplierDepot" AND ServiceDenomination=OutboundBatcher by Namespace, Environment, ServiceDenomination, MetricName, EntityName
| where count > 0



Output:

_time Namespace Environment ServiceDenomination MetricName EntityName Count 2023-10-06 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 1 2023-10-07 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 2 2023-10-08 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 3 2023-10-09 09:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 4 2023-10-09 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 5 2023-10-10 09:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 6 2023-10-10 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 7 2023-10-11 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier 8 2023-10-11 22:00   Entity Test TestBoundBatch TestMessageCount TestOrder.Supplier

9

 

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

There is not really enough information here to be able to easily help you. Please can you share your full search and some anonymised sample events for the volunteers to work with.

0 Karma

Srubhi
Path Finder

Hello @ITWhisperer ,

Is the above data is sufficient to resolve this issue. could you please help me in this.

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

Not really. It doesn't tell me what data you are dealing with nor what search you are using.

0 Karma

Srubhi
Path Finder

Hi  @ITWhisperer

my expectation is, suppose everyday we have data at 22:00 we need to keep that data and ignore the rest other data.

can outlier be the option to ignore the data coming with different timestamp?
please note: it is not always 22:00 data it can we any time but we have to ignore the other timestamp data apart from the usual one.
 
base search:

| mstats sum(Entity.InMessageCount.count.Sum) as count span=1h where index=cloudwatch_metrics AND Namespace=Entity AND Environment=prod AND EntityName="Order.SupplierDepot" AND ServiceDenomination=OutboundBatcher by Namespace, Environment, ServiceDenomination, MetricName, EntityName
| where count > 0

 

0 Karma

Srubhi
Path Finder

Output

_timeNamespaceEnvironmentServiceDenominationMetricNameEntityNameCount
2023-10-06 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier1
2023-10-07 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier2
2023-10-08 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier3
2023-10-09 09:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier4
2023-10-09 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier5
2023-10-10 09:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier6
2023-10-10 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier7
2023-10-11 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier8
2023-10-11 22:00  EntityTestTestBoundBatchTestMessageCountTestOrder.Supplier9
0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

Try something like this

| where strftime(_time, "%H") != "22"
0 Karma
Get Updates on the Splunk Community!

Enhance Security Visibility with Splunk Enterprise Security 7.1 through Threat ...

(view in My Videos)Struggling with alert fatigue, lack of context, and prioritization around security ...

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...

Adoption of Infrastructure Monitoring at Splunk

  Splunk's Growth Engineering team showcases one of their first Splunk product adoption-Splunk Infrastructure ...