All Apps and Add-ons

Why is rising column getting old logs into Splunk aswell?

kiranpanchavat1
Path Finder

Hello Team,

we have selected the rising column feature of DBX that allows Splunk to incrementally import new database records. But it’s not working and getting old logs into our Splunk aswell. 

we need logs from the 01st March 2022 but we are receiving logs from the last year 2021. 

select * from xxxxxxxxxxxxxxx
SELECT * FROM your_table
WHERE LoginDt > ?
ORDER BY LoginDt ASC

checkpoint value : 3/1/2022 00:00:00.000

Labels (1)
Tags (1)
0 Karma

scelikok
SplunkTrust
SplunkTrust

Hi @kiranpanchavat1,

If LoginDt field is not DateTime type field, the query will be sorted as text. This does not seem Splunk DBConnect problem.

You can test the result by replacing ? sign with checkpoing value.

SELECT * FROM your_table
WHERE LoginDt > '3/1/2022 00:00:00.000'
ORDER BY LoginDt ASC

The best option is using an ID column if there is any incrementing numeric field, the lst option may be a DateTime field.

If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma
Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Get the T-shirt to Prove You Survived Splunk University Bootcamp

As if Splunk University, in Las Vegas, in-person, with three days of bootcamps and labs weren’t enough, now ...

Wondering How to Build Resiliency in the Cloud?

IT leaders are choosing Splunk Cloud as an ideal cloud transformation platform to drive business resilience,  ...