All Apps and Add-ons

Rising column not working as expected

Explorer

Hello experts
I have a DB Connect connection to my DB that validates. The query that I send to the DB is displayed here:

WITH "dte" as (SELECT * 
FROM "T_AUDIT_LOG_HISTORY"
UNION
SELECT * 
FROM "T_AUDIT_LOG"
)
select *
from "dte"
where "UN_ID" > ?
ORDER BY "UN_ID" ASC

I use a rising value on column 10 ("UN_ID") which is a integer unique identifier that increases for every new record. This table is not updated. Only inserts arrive. The first column has a timestamp that I link to the _time internal field. What I would expect is that every unique id is imported just once, but this is not the case. Every 15 minutes it imports a full copy of the whole table...

Here is my config file for this connector:

[AUDIT_LOG_HIST]
connection = Production
disabled = 0
host = XXX_PROD
index = xxx
index_time_mode = dbColumn
input_timestamp_column_number = 1
interval = */15 * * * *
mode = rising
query = WITH "dte" as (SELECT * \
FROM "T_AUDIT_LOG_HISTORY"\
UNION\
SELECT * \
FROM "T_AUDIT_LOG"\
)\
select *\
from "dte"\
where "UN_ID" > ?\
ORDER BY "UN_ID" ASC
query_timeout = 60
sourcetype = audit:log
tail_rising_column_number = 10

I would only need the new ids so I don't see any doubles in my index.

Thanks in advance
P

Labels (2)
0 Karma
1 Solution

Explorer

Removing the whole thing and starting from scratch fixed this issue...

View solution in original post

0 Karma

Explorer

Removing the whole thing and starting from scratch fixed this issue...

View solution in original post

0 Karma
State of Splunk Careers

Access the Splunk Careers Report to see real data that shows how Splunk mastery increases your value and job satisfaction.

Find out what your skills are worth!