All Apps and Add-ons
×

Are you a member of the Splunk Community?

Sign in or Register with your Splunk account to get your questions answered, access valuable resources and connect with experts!
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Ask a Question
Solved! Jump to solution

Why is my DB connect checkpoint value not updating?

jacobpevans
Motivator
‎03-09-2020 02:49 PM

Howdy Splunkers,

After creating a new database input through the DB connect GUI, the query keeps returning the same values, and the checkpoint value is not updating.

Log search:

index=_internal host=[db_connect_host] sourcetype=dbx_server DbInputCheckpointRepository

Log messages:

2020-03-09 17:15:00.253 -0400  [QuartzScheduler_Worker-5] INFO  c.s.d.s.dbinput.task.DbInputCheckpointRepository - action=load_checkpoint_from_cache checkpoint=Checkpoint{value='9090000', appVersion='3.1.2', columnType=2, timestamp='2020-03-09T17:06:32.535-04:00'}
2020-03-09 17:15:00.254 -0400  [QuartzScheduler_Worker-5] ERROR c.s.d.s.dbinput.task.DbInputCheckpointRepository - action=unable_to_save_checkpoint
java.io.FileNotFoundException: D:\Program Files\Splunk\var\lib\splunk\modinputs\server\splunk_app_db_connect\[db_connect_input_name] (Access is denied)
    at java.io.FileOutputStream.open0(Native Method)
    at java.io.FileOutputStream.open(Unknown Source)
    at java.io.FileOutputStream.<init>(Unknown Source)
    at java.io.FileWriter.<init>(Unknown Source)
    at com.splunk.dbx.server.dbinput.task.DbInputCheckpointRepository.dumpCheckpoint(DbInputCheckpointRepository.java:206)
    at com.splunk.dbx.server.dbinput.task.DbInputCheckpointRepository.saveImpl(DbInputCheckpointRepository.java:239)
    at com.splunk.dbx.server.dbinput.task.DbInputCheckpointRepository.saveCheckpoint(DbInputCheckpointRepository.java:115)
    at com.splunk.dbx.server.dbinput.task.DbInputCheckpointRepository.save(DbInputCheckpointRepository.java:102)
    at com.splunk.dbx.server.dbinput.task.DbInputTask.saveCheckpoint(DbInputTask.java:114)
    at com.splunk.dbx.server.dbinput.task.processors.HecEventWriter.writeRecords(HecEventWriter.java:68)
    at org.easybatch.core.job.BatchJob.writeBatch(BatchJob.java:203)
    at org.easybatch.core.job.BatchJob.call(BatchJob.java:79)
    at org.easybatch.extensions.quartz.Job.execute(Job.java:59)
    at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
2020-03-09 17:15:00.254 -0400  [QuartzScheduler_Worker-5] ERROR org.easybatch.core.job.BatchJob - Unable to write records
com.splunk.dbx.server.exception.WriteCheckpointFailException: Error(s) occur when writing checkpoint.
    at com.splunk.dbx.server.dbinput.task.DbInputCheckpointRepository.saveCheckpoint(DbInputCheckpointRepository.java:121)
    at com.splunk.dbx.server.dbinput.task.DbInputCheckpointRepository.save(DbInputCheckpointRepository.java:102)
    at com.splunk.dbx.server.dbinput.task.DbInputTask.saveCheckpoint(DbInputTask.java:114)
    at com.splunk.dbx.server.dbinput.task.processors.HecEventWriter.writeRecords(HecEventWriter.java:68)
    at org.easybatch.core.job.BatchJob.writeBatch(BatchJob.java:203)
    at org.easybatch.core.job.BatchJob.call(BatchJob.java:79)
    at org.easybatch.extensions.quartz.Job.execute(Job.java:59)
    at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)

Cheers,
Jacob

Cheers,
Jacob

If you feel this response answered your question, please do not forget to mark it as such. If it did not, but you do have the answer, feel free to answer your own post and accept that as the answer.
0 Karma
Reply
1 Solution
Solved! Jump to solution
Solution

jacobpevans
Motivator
‎03-09-2020 02:51 PM

Despite running as "Local System", apparently Splunk was unable to update the file. I relaxed the security on this checkpoint file only, and now it updates no problem.

2020-03-09 17:40:01.470 -0400  [QuartzScheduler_Worker-7] INFO  c.s.d.s.dbinput.task.DbInputCheckpointRepository - action=save_checkpoint_success checkpoint=Checkpoint{value='9092006', appVersion='3.2.0', columnType=2, timestamp='2020-03-09T17:40:01.436-04:00'}
Cheers,
Jacob

If you feel this response answered your question, please do not forget to mark it as such. If it did not, but you do have the answer, feel free to answer your own post and accept that as the answer.

View solution in original post

Reply
Solved! Jump to solution
Solution

jacobpevans
Motivator
‎03-09-2020 02:51 PM

Despite running as "Local System", apparently Splunk was unable to update the file. I relaxed the security on this checkpoint file only, and now it updates no problem.

2020-03-09 17:40:01.470 -0400  [QuartzScheduler_Worker-7] INFO  c.s.d.s.dbinput.task.DbInputCheckpointRepository - action=save_checkpoint_success checkpoint=Checkpoint{value='9092006', appVersion='3.2.0', columnType=2, timestamp='2020-03-09T17:40:01.436-04:00'}
Cheers,
Jacob

If you feel this response answered your question, please do not forget to mark it as such. If it did not, but you do have the answer, feel free to answer your own post and accept that as the answer.
Reply
Get Updates on the Splunk Community!

Get Early Access to AI Playbook Authoring: Apply for the Alpha Private Preview ...

Passionate about security automation? Apply now to our AI Playbook Authoring Alpha private preview ...

Reduce and Transform Your Firewall Data with Splunk Data Management

Managing high-volume firewall data has always been a challenge. Noisy events and verbose traffic logs often ...

Automatic Discovery Part 1: What is Automatic Discovery in Splunk Observability Cloud ...

If you’ve ever deployed a new database cluster, spun up a caching layer, or added a load balancer, you know it ...