topic Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI in All Apps and Add-ons

DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

rajanala — Wed, 30 Sep 2020 01:00:07 GMT

Version: DB Connect 3.1.4
Issue: DB Connections and DB Inputs created via GUI works fine with no issues.
When new connections and inputs are added via CLI, the checkpoint for new inputs are not created and results in error.
ERROR c.s.d.s.dbinput.task.DbInputCheckpointRepository - action=unable_to_load_checkpoint

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

harsmarvania57 — Tue, 18 Jun 2019 15:43:36 GMT

Hi,

Can you please let us know, how you configured via CLI ? If you modified db_inputs.conf directly then it will not create checkpoint file automatically. When you create new input via GUI, it will create initial checkpoint file with value you provided during setup.

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

rajanala — Tue, 18 Jun 2019 15:52:11 GMT

Modified db_inputs.conf directly.
And yes, that is exactly my question. Why is the checkpoint created when configured via GUI and why not when edited via CLI ?

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

harsmarvania57 — Tue, 18 Jun 2019 15:54:45 GMT

When you create DB Input via GUI, it will hit DB Connect REST API (These are not publicly documented) which will create checkpoint file, however that is not the case when you modify config file directly.

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

rajanala — Tue, 18 Jun 2019 21:04:46 GMT

That explains the issue. Thanks for the information.

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

danielbb — Mon, 12 Apr 2021 12:41:02 GMT

@harsmarvania57

Is it possible to define the data input in the back-end including the checkpoint information?

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

harsmarvania57 — Mon, 12 Apr 2021 12:51:39 GMT

You can create checkpoint file manually but I'll not recommend it.

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

danielbb — Mon, 12 Apr 2021 12:58:05 GMT

@harsmarvania57

Are you saying that when creating new Data Inputs, I should define the configurations from the UI?

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

harsmarvania57 — Mon, 12 Apr 2021 13:00:48 GMT

Yes use the GUI, there are REST APIs but those are not documented by Splunk so I'll not use those as well.

Re: DB Connect 3.1.4 Error "unable_to_load_checkpoint" when configured via CLI

danielbb — Mon, 12 Apr 2021 13:07:25 GMT

We did exactly that over the weekend (after finding out that the back-end config doesn't work) and the problem is the initial load from the DB, that in some cases took hours, and we need to do couple of hundreds of DBs soon.