All Apps and Add-ons

Microsoft Log Analytics Add-on : How do I use the checkpointing feature?

althomas
Communicator

Hi all,

I've installed https://splunkbase.splunk.com/app/4127/ in order to pull some required data out of Log Analytics and into Splunk.

When setting up an input, there is a "Start Date" which implies that checkpointing is used in this app, but the only documentation I can find for this is as follows:

01/01/1970 00:00:00
Start date must be in the format of dd/mm/yyyy hh:mm:ss

In the DB Connect app, this is done by a ? in the query, but I don't know how this will be used when producing a query for Log Analytics.

Any and all help would be greatly appreciated.

Best regards,
Alex

1 Solution

nickhills
Ultra Champion

Hi @althomas!

Having looked at the code, the TA seems to create/update a checkpoint each time it iterates through the data collection.

This checkpoint date is used as the starting point on subsequent queries, but in the case that this is the first run it will override the (non-existent) checkpoint value with the value defined in your inputs.conf

if helper.get_check_point(input_name):
    start_datetime = datetime.datetime.strptime(helper.get_check_point(input_name),'%d/%m/%Y %H:%M:%S')
else:
    start_datetime = datetime.datetime.strptime(str(input_item['start_date']),'%d/%m/%Y %H:%M:%S')
If my comment helps, please give it a thumbs up!

View solution in original post

nickhills
Ultra Champion

Hi @althomas!

Having looked at the code, the TA seems to create/update a checkpoint each time it iterates through the data collection.

This checkpoint date is used as the starting point on subsequent queries, but in the case that this is the first run it will override the (non-existent) checkpoint value with the value defined in your inputs.conf

if helper.get_check_point(input_name):
    start_datetime = datetime.datetime.strptime(helper.get_check_point(input_name),'%d/%m/%Y %H:%M:%S')
else:
    start_datetime = datetime.datetime.strptime(str(input_item['start_date']),'%d/%m/%Y %H:%M:%S')
If my comment helps, please give it a thumbs up!
Get Updates on the Splunk Community!

Splunk Observability Cloud | Unified Identity - Now Available for Existing Splunk ...

Raise your hand if you’ve already forgotten your username or password when logging into an account. (We can’t ...

Index This | How many sides does a circle have?

February 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

Registration for Splunk University is Now Open!

Are you ready for an adventure in learning?   Brace yourselves because Splunk University is back, and it's ...