Microsoft Log Analytics Add-on : How do I use the checkpointing feature?

[althomas]

Hi all,

I've installed https://splunkbase.splunk.com/app/4127/ in order to pull some required data out of Log Analytics and into Splunk.

When setting up an input, there is a "Start Date" which implies that checkpointing is used in this app, but the only documentation I can find for this is as follows:

01/01/1970 00:00:00
Start date must be in the format of dd/mm/yyyy hh:mm:ss

In the DB Connect app, this is done by a ? in the query, but I don't know how this will be used when producing a query for Log Analytics.

Any and all help would be greatly appreciated.

Best regards,
Alex

[nickhills · Accepted solution]

Hi @althomas!

Having looked at the code, the TA seems to create/update a checkpoint each time it iterates through the data collection.

This checkpoint date is used as the starting point on subsequent queries, but in the case that this is the first run it will override the (non-existent) checkpoint value with the value defined in your inputs.conf

if helper.get_check_point(input_name):
    start_datetime = datetime.datetime.strptime(helper.get_check_point(input_name),'%d/%m/%Y %H:%M:%S')
else:
    start_datetime = datetime.datetime.strptime(str(input_item['start_date']),'%d/%m/%Y %H:%M:%S')