@richgallowayHere's the code I'm running:. index=miscapps sourcetype="app:z-ingest" transaction source | where ProcessType = "UseCaseIngestion" AND isnotnull(TableName) | eval CurrDate = now() | eval RunDate = strptime(TimeStamp, "%m/%d/%y") | eval DaysSinceLoad = round((CurrDate - RunDate)/86400) | fillnull value=0 DaysSinceLoad, ExtractRowCount, LandingRowCount, ProdRowCount, ReturnCode | convert dur2sec(Duration) as Duration2 | eval Hour = floor(Duration2/3600) | eval Duration2 = strftime(Duration2, "%M:%S") | eval result = (Hour.":".Duration2) | eval Status=if((ReturnCode = 0) AND (DaysSinceLoad < 8), "Successful", "Error") | eval ErrMsg= case(ReturnCode !=0, ErrorMessage, DaysSinceLoad > 7, "Stale Data Ingestion", 1=1, "None") | rename Duration2 as Duration | dedup UseCase, DatabaseName, TableName | filldown UseCase, DatabaseName, ReturnCode, DaysSinceLoad | table UseCase, DatabaseName, TableName, Status, ReturnCode, SourceRowCount, ExtrRowCount, DaysSinceLoad, Duration The ouput leaves the UseCase, DatabaseName. Status, ReturnCode, and DaysSinceLoad fields blank on the second row. I have everything for this job in a single log file, and I repeat every field in the log file each time I extract a new table.
... View more