How to apply time-setting for different types of logs ?

[georgear7]

I have different flavors of log files, below are those.

1. Each events having timestamp
2. Events without timestamp
3. Few events having timestamp, few doesn't.

For all these type of logs, i have one common source type because these are belongs to one app. Due to these varieties of logs, will it create any problem like logs not getting updated properly on time or sometime data itself is missing ? If that is the case, how to apply time-setting to fix the issue ?

[richgalloway · Accepted solution]

The app developers have not done you any favors.  If you have any influence over them, get them to fix the logs.  Otherwise, yes, you will have problems with that data.

Your best option (other than fixing the app) might be to specify DATETIME_CONFIG = current in props.conf.  That will apply the current timestamp to all events regardless of the presence of a timestamp in the event itself.

[georgear7]

@richgalloway Thanks for your suggestion. Let me check on this and get back to you.