I try to index my logs with a custom Source type. Here is my files :
Log file exemple :
#HeaderKey1: header value 1
#HeaderKey2: header value 2
id|severity|date|time|duration|description|uri|operation|collection|lang|format|size|source|errorcode|links|badlinks|collectionid|sourceid|printableuri
...
transforms.conf :
[my_log]
DELIMS="|"
FIELDS = "id", "severity", "date", "time", "duration", "description", "uri", "operation", "collection", "lang", "format", "size", "source", "errorcode", "links", "badlinks", "collectionid", "sourceid", "printableuri"
[my_log_comment]
REGEX = ^#
DEST_KEY = queue
FORMAT = nullQueue
props.conf :
[my_log]
EXTRACT-my_log = my_log_comment, my_log
The result is that all the line are indexed (header include) and the only field i got is _raw... I do not care about the information in the header; I don't want to index it or to take information from it. I only want to have all my log with all the fields.
What is wrong in my configuration? What i should do to index my custom log file correctly
thank you
... View more