I would like to eliminate the unnecessary content in the events because I have a small license. I want to remove the text and 20 . characters from each of the events. So I added two stanzas in transforms.conf: one for removing the . dot, and one for removing text . Even these small stanzas make a huge impact on my very frequently rolling logs.
transforms.conf
[nullifytext]
REGEX = ^\.{20}$
DEST_KEY = queue
FORMAT = nullQueue
props.conf
[webserverIH]
TRANSFORMS-removedots= nullifytext
category = Application
description = webserver logs
pulldown_type = 1
DATETIME_CONFIG =
NO_BINARY_CHECK = true
disabled = false
I have edited those logs at the search app level c:\Splunk\etc\apps\search\local and restarted Splunk. Now I have deleted the old logs and reindexed the new similar logs, but still I see the text (not shown here) and dots in the events.
UPDATE
This is my custom log file looks like. We want to remove the dots only from the splunk perspective.
....................
IP: ipaddress
Date: [07/Mar/2004:16:05:49 -0800]
Method: "GET /topicparent=Main.ConfigurationVariables HTTP/1.1"
Response: 401
Type: Info
....................
I want to remove only the . dot and Type:info from the event, not the entire event which contain the Type:info . I need Splunk not to index those dots and test for every event, and desired output should be
IP: ipaddress
Date: [07/Mar/2004:16:05:49 -0800]
Method: "GET /topicparent=Main.ConfigurationVariables HTTP/1.1"
Response: 401
... View more