Deployment Architecture

forwarded data remove timestamp and host

KhalidAlharthi
Explorer

is there a way to remove the header comes with non syslog source types that include hostname and timestamp with priority at the begnning of the event sended

 

i have configuered outputs.conf,props.conf,transforms.conf

 

is there a way to remove the priority and hostname associated with timestamp on the third-party system

 

thanks

Labels (1)
0 Karma

KhalidAlharthi
Explorer

@KendallW Thanks for responding to this matter 

 

could you please give example cuz i don't understand it quite good .

for example this log 

Jul 14 14:15:56 10.128.213.50 Jul 14 14:15:56 my-host-int02 snmpd[7777]: Received SNMP packet(s) from UDP: [10.128.30.20]:54900

 

i want to remove the timestamp and host at the beginning of the event 

 

this happened because the non syslog source type i guess and i want this to be removed

0 Karma

KendallW
Contributor

Hi @KhalidAlharthi try this in props.conf (on indexer or HF)
PREAMBLE_REGEX = \w{3}\s(\d{2}[\s\:]){4}(\d{1,3}\.){3}\d{1,3}\s\w{3}\s(\d{2}[\s\:]){4}[^\s]+\s

0 Karma

KhalidAlharthi
Explorer

Can you see your private messages if you don't mind

0 Karma

KendallW
Contributor

Hi @KhalidAlharthi 

You can do this with PREAMBLE_REGEX in props.conf

PREAMBLE_REGEX = <regex>
* A regular expression that lets Splunk software ignore "preamble lines",
  or lines that occur before lines that represent structured data.
* When set, Splunk software ignores these preamble lines,
  based on the pattern you specify.
* Default: not set
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...