Deployment Architecture

forwarded data remove timestamp and host

KhalidAlharthi
Explorer

is there a way to remove the header comes with non syslog source types that include hostname and timestamp with priority at the begnning of the event sended

 

i have configuered outputs.conf,props.conf,transforms.conf

 

is there a way to remove the priority and hostname associated with timestamp on the third-party system

 

thanks

Labels (1)
0 Karma

KhalidAlharthi
Explorer

@KendallW Thanks for responding to this matter 

 

could you please give example cuz i don't understand it quite good .

for example this log 

Jul 14 14:15:56 10.128.213.50 Jul 14 14:15:56 my-host-int02 snmpd[7777]: Received SNMP packet(s) from UDP: [10.128.30.20]:54900

 

i want to remove the timestamp and host at the beginning of the event 

 

this happened because the non syslog source type i guess and i want this to be removed

0 Karma

KendallW
Contributor

Hi @KhalidAlharthi try this in props.conf (on indexer or HF)
PREAMBLE_REGEX = \w{3}\s(\d{2}[\s\:]){4}(\d{1,3}\.){3}\d{1,3}\s\w{3}\s(\d{2}[\s\:]){4}[^\s]+\s

0 Karma

KhalidAlharthi
Explorer

Can you see your private messages if you don't mind

0 Karma

KendallW
Contributor

Hi @KhalidAlharthi 

You can do this with PREAMBLE_REGEX in props.conf

PREAMBLE_REGEX = <regex>
* A regular expression that lets Splunk software ignore "preamble lines",
  or lines that occur before lines that represent structured data.
* When set, Splunk software ignores these preamble lines,
  based on the pattern you specify.
* Default: not set
0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...