Getting Data In

How can I forward data received from file path monitoring to third party system?

swapsplunk236
Explorer

Hi, We have a UF which forwards data to HF and HF passes it to indexers. UF forwards OS logs as well as logs from the directory that we are monitoring. We have configured HF to forward data received to indexers as well as to third party system as explained here: http://docs.splunk.com/Documentation/SplunkCloud/6.6.3/Forwarding/Forwarddatatothird-partysystemsd.

But as checked only OS logs are getting forwarded and not the logs from the directory. Can anybody suggest the additional checks we should perform to ensure logs from the directory too are getting forwarded to third party system?

Thanks.

0 Karma
1 Solution

harsmarvania57
Ultra Champion

Can you please share your configuration which you configured on HF (Please mask any sensitive data) ?

View solution in original post

DavidHourani
Super Champion

Hi swapsplunk236,

If your OS logs are being received that means your chain UF -> HF ->IDX+3rdParty is working properly. It could be that you misconfigured the data input to read from your folders. Can you please post your UF inputs / outputs config ?

Regards,
David

0 Karma

naidusadanala
Communicator

Please follow this

-->Make sure you have no transforms configured for that data for routing purpose
Forward all data
This example shows how to send all the data from a forwarder to a third-party system. Since you are sending all the data, you only need to edit outputs.conf:

[tcpout]

[tcpout:fastlane]
server = 10.1.1.35:6996
sendCookedData = false

0 Karma

swapsplunk236
Explorer

Hi, Thank you for the suggestion. I will try this too.

0 Karma

harsmarvania57
Ultra Champion

Can you please share your configuration which you configured on HF (Please mask any sensitive data) ?

swapsplunk236
Explorer

Hi, Please see below for current output configuration in place on HF.

[tcpout]
defaultGroup = default-INDEXERS
autoLB = true
autoACK = true
indexAndForward = false
forwardedindex.filter.disable = true

Configuration settings to forward logs from Heavy forwarder to Indexer1 and Indexer2

[tcpout:default-INDEXERS]
autoLBFrequency = 40
server = indexer1:9997,indexer2:9997

Configuration settings to forward logs from Heavy forwarder to Third party.

[syslog]
type = udp
sendCookedData = false
DefaultGroup = SIEM-TP

[syslog:SIEM-TP]
server=X.X.X.X:port
disabled=false

0 Karma

harsmarvania57
Ultra Champion

In syslog stanza it should be defaultGroup not DefaultGroup, if this is correctly configured then please share your props.conf and transforms.conf

0 Karma

swapsplunk236
Explorer

Thanks. Here is my prop.conf

[host::*]
TRANSFORMS = SIEM-TP-T

and transform.conf

[SIEM-TP-T]
REGEX= .
DEST_KEY =_SYSLOG_ROUTING
FORMAT = SIEM-TP

0 Karma

harsmarvania57
Ultra Champion

Please change your props.conf as below and restart splunk on HF.

[host::*]
TRANSFORMS-all = SIEM-TP-T

swapsplunk236
Explorer

This worked for me! Thank you very much.
[host::*]
TRANSFORMS-all = SIEM-TP-T

0 Karma

harsmarvania57
Ultra Champion

I have converted my comment to answer, please accept and upvote it.

0 Karma
Get Updates on the Splunk Community!

How to Monitor Google Kubernetes Engine (GKE)

We’ve looked at how to integrate Kubernetes environments with Splunk Observability Cloud, but what about ...

Index This | How can you make 45 using only 4?

October 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with this ...

Splunk Education Goes to Washington | Splunk GovSummit 2024

If you’re in the Washington, D.C. area, this is your opportunity to take your career and Splunk skills to the ...