Getting Data In

Index all and selective forward

Adevill
Loves-to-Learn Lots

Hi all. I need some help to index all data coming into one server and only forward 3 sourcetypes to a 2nd server. Receiving and indexing the data is not a problem, but I cannot seem to get the 3 sourcetypes to the 2nd server. Any help would be appreciated.

 My props.conf

 

[cisco:asa]
TRANSFORMS-routing=gsoc

[icsp]
TRANSFORMS-routing=gsoc

[syslog]
TRANSFORMS-routing=gsoc

 

 

transforms.conf

 

[gsoc]
REGEX=.
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary

 

 

and outputs.conf

 

[tcpout]
defaultGroup=nothing
indexAndForward=true

[tcpout:gsocPrimary]
server=*.*.*.*:9997

 

Labels (1)
0 Karma

Vardhan
Contributor

Hi @Adevill,

Are you trying to forward the data from HF?

The connectivity between source and destination is exist?

Try the below outputs


[tcpout]
defaultGroup=none
indexAndForward=true

[tcpout:gsocPrimary]
server=*.*.*.*:9997

 

And why are using the 9997 port why can't use a port like 514?

The 9997 port is already is used to get the data from the forwarder to an indexer. Don't use the same port for two different activities.

0 Karma

Adevill
Loves-to-Learn Lots

Hey @Vardhan 

Yes, I'm trying to forward from HF to a test server at the moment, that's why the port 9997 doesn't matter now, but you are correct, I would have chosen a different one for deployment. Connectivity is not a problem as I can forward all data to the 2nd server, but it fails when trying to filter for only the 3 sourcetypes. The solution you suggested also didn't work unfortunately. 

0 Karma

Vardhan
Contributor

@Adevill just give a try by keeping seperate stanza's in transform.conf.

props
[cisco:asa]
TRANSFORMS-routing=gsoc1
[icsp]
TRANSFORMS-routing=gsoc2
[syslog]
TRANSFORMS-routing=gsoc3

[gsoc1]
REGEX=(.*)
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary
[gsoc2]
REGEX=(.*)
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary
[gsoc3]
REGEX=(.*)
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary

0 Karma

Adevill
Loves-to-Learn Lots

Hi @Vardhan 

Unfortunately it's also not working. 

0 Karma

Vardhan
Contributor

@Adevill Can u try with one source type first and check the result

0 Karma

Adevill
Loves-to-Learn Lots

Hi @Vardhan 

Even if I try just 1 sourcetype it doesn't work.

I've then removed the forwarding, then re-enabled it for all tags, which worked, then changed to a single sourcetype again which failed then again. Any other ideas?

0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...