Getting Data In

Index all and selective forward

Adevill
Loves-to-Learn Lots

Hi all. I need some help to index all data coming into one server and only forward 3 sourcetypes to a 2nd server. Receiving and indexing the data is not a problem, but I cannot seem to get the 3 sourcetypes to the 2nd server. Any help would be appreciated.

 My props.conf

 

[cisco:asa]
TRANSFORMS-routing=gsoc

[icsp]
TRANSFORMS-routing=gsoc

[syslog]
TRANSFORMS-routing=gsoc

 

 

transforms.conf

 

[gsoc]
REGEX=.
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary

 

 

and outputs.conf

 

[tcpout]
defaultGroup=nothing
indexAndForward=true

[tcpout:gsocPrimary]
server=*.*.*.*:9997

 

Labels (1)
0 Karma

Vardhan
Contributor

Hi @Adevill,

Are you trying to forward the data from HF?

The connectivity between source and destination is exist?

Try the below outputs


[tcpout]
defaultGroup=none
indexAndForward=true

[tcpout:gsocPrimary]
server=*.*.*.*:9997

 

And why are using the 9997 port why can't use a port like 514?

The 9997 port is already is used to get the data from the forwarder to an indexer. Don't use the same port for two different activities.

0 Karma

Adevill
Loves-to-Learn Lots

Hey @Vardhan 

Yes, I'm trying to forward from HF to a test server at the moment, that's why the port 9997 doesn't matter now, but you are correct, I would have chosen a different one for deployment. Connectivity is not a problem as I can forward all data to the 2nd server, but it fails when trying to filter for only the 3 sourcetypes. The solution you suggested also didn't work unfortunately. 

0 Karma

Vardhan
Contributor

@Adevill just give a try by keeping seperate stanza's in transform.conf.

props
[cisco:asa]
TRANSFORMS-routing=gsoc1
[icsp]
TRANSFORMS-routing=gsoc2
[syslog]
TRANSFORMS-routing=gsoc3

[gsoc1]
REGEX=(.*)
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary
[gsoc2]
REGEX=(.*)
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary
[gsoc3]
REGEX=(.*)
DEST_KEY=_TCP_ROUTING
FORMAT=gsocPrimary

0 Karma

Adevill
Loves-to-Learn Lots

Hi @Vardhan 

Unfortunately it's also not working. 

0 Karma

Vardhan
Contributor

@Adevill Can u try with one source type first and check the result

0 Karma

Adevill
Loves-to-Learn Lots

Hi @Vardhan 

Even if I try just 1 sourcetype it doesn't work.

I've then removed the forwarding, then re-enabled it for all tags, which worked, then changed to a single sourcetype again which failed then again. Any other ideas?

0 Karma
Get Updates on the Splunk Community!

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...