Splunk Enterprise Security

How to Separate data from main index/HF?

Zacknoid
Explorer

Hello everyone, 
I am trying to separate data getting into the main index from particular hosts. I am trying 

Transforms.conf
[windows_ot]
DEST_KEY = _metadata_index
Regex = HOst123
Format = host_wineventlog
Source_key = Metadata:Host

Props.conf
[wineventlog]
Transforms-setindex = windows_ot

Do we have another way to separate 26 host's data ( without accessing the host machines ) 
The following data flow level 2 (Heavyforwarder) sending data to ---> level 3 (heavy forwarder) ---> main HF
Is it a way to separate data in the main HF ?? also is trans conf correct ?? 

Labels (2)
0 Karma
1 Solution

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

View solution in original post

Zacknoid
Explorer

We're using intermediate forwarders to send data from one level to another, as in between there are firewall and communication though one HF to another HF on another level. 
we're collecting all data from UF's and using HF to push it to another level with all firewall rules and policies.

I am trying with DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

Do you have any document link referring to the same ? | THANKS

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

richgalloway
SplunkTrust
SplunkTrust

The correct value for DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

The transforms must be on the first heavy forwarder through which the data passes.

Why do you have intermediate forwarders (IFs)?  Why multiple layers of IFs?  Why are you using HFs instead of UFs for the IFs?  IFs add complexity and can impede performance

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...