Splunk Enterprise Security

How to Separate data from main index/HF?

Zacknoid
Explorer

Hello everyone, 
I am trying to separate data getting into the main index from particular hosts. I am trying 

Transforms.conf
[windows_ot]
DEST_KEY = _metadata_index
Regex = HOst123
Format = host_wineventlog
Source_key = Metadata:Host

Props.conf
[wineventlog]
Transforms-setindex = windows_ot

Do we have another way to separate 26 host's data ( without accessing the host machines ) 
The following data flow level 2 (Heavyforwarder) sending data to ---> level 3 (heavy forwarder) ---> main HF
Is it a way to separate data in the main HF ?? also is trans conf correct ?? 

Labels (2)
0 Karma
1 Solution

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

View solution in original post

Zacknoid
Explorer

We're using intermediate forwarders to send data from one level to another, as in between there are firewall and communication though one HF to another HF on another level. 
we're collecting all data from UF's and using HF to push it to another level with all firewall rules and policies.

I am trying with DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

Do you have any document link referring to the same ? | THANKS

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

richgalloway
SplunkTrust
SplunkTrust

The correct value for DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

The transforms must be on the first heavy forwarder through which the data passes.

Why do you have intermediate forwarders (IFs)?  Why multiple layers of IFs?  Why are you using HFs instead of UFs for the IFs?  IFs add complexity and can impede performance

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Splunk Forwarders and Forced Time Based Load Balancing

Splunk customers use universal forwarders to collect and send data to Splunk. A universal forwarder can send ...

NEW! Log Views in Splunk Observability Dashboards Gives Context From a Single Page

Today, Splunk Observability releases log views, a new feature for users to add their logs data from Splunk Log ...

Last Chance to Submit Your Paper For BSides Splunk - Deadline is August 12th!

Hello everyone! Don't wait to submit - The deadline is August 12th! We have truly missed the community so ...