Splunk Enterprise Security

How to Separate data from main index/HF?

Zacknoid
Explorer

Hello everyone, 
I am trying to separate data getting into the main index from particular hosts. I am trying 

Transforms.conf
[windows_ot]
DEST_KEY = _metadata_index
Regex = HOst123
Format = host_wineventlog
Source_key = Metadata:Host

Props.conf
[wineventlog]
Transforms-setindex = windows_ot

Do we have another way to separate 26 host's data ( without accessing the host machines ) 
The following data flow level 2 (Heavyforwarder) sending data to ---> level 3 (heavy forwarder) ---> main HF
Is it a way to separate data in the main HF ?? also is trans conf correct ?? 

Labels (2)
0 Karma
1 Solution

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

View solution in original post

Zacknoid
Explorer

We're using intermediate forwarders to send data from one level to another, as in between there are firewall and communication though one HF to another HF on another level. 
we're collecting all data from UF's and using HF to push it to another level with all firewall rules and policies.

I am trying with DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

Do you have any document link referring to the same ? | THANKS

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

richgalloway
SplunkTrust
SplunkTrust

The correct value for DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

The transforms must be on the first heavy forwarder through which the data passes.

Why do you have intermediate forwarders (IFs)?  Why multiple layers of IFs?  Why are you using HFs instead of UFs for the IFs?  IFs add complexity and can impede performance

---
If this reply helps you, Karma would be appreciated.
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.


Introducing Unified TDIR with the New Enterprise Security 8.2

Read the blog

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Community Content Calendar, September edition

Welcome to another insightful post from our Community Content Calendar! We're thrilled to continue bringing ...

Splunkbase Unveils New App Listing Management Public Preview

Splunkbase Unveils New App Listing Management Public PreviewWe're thrilled to announce the public preview of ...

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Are you leveraging automation to its fullest potential in your threat detection strategy?Our upcoming Security ...