Splunk Enterprise Security

How to Separate data from main index/HF?

Zacknoid
Explorer

Hello everyone, 
I am trying to separate data getting into the main index from particular hosts. I am trying 

Transforms.conf
[windows_ot]
DEST_KEY = _metadata_index
Regex = HOst123
Format = host_wineventlog
Source_key = Metadata:Host

Props.conf
[wineventlog]
Transforms-setindex = windows_ot

Do we have another way to separate 26 host's data ( without accessing the host machines ) 
The following data flow level 2 (Heavyforwarder) sending data to ---> level 3 (heavy forwarder) ---> main HF
Is it a way to separate data in the main HF ?? also is trans conf correct ?? 

Labels (2)
0 Karma
1 Solution

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

View solution in original post

Zacknoid
Explorer

We're using intermediate forwarders to send data from one level to another, as in between there are firewall and communication though one HF to another HF on another level. 
we're collecting all data from UF's and using HF to push it to another level with all firewall rules and policies.

I am trying with DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

Do you have any document link referring to the same ? | THANKS

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

richgalloway
SplunkTrust
SplunkTrust

The correct value for DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

The transforms must be on the first heavy forwarder through which the data passes.

Why do you have intermediate forwarders (IFs)?  Why multiple layers of IFs?  Why are you using HFs instead of UFs for the IFs?  IFs add complexity and can impede performance

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

What’s new on Splunk Lantern in August

This month’s Splunk Lantern update gives you the low-down on all of the articles we’ve published over the past ...

Welcome to the Future of Data Search & Exploration

You have more data coming at you than ever before. Over the next five years, the total amount of digital data ...

This Week's Community Digest - Splunk Community Happenings [8.3.22]

Get the latest news and updates from the Splunk Community here! News From Splunk Answers ✍️ Splunk Answers is ...