Getting Data In

Change index depending on host

pbalbasdtt
Path Finder

Hi all,

I'm trying to split Windows events into different indexes at index time depending on the host which is sending them. Below there are my props.conf and transforms.conf

  • props.conf:
    [WMI:WinEventLog:Security]
    TRANSFORMS-set_new_index = set_index_new

  • transforms.conf
    [set_index_new]
    REGEX = MY.HOSTNAME.12.COM
    FORMAT = windows-new
    DEST_KEY = _MetaData:Index

I tried with different combinations on the regex but none of them worked. Can someone tell me what could be wrong? Thanks in advance.

Best.

0 Karma
1 Solution

DalJeanis
Legend

1) Your transforms does not say which field you are trying to match (SOURCE_KEY). If you don't tell it that, then it probably is checking the entire _raw, iirc.

2) If you mean to match only the character ., then your regex should escape the character using \.

View solution in original post

0 Karma

DalJeanis
Legend

1) Your transforms does not say which field you are trying to match (SOURCE_KEY). If you don't tell it that, then it probably is checking the entire _raw, iirc.

2) If you mean to match only the character ., then your regex should escape the character using \.

0 Karma

pbalbasdtt
Path Finder

The 2nd one works!!! Thanks a lot for your answer

0 Karma

harsmarvania57
Ultra Champion

Hi,

On which splunk instance, have you configured above props.conf and transforms.conf ? It should be on first Splunk Enterprise instance from Universal Forwarder. For example: If UF sends data to Heavy Forwarder and then it goes to Indexer then you need to configure props & transforms on Heavy Forwarder. If UF sends data directly to Indexer then you need to configure props & transforms on Indexer.

pbalbasdtt
Path Finder

Hi,

Thanks for your response. I have a UF sending logs to indexers. I deployed those .conf files on indexers but it's not indexing logs on the new index, and it is using the old one.

0 Karma

harsmarvania57
Ultra Champion

Have you restarted splunk on Indexer after adding those props/transforms ?

0 Karma

pbalbasdtt
Path Finder

I deployed the changes via Cluster Master, so I assume no restart on IDX is required, is that right?

0 Karma

harsmarvania57
Ultra Champion

Yes if you deployed from CM then it will automatically take care. Additionally only new data will go into new index not existing data. If that is still not working then I'll suggest to provide some sample data (Mask sensitive data)

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Thanks for the Memories! Splunk University, .conf25, and our Community

Thank you to everyone in the Splunk Community who joined us for .conf25, which kicked off with our iconic ...

Data Persistence in the OpenTelemetry Collector

This blog post is part of an ongoing series on OpenTelemetry. What happens if the OpenTelemetry collector ...

Introducing Splunk 10.0: Smarter, Faster, and More Powerful Than Ever

Now On Demand Whether you're managing complex deployments or looking to future-proof your data ...