Deployment Architecture

Mask data at indexserver for only some of the indexes

jnhth
Explorer

I want to mask only data in my test indexes (I have both prod and test indexes on 1 indexer server)

Can I do so? As I can see the masking is applied to all my indexes with data from a specified spurcetype.

Ex:
props.conf:
[source::...\access.log*]
sourcetype = access_common

transform.conf:
[access_common]
SE-msi1 = q/(\/eb\/res\/rec\/Number\/\d{2})\d{4}/\1xxxx/

Tags (3)
0 Karma
1 Solution

woodcock
Esteemed Legend

Given your clarification:

Some host are test and some are prod - the filename is the same but the paths are different

Then you can do this:

props.conf:

[source::.../UniqueSegmentOfTestPath/...]
sourcetype = access_common_filter_first

[source::.../UniqueSegmentOfProductionPath/...]
sourcetype = access_common

transform.conf:

[access_common_filter_first]
SE-msi1 = q/(/eb/res/rec/Number/d{2})d{4}/1xxxx/
rename = access_common

View solution in original post

0 Karma

woodcock
Esteemed Legend

Given your clarification:

Some host are test and some are prod - the filename is the same but the paths are different

Then you can do this:

props.conf:

[source::.../UniqueSegmentOfTestPath/...]
sourcetype = access_common_filter_first

[source::.../UniqueSegmentOfProductionPath/...]
sourcetype = access_common

transform.conf:

[access_common_filter_first]
SE-msi1 = q/(/eb/res/rec/Number/d{2})d{4}/1xxxx/
rename = access_common
0 Karma

woodcock
Esteemed Legend

What discriminates test vs. prod? Is there a difference in the path/file? Are some hosts prod and some test?

0 Karma

jnhth
Explorer

Some host are test and some are prod - the filename is the same but the paths are different

0 Karma

somesoni2
Revered Legend

Since both prod and test are on same server and surely, they will have same sourcetype and can have same source, try to setup the masking based on host (in props.conf).

0 Karma
Get Updates on the Splunk Community!

Index This | Why did the turkey cross the road?

November 2025 Edition  Hayyy Splunk Education Enthusiasts and the Eternally Curious!   We’re back with this ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Feel the Splunk Love: Real Stories from Real Customers

Hello Splunk Community,    What’s the best part of hearing how our customers use Splunk? Easy: the positive ...