Getting Data In

split events to different indexes and sanitize for PII data

wbrooks
New Member

I have a use case where I need to store pii data in one index and sanitized data in another index. I can use the clone_sourcetype, which works, but the problem is I also want to take the generic data that has no PII data and put it in a third index. The idea is as follows:
1). store non-pii data in index1
2). store pii data in a protected index2
3). store the same pii data, but sanitized in a general index3

---incoming data
- no queries send to index1
- has queries send to index2
- send duplicate of index2 to index3 and sanitize with sed / transforms etc

0 Karma
Get Updates on the Splunk Community!

Stay Connected: Your Guide to January Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...

[Puzzles] Solve, Learn, Repeat: Reprocessing XML into Fixed-Length Events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Data Management Digest – December 2025

Welcome to the December edition of Data Management Digest! As we continue our journey of data innovation, the ...