Getting Data In

What is CLONE_SOURCETYPE used for in transforms.conf? Are there examples?

acharlieh
Influencer

It gets dangerous when I start looking at docs and start seeing features that I hadn't noticed before. So I was looking at the spec for transforms.conf and I noticed this paragraph stuck in here:

CLONE_SOURCETYPE = <string>
* Specifies the sourcetype of a cloned data stream.
* The value string must be nonempty.
* The value string should be different from the sourcetype of the original data stream.
  If it is the same, no cloning happens and a warning will be logged.

I don't see it mentioned on the Indexing wiki and I'm thinking, could this be used somehow for multi-pass parsing? It also raises the question on how to get a cloned data stream, if I could somehow send to multiple queues after the typing pipeline, or do I have to adjust _TCP_ROUTING and forward data back to myself (possibly also twiddling my routes or something), or I'm completely off, and this doesn't have to do with parsing.

Does anyone know more about the intended use of this setting and/or have examples of how they've used it?

Lucas_K
Motivator

So did you figure out a full config example on how this was used?

Can you clone to a different index?

0 Karma

woodcock
Esteemed Legend

Let's say that you must clone an index (and possibly modify it somehow, maybe to anonymize it) so that some users have access to one version and others to the modified version. This is how that could be done.

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...