All Apps and Add-ons

Splitting up one data source into two indexes in O365

omuelle1
Communicator

Good morning,

I have a question regarding Office 365 data:

  • I have two organizations that share one O365 tenant.
  • Both organizations want to have their own Splunk O365 index and only see their data.
  • I am able to differentiate the data by domains of users.

Is there a way to write a transforms.conf or props.conf with which I could parse the data with certain domains to go to one index and data with certain domains to the other?

Thank you,

Oliver

0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi omuelle1,
yiou have to write a props.conf and transforma.conf on your indexers; if you have an Heavy Forwarders (and you should have it) you have to put these files on the Heavy Forwarders.

On props.conf

 [mysourcetype]
 TRANSFORMS-index = overrideindex

On transforms.conf

 [overrideindex]
 DEST_KEY =_MetaData:Index
 REGEX = my_regex
 FORMAT = my_new_index

where my_regex is the regex that identifies the logs to forward to a different Index.

Bye.
Giuseppe

View solution in original post

gcusello
SplunkTrust
SplunkTrust

Hi omuelle1,
yiou have to write a props.conf and transforma.conf on your indexers; if you have an Heavy Forwarders (and you should have it) you have to put these files on the Heavy Forwarders.

On props.conf

 [mysourcetype]
 TRANSFORMS-index = overrideindex

On transforms.conf

 [overrideindex]
 DEST_KEY =_MetaData:Index
 REGEX = my_regex
 FORMAT = my_new_index

where my_regex is the regex that identifies the logs to forward to a different Index.

Bye.
Giuseppe

omuelle1
Communicator

Thank you I just did that with some test data and it worked. I will need to try it as well once I have the live data.

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi omuelle1,
if you're satisfied by this answer, please accept and/ot upvote it.
We'll see for the next tip.
Bye.
Giuseppe

0 Karma

oscar84x
Contributor

What in the actual events or data tells them apart? What about the file name? Could you provide a data sample and highlight what differentiates them?

Get Updates on the Splunk Community!

Strengthen Your Future: A Look Back at Splunk 10 Innovations and .conf25 Highlights!

The Big One: Splunk 10 is Here!  The moment many of you have been waiting for has arrived! We are thrilled to ...

Now Offering the AI Assistant Usage Dashboard in Cloud Monitoring Console

Today, we’re excited to announce the release of a brand new AI assistant usage dashboard in Cloud Monitoring ...

Stay Connected: Your Guide to October Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...