Installation

Enterprise 6.1.3 - Is there a performance impact of installing and running app R Project?

rufusporter23
Engager

Hello Splunkers!

I'm trying to get our admin to install the R Project app. Native R uses memory to perform statistical computations on the data source(s). He is trying to get information on potential impact (CPU, memory, jobs, etc.) on the shared Splunk environment. Any information (even anecdote) is welcome. Thank you.

Rufus

0 Karma
1 Solution

rfujara_splunk
Splunk Employee
Splunk Employee

At the moment, the R Project app (more specifically the "r" search command) doesn't make use of the map/reduce functionality.

But you can use Splunk search commands like search, stats, tstats, etc that does the map/reduct tricks to collect data and then send the data to your R script.

So the script is only executed on the search head in the context of a R sub-process which is spawned every time the search is executed.

That means it's still native R environment which uses memory to perform computations. The app uses temporary files to send the input data from Splunk to R and the results back from R to Splunk. I'm thinking about changing that so that the data is streamed instead of copied in a whole.

View solution in original post

rfujara_splunk
Splunk Employee
Splunk Employee

At the moment, the R Project app (more specifically the "r" search command) doesn't make use of the map/reduce functionality.

But you can use Splunk search commands like search, stats, tstats, etc that does the map/reduct tricks to collect data and then send the data to your R script.

So the script is only executed on the search head in the context of a R sub-process which is spawned every time the search is executed.

That means it's still native R environment which uses memory to perform computations. The app uses temporary files to send the input data from Splunk to R and the results back from R to Splunk. I'm thinking about changing that so that the data is streamed instead of copied in a whole.

rufusporter23
Engager

Thank you for the rapid response. I can't wait to use the app that you created @rfujara_splunk!

Get Updates on the Splunk Community!

Celebrating Fast Lane: 2025 Authorized Learning Partner of the Year

At .conf25, Splunk proudly recognized Fast Lane as the 2025 Authorized Learning Partner of the Year. This ...

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...