which technology Splunk use?

[gaikarmayur]

Which technology splunk use?

[gaikarmayur]

Splunk uses map-reduce technology which is basically key-value pairs terms. This is the main reason behind faster searching of data in splunk.

[gcusello]

Hi gaikarmayur,
your question is rather vague!
Anyway Splunk is written in Python and doesn't use any DB.
Can use JS, CSS, and is integrable with external environments as DB, LDAP, etc...
What do you want to know?
You can find in Splunk site all useful information https://www.splunk.com/en_us/products/splunk-enterprise.html

Bye.
Giuseppe

[woodcock]

What makes you think that Splunk is written in Python?

[gaikarmayur]

Finally got the answer.
Splunk uses map-reduce technology which is basically key-value pairs terms. This is the main reason behind faster searching of splunk.

[niketn]

@woodcock, I think @cusello was referring to splunkweb(legacy) that was Python (prior to version 6.2). This used to generate the UI for Splunk Web. From 6.2 onward the same is being handled directly via splunkd in c++.

Splunk 6.1 Documentation ( Splunkweb used Python module CherryPy 😞
https://docs.splunk.com/Documentation/Splunk/6.1.13/Installation/Splunksarchitectureandwhatgetsinsta...

Latest Splunk Documentation ( from 6.2 till date - splunkd handles splunkweb as well using C++ 😞
https://docs.splunk.com/Documentation/Splunk/latest/Installation/Splunksarchitectureandwhatgetsinsta...

In any case the Above link should provide a basic overview and starting point for Splunk Architecture/Technology Stack and Third Party Tools/Libraries used in Splunk.

[gaikarmayur]

Thank niket.
but i m more interested to know which algorithm will helps splunk to speedup it's searching faster like google.

[niketn]

@gaikarmayur, Splunk has its own propriety way of ingesting the data to indexes (regular, summary or metrics) and then its own Search Processing Language (SPL) commands to fetch and transform data. Like any query language there are tips for writing better searches and search optimization.

The technology underlying remains the same as described in previous comment/s. Some of the Search Commands are written using Python and you can even create your own Custom Search Command using Python as well. While Splunk docs will give you insight to Splunk's Architecture I don't think you would have access to algorithms/code creating the magic. However, I am leaving the question unanswered for Splunk team/Splunk "Gurus" to pitch in.

[nickhills]

In an interview.
Me: "So are your familiar with Splunk?"

Him:"Splunk is just grep with a web UI..... right?"
Me: "thanks for your time"

[esix_splunk]

Splunk core is written in c/c++, but there are quite of bit of supporting libraries that are python based...

[woodcock]

Yes, I know that the primary dev.splunk.com toolkit is python, too, but that has nothing to do with the core splunk software. That is my whole point.