topic Re: which technology Splunk use? in #Random

which technology Splunk use?

gaikarmayur — Fri, 24 Nov 2017 06:13:52 GMT

Which technology splunk use?

Re: which technology Splunk use?

gcusello — Fri, 24 Nov 2017 08:09:40 GMT

Hi gaikarmayur,
your question is rather vague!
Anyway Splunk is written in Python and doesn't use any DB.
Can use JS, CSS, and is integrable with external environments as DB, LDAP, etc...
What do you want to know?
You can find in Splunk site all useful information https://www.splunk.com/en_us/products/splunk-enterprise.html

Bye.
Giuseppe

Re: which technology Splunk use?

woodcock — Sun, 26 Nov 2017 13:00:51 GMT

What makes you think that Splunk is written in Python?

Re: which technology Splunk use?

esix_splunk — Sun, 26 Nov 2017 21:12:04 GMT

Splunk core is written in c/c++, but there are quite of bit of supporting libraries that are python based...

Re: which technology Splunk use?

woodcock — Sun, 26 Nov 2017 23:52:26 GMT

Yes, I know that the primary dev.splunk.com toolkit is python, too, but that has nothing to do with the core splunk software. That is my whole point.

Re: which technology Splunk use?

niketn — Mon, 27 Nov 2017 05:54:52 GMT

@woodcock, I think @cusello was referring to splunkweb(legacy) that was Python (prior to version 6.2). This used to generate the UI for Splunk Web. From 6.2 onward the same is being handled directly via splunkd in c++.

Splunk 6.1 Documentation ( Splunkweb used Python module CherryPy 😞
https://docs.splunk.com/Documentation/Splunk/6.1.13/Installation/Splunksarchitectureandwhatgetsinstalled

Latest Splunk Documentation ( from 6.2 till date - splunkd handles splunkweb as well using C++ 😞
https://docs.splunk.com/Documentation/Splunk/latest/Installation/Splunksarchitectureandwhatgetsinstalled

In any case the Above link should provide a basic overview and starting point for Splunk Architecture/Technology Stack and Third Party Tools/Libraries used in Splunk.

Re: which technology Splunk use?

gaikarmayur — Tue, 28 Nov 2017 09:04:21 GMT

Thank niket.
but i m more interested to know which algorithm will helps splunk to speedup it's searching faster like google.

Re: which technology Splunk use?

niketn — Tue, 28 Nov 2017 10:14:33 GMT

@gaikarmayur, Splunk has its own propriety way of ingesting the data to indexes (regular, summary or metrics) and then its own Search Processing Language (SPL) commands to fetch and transform data. Like any query language there are tips for writing better searches and search optimization.

The technology underlying remains the same as described in previous comment/s. Some of the Search Commands are written using Python and you can even create your own Custom Search Command using Python as well. While Splunk docs will give you insight to Splunk's Architecture I don't think you would have access to algorithms/code creating the magic. However, I am leaving the question unanswered for Splunk team/Splunk "Gurus" to pitch in.

Re: which technology Splunk use?

nickhills — Tue, 28 Nov 2017 14:19:56 GMT

In an interview.
Me: "So are your familiar with Splunk?"

Him:"Splunk is just grep with a web UI..... right?"
Me: "thanks for your time"

Re: which technology Splunk use?

gaikarmayur — Mon, 27 Aug 2018 06:41:12 GMT

Finally got the answer.
Splunk uses map-reduce technology which is basically key-value pairs terms. This is the main reason behind faster searching of splunk.

Re: which technology Splunk use?

gaikarmayur — Mon, 27 Aug 2018 06:57:58 GMT

Splunk uses map-reduce technology which is basically key-value pairs terms. This is the main reason behind faster searching of data in splunk.