Splunk Enterprise

Splunk SDK for Java comparatively fetching result is slower

pchinnasamy
New Member

Comparatively elastic search fetches result faster then splunk.
Is it due to HTTP request call?

Tags (1)
0 Karma
1 Solution

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

View solution in original post

0 Karma

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

0 Karma

pchinnasamy
New Member

Hi,

I am using the same fetching results from splunk doc provided

InputStream resultsNormalSearch = job.getResults();

    ResultsReaderXml resultsReaderNormalSearch;

    System.out.println("Results from the search job fetch logs :\n");
    try {
        resultsReaderNormalSearch = new ResultsReaderXml(resultsNormalSearch);
        HashMap<String, String> event;

        while ((event = resultsReaderNormalSearch.getNextEvent()) != null) {

            LogEntry logEntry = new LogEntry();
            for (String key : event.keySet()) {
                String field = key;
                String value = event.get(key);

                logEntry.put(field, value);
                logs.add(logEntry);
            }
        }

It hits the search query and results is gets loaded to my GUI after every search entry is finished that is too long time taken

0 Karma
Get Updates on the Splunk Community!

The Payment Operations Wake-Up Call: Why Financial Institutions Can't Afford ...

The same scenario plays out across financial institutions daily. A payment system fails at 11:30 AM on a busy ...

Make Your Case: A Ready-to-Send Letter for Getting Approval to Attend .conf25

Hello Splunkers, Want to attend .conf25 in Boston this year but not sure how to convince your manager? We've ...

Community Spotlight: A Splunk Expert's Journey

In the world of data analytics, some journeys leave a lasting impact not only on the individual but on the ...