Splunk Enterprise

Splunk SDK for Java comparatively fetching result is slower

pchinnasamy
New Member

Comparatively elastic search fetches result faster then splunk.
Is it due to HTTP request call?

Tags (1)
0 Karma
1 Solution

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

View solution in original post

0 Karma

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

0 Karma

pchinnasamy
New Member

Hi,

I am using the same fetching results from splunk doc provided

InputStream resultsNormalSearch = job.getResults();

    ResultsReaderXml resultsReaderNormalSearch;

    System.out.println("Results from the search job fetch logs :\n");
    try {
        resultsReaderNormalSearch = new ResultsReaderXml(resultsNormalSearch);
        HashMap<String, String> event;

        while ((event = resultsReaderNormalSearch.getNextEvent()) != null) {

            LogEntry logEntry = new LogEntry();
            for (String key : event.keySet()) {
                String field = key;
                String value = event.get(key);

                logEntry.put(field, value);
                logs.add(logEntry);
            }
        }

It hits the search query and results is gets loaded to my GUI after every search entry is finished that is too long time taken

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Guided Onboarding with Auto-schema Is Now Generally Available

  We are excited to announce the General Availability of Guided Onboarding with Auto-Schematization ...

ATTENTION: We’re Moving! (AGAIN!)

The Splunk Community Slack is undergoing a system migration to keep our workspace secure and ...

Deep Dive: Optimizing Telemetry Pipelines in Splunk Observability Cloud

In this session, we will peel back the layers of Splunk Observability Cloud’s cost-optimization features. ...