topic Re: Upload and index a file : server abort in Deployment Architecture

Upload and index a file : server abort

madmoravian — Tue, 07 Feb 2012 16:10:03 GMT

As a brand new user, I'm attempting to add several log files as input to my installation of splunk. These are server log files of about 3GB+. Whenever I attempt to "Upload and index a file" I get a "Your entry was not saved. The following error was reported: server abort." message.

I have managed to upload some access logs, but it generally takes me multiple tries to do so. The access log files are about 85MB in size.

Any thoughts? We are using 4.3

Re: Upload and index a file : server abort

Brian_Osburn — Tue, 07 Feb 2012 19:14:13 GMT

Have you tried pointing Splunk @ the directory instead of at the file itself?

Brian

Re: Upload and index a file : server abort

madmoravian — Tue, 07 Feb 2012 20:23:38 GMT

Not yet, as the file is not on the splunk server. I might move it over there and see what happens. Thanks for the suggestion.

Re: Upload and index a file : server abort

Brian_Osburn — Wed, 08 Feb 2012 01:56:06 GMT

Let me know if this works, and we'll convert this to an answer..

Re: Upload and index a file : server abort

madmoravian — Wed, 08 Feb 2012 13:54:29 GMT

Yes. moving the file to the Splunk server allowed it to successfully save and process the log file.

Re: Upload and index a file : server abort

Brian_Osburn — Wed, 08 Feb 2012 14:02:28 GMT

Try setting Splunk to read the directory, and not the file itself. My guess is it's trying to load the whole thing into memory or something.

Brian

Re: Upload and index a file : server abort

amiracle — Mon, 18 Mar 2013 23:59:56 GMT

If that does not work, try splinting the file into smaller chunks and see if your server can index the files then. On *NIX use the split command:

split -b 1000k largefile.big smallerfiles

You can also split it by lines if you know how many lines make up an event:

split -l 1000 largefile.big smallerfiles

This will then create the 'smallerfiles' with the suffix aa-zz.

Re: Upload and index a file : server abort

apjhadoop — Fri, 24 Jan 2014 20:39:47 GMT

@madmoravian:
"moving the file to the Splunk server allowed it to successfully save and process the log file."

Moving it to which directory path on the Splunk server? Thanks.

Re: Upload and index a file : server abort

himynamesdave — Tue, 25 Mar 2014 12:46:52 GMT

+1 to this.