Getting Data In

How do I use/activate the short term bulk loading using the Splunk free version?

yihan
New Member

Hi all, Currently I am using the Splunk Free version. However, i would like to import the splunk bots dataset into the splunk server to . They are 6GB large.

According to splunk free documentation on https://docs.splunk.com/Documentation/Splunk/7.2.6/Admin/MoreaboutSplunkFree,

"Is Splunk Free for you?
Splunk Free is designed for personal, ad hoc search and visualization of IT data. You can use Splunk Free for ongoing indexing of small volumes (<500 MB/day) of data. Additionally, you can use it for short-term bulk-loading and analysis of larger data sets--Splunk Free lets you bulk-load much larger data sets up to 3 times within a 30 day period. This can be useful for forensic review of large data sets."

How do I use/activate the short term bulk loading? I tried to import the dataset via installing a app, but received the error message of maximum size is 500mb.

0 Karma

soskaykakehi
Path Finder

Hi @yihan

How did you input the log file? If you are uploading with Splunk WebUI, it is failing due to HTTP file transfer size limitation. It is not a license limitation.

When importing logs larger than 500MB, split the file so that one file is less than 500MB. Then try uploading from WebUI.

0 Karma

soskaykakehi
Path Finder

Other option is using input monitor or oneshot command.

0 Karma

DavidHourani
Super Champion

Hi @yihan, what do you mean tried importing the dataset via installing an app ? Did you setup a monitor on the required files via inputs.conf or GUI ?

0 Karma

yihan
New Member

The dataset given from splunk for Bots SOC is given as an app to import: https://github.com/splunk/botsv1

0 Karma
Get Updates on the Splunk Community!

SOCin’ it to you at Splunk University

Splunk University is expanding its instructor-led learning portfolio with dedicated Security tracks at .conf25 ...

Credit Card Data Protection & PCI Compliance with Splunk Edge Processor

Organizations handling credit card transactions know that PCI DSS compliance is both critical and complex. The ...

Stay Connected: Your Guide to July Tech Talks, Office Hours, and Webinars!

What are Community Office Hours?Community Office Hours is an interactive 60-minute Zoom series where ...