Knowledge Management

Provided solution : Tip to reduce large CSV lookups / replication issues

splunkreal
Motivator

Find large CSV lookups above 400 mb (500 mb limit) :

| rest splunk_server=* /servicesNS/-/-/data/transforms/lookups getsize=true f=size f=title f=type f=filename f=eai*|fields splunk_server filename title type size eai:appName
|where isnotnull(size)|eval KB = round(size / 1024, 2)|fields - size
| sort - KB
| search KB>400000

 

Use this to reduce CSV lookup (example) :

| inputlookup file.csv
| eval time_epoch = strftime(_time,"%s")
| where time_epoch>relative_time(now(),"-100d@d")
| outputlookup file.csv append=false

 

* If this helps, please upvote or accept solution 🙂 *
Labels (1)
Get Updates on the Splunk Community!

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...