Splunk App for Enterprise Security: Where to change the setting for lookup table maximum allowable value?

[grambo271]

Greetings... I'm still very junior to the world of Splunk so I thought I'd reach out to the community for a little direction. We are running the Enterprise Security Suite 3x version on Splunk 6.1.3. I have noticed the following messsage is generated daily:

"msg="A lookup table used in a CIDR or WILDCARD definition exceeds the maximum allowable value" file="asn_by_cidr.csv" size="14690788" limit="10000000"

I have tried (with little success) to find out where this size limit is defined. Has anyone else seen this error and if so, could you suggest where to change this setting?

Thanks in advance

[Nicolo_Figiani · Accepted solution]

Hi,
I had the same problem (on ES 3.1 and Splunk 6.1.3). I solved the issue by editing the following configuration file:

/opt/splunk/etc/system/local/limits.conf

In particular, I've added the following snippet of configuration:

[lookup]
max_memtable_bytes = 100000000

The increase of "max_memtable_bytes" will make the error message to stop appearing and will make Splunk working without trouble.

Regards.

[grambo271]

Thank you both. The addition of the [lookup] stanza seems to have fixed the issue.

Appreciate your assistance!!

[rfaircloth_splu]

Notes this must be system local you can't include this setting in an app

[DerekKing]

I think you'll find all global default limits, in the /etc/system/defaults/limits.conf file.

Take a copy of it into the local directory, and then make your changes.

Regards
Derek