topic Re: What is LDAP error: Size Limit Exceeded ? in Security

What is LDAP error: Size Limit Exceeded ?

the_wolverine — Sun, 07 Jun 2020 20:09:21 GMT

I'm trying to configure LDAP and am hitting the following error:

ERROR ScopedLDAPConnection - Search for DN 'CN=Users,DC=Domain,DC=Com' gave error: Size limit exceeded

What does this error mean?

Re: What is LDAP error: Size Limit Exceeded ?

the_wolverine — Tue, 20 Apr 2010 02:28:35 GMT

Size Limit Exceeded is an LDAP server error indicating that the search request was unable to return all entries due to a limit. The problem encountered is that the users or groups you are looking for may have been in the 1001+ entries and are not being returned.

In AD, the default size limit is typically 1000 entries. The LDAP server error is usually followed by an error indicating the number of entries returned which is a few entries less than the actual size limit. There is nothing you can do to change this limit unless you are the LDAP server administrator.

In Splunk, you can use filters to reduce the number of LDAP entries returned so that you do not hit this limit.

Re: What is LDAP error: Size Limit Exceeded ?

adamw — Wed, 11 Aug 2010 11:18:13 GMT

There used to be a pageSize setting back in the 3.x days (still lives in some of the docs), but it doesnt exist in 4.x, any chance of this being addeed back in?

Re: What is LDAP error: Size Limit Exceeded ?

lisaac — Wed, 22 Feb 2012 17:12:14 GMT

I received this same error on 4.3 I went into Manager > Authentication Method > Configure Splunk to use LDAP and map groups >

On the CLI, you could just edit /etc/system/local/authentication.conf as follows:
OLD: sizelimit = 1000
New: sizelimit = 10000

Re: What is LDAP error: Size Limit Exceeded ?

viswanathsd — Wed, 19 Aug 2015 02:24:31 GMT

in 6.2.x,Even increased the size limit to 30000 also,got error message as "LDAP server warning:size limit exceeded".
Is there any otherway,can we increase the limit?

Re: What is LDAP error: Size Limit Exceeded ?

andrey2007 — Fri, 25 Sep 2015 08:22:45 GMT

I have the same issue "Warning: LDAP server size limit exceeded" but I can see more than 1000 groups in Splunk(near 1800) and users can Log in.
My LDAP server limit is 5000. I have no Idea where to find solution.
May be this message could be ignore as it is not error but warning.

Re: What is LDAP error: Size Limit Exceeded ?

hrawat — Wed, 09 May 2018 01:07:39 GMT

Splunk 7.2 will have ldap pagination to overcome this limit.

Re: What is LDAP error: Size Limit Exceeded ?

lucassilber — Wed, 05 Jun 2019 14:05:14 GMT

Is ldap pagination available by now? I haven't found anything regarding this topic in the Splunk release notes

Re: What is LDAP error: Size Limit Exceeded ?

hettervik — Mon, 01 Jul 2019 08:01:09 GMT

Bump. Can't find it either.

Re: What is LDAP error: Size Limit Exceeded ?

hrawat — Mon, 01 Jul 2019 22:39:35 GMT

Instead of 7.2, LDAP pagination is supported in 7.3
https://docs.splunk.com/Documentation/Splunk/7.3.0/Admin/Authenticationconf

pagelimit =
* OPTIONAL
* The maximum number of entries to return in each page.
* Enables result sets that exceed the maximum number of entries defined for the
LDAP server.
* If set to -1, ldap pagination is off.
* IMPORTANT: The maximum number of entries a page returns is subject to
the maximum page size limit of the LDAP server. For example: If you set 'pagelimit =
5000' and the server limit is 1000, you cannot receive more than 1000 entries in
a page.
* Default: -1

Splunk 7.3 also supports LDAP Range Retrieval ( in case there are too many users in a group).
enableRangeRetrieval =
* OPTIONAL
* The maximum number of values that can be retrieved from one attribute in a
single LDAP search request is determined by the LDAP server. If the number of
users in a group exceeds the LDAP server limit, enabling this setting fetches all
users by using the "range retrieval" mechanism.
* Enables result sets for a given attribute that exceed the maximum number of
values defined for the LDAP server.
* If set to false, ldap range retrieval is off.
* Default: false

Re: What is LDAP error: Size Limit Exceeded ?

hrawat — Mon, 01 Jul 2019 22:39:47 GMT

Instead of 7.2, LDAP pagination is supported in 7.3
https://docs.splunk.com/Documentation/Splunk/7.3.0/Admin/Authenticationconf

Re: What is LDAP error: Size Limit Exceeded ?

hrawat — Mon, 01 Jul 2019 22:40:35 GMT

I downvoted this post because instead of 7.2, ldap pagination is supported in 7.3
https://docs.splunk.com/documentation/splunk/7.3.0/admin/authenticationconf

pagelimit =
* optional
* the maximum number of entries to return in each page.
* enables result sets that exceed the maximum number of entries defined for the
ldap server.
* if set to -1, ldap pagination is off.
* important: the maximum number of entries a page returns is subject to
the maximum page size limit of the ldap server. for example: if you set 'pagelimit =
5000' and the server limit is 1000, you cannot receive more than 1000 entries in
a page.
* default: -1

Splunk 7.3 also supports ldap range retrieval ( in case there are too many users in a group).
enablerangeretrieval =
* optional
* the maximum number of values that can be retrieved from one attribute in a
single ldap search request is determined by the ldap server. if the number of
users in a group exceeds the ldap server limit, enabling this setting fetches all
users by using the "range retrieval" mechanism.
* enables result sets for a given attribute that exceed the maximum number of
values defined for the ldap server.
* if set to false, ldap range retrieval is off.
* default: false

Re: What is LDAP error: Size Limit Exceeded ?

Gowthamdevaraj — Mon, 16 Mar 2020 18:22:06 GMT

Hello 🙂

So your mean, in 7.2x version of splunk the concept of extending the LDAP limit is not possible?

thanks