Request Too Large:File Handles Exceeded

Forum|Forum|7 years ago
June 19, 2019
7 replies
3 views

+1

vcarusi
Participating Frequently

Hi,
I have the following error:

java.sql.SQLTransientException: [Vertica]VJDBC ERROR: Insufficient resources to execute plan on pool my_pool [Request Too Large:File Handles Exceeded: Requested = 28490, Free = 27496 (Limit = 27496, Used = 0)]
at com.vertica.util.ServerErrorData.buildException(Unknown Source)

I obtain this error when I execute
select max(col_1), max(col_2) ....., max(col_1287) from

decreasing the number of columns , the value of 'Requested (File Handles)' decreases, also

What should be done in order to increase the 'Limit = 27496' ?

ulimit -n
65536

/etc/security/limits.conf

- as unlimited
hard nofile 65536
soft nofile 65536
dbadmin - nice 0
dbadmin - nofile 65536

Thank you,
Veronica

+1

vcarusi
Author
Participating Frequently
Forum|Forum|7 years ago
June 19, 2019

Here is an interesting description
https://forum.vertica.com/discussion/234883/file-handle-count-calculation

Like

skeswani
Participating Frequently
Forum|Forum|7 years ago
June 20, 2019

for dbadmin run the following command. It will show how many file descriptors are available

ulimit -a

They can be increased in /etc/security/limits.conf as you have shown above.

note, the increase requires either a reboot or a relogin by the dbadmin user.

ulimit -a will tell you how many FDs are available

Like

+1

vcarusi
Author
Participating Frequently
Forum|Forum|7 years ago
June 21, 2019

Yes, it worked.

https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/InstallationGuide/BeforeYouInstall/openfilelimits.htm
The open file limit should be at least 1 file open per MB of RAM, 65536, or the amount of RAM in MB.

In my case, I use a virtual machine and I could increase the amount of RAM, from 60 GB to 122 GB.
I modified /etc/security/limits.conf, changing
hard nofile 65536 -> 122000
soft nofile 65536 -> 122000
dbadmin - nofile 65536 -> 122000
restarted the machine

My conclusion is: there is a connection between number of ROS containers, number of columns and the amount of RAM. More columns I need to select, more RAM I need.