(v24) Configure the Maximum Number of Open Processes and Files

Configure the Maximum Number of Open Processes and Files

Configuring the maximum number of open processes and open files that can run in your operating environment keeps Composer processes from hitting or exceeding the resource limits that may be imposed by your operating system.

Instructions are provided here for the following operating environments:

CentOS Instructions

If you are installing via RPM using CentOS or Red Hat, the recommended settings differ slightly. Because systemd is responsible for starting the various Composer microservices, you need to amend the files and microservices that are launched so the limits.conf file is not ignored.

Composer recommends that you create an override directory specifically for the microservices you want to override.

1. Create a new systemd directory:

   mkdir /etc/systemd/system/<servicename>.service.d/

   Replace <servicename> with the microservice you need to override.

2. The file name for the microservice you want to override needs to be in .conf, so use the following command:

   touch /etc/systemd/system/<servicename>.service.d/<servicename>.conf

For more information about managing microservices for Red Hat, see the Red Hat documentation.

If Composer stops operating and you receive the error message too many files, cannot operate, you may need to increase the system limits in your CentOS or Ubuntu 18, 20, or 22 environments. Make the following changes:

1. In the service.d folder for each microservice, open the limits.conf file. If the configuration file does not exist, this command creates it.

   vi /etc/systemd/system/<servicename>.service.d/limits.conf

2. Add the following to the file:

   [Service]
   LimitNOFILE=10000

3. Restart the init service:

   systemctl daemon-reload

4. Restart the zoomdata microservice:

   systemctl restart zoomdata.service

5. Verify your changes were applied:

   ps -ef | grep zoomdata-web | grep -v grep | awk '{system("cat /proc/"$2"/limits")}' | grep -i "Max open files"

6. In the output, you should see the following, indicating that your changes were applied:

   Max open files 10000 10000 files

Return to the installation topic you are using to continue the installation process:

• Install Composer
• Install Composer Manually