Too many open files

SeaDrive
1

I’m using restic to backup from the drive.

It performs a stat and then open and close on each file, but only about 2 concurrently.

The open operations fail which then fail the backup because SeaDrive reports [02/04/20 09:17:25] file-cache-mgr.c(725): Failed to open file {guid}/file:Too many open files.

What is too many? Can I increase this limit?

I’m using the Linux client so even a parameter in seadrive.conf would help tremendously.

2

The are open file limitations by your operating system.

See https://unix.stackexchange.com/a/8948

3

Thanks but I’m not sure that’s it.

# cat /proc/sys/fs/file-nr
24384 0 3247430

# lsof | wc -l
263697

Appear to be well under the limit.

No other app seems to be hitting a limit, just when backing up from the drive. As far as I can tell, the backup never reads more than 2 files at a time.

I will experiment with the limits though to see if it helps.

4

Thank you @shoeper, after experimenting it was related to the user and not system limit. The solution was in the answer above the one you linked.
See /a/145025

$ vi /etc/security/limits.conf

* soft     nofile         65535
* hard     nofile         65535

The open limitation seems to have been resolved but now I am experiencing occasional input/output errors reading some files once opened. Once the backup completes I’ll try to diagnose if they’re specific files or random access errors.

2 Likes