Failed to index file

Hello,

I’m using self hosted server v7.1.5 on ubuntu and seadrive client v2.0.12 on windows, both fresh install, I’m getting an “Failed to index file …” error everytime i try to upload large file, not sure where is exact limit but generally 500MB+, thing is the file gets uploaded successfully, file intergrity is 100% correct, so in the end everything works, but I just feel bad because of that error message.

Can anyone give me some hints, where to go, what to check, how to fix that ?

seadrive.log looks like this:
[05/05/21 03:28:09] CDC: failed to open C:\seadrive\user/My Libraries/backup/zalohy/zfile.AVI.
[05/05/21 03:28:09] Failed to chunk file with CDC.
[05/05/21 03:28:09] Failed to index file C:\seadrive\user/My Libraries/backup/zalohy/zfile.AVI
[05/05/21 03:28:09] All events are processed for repo ad594476-8be8-4c07-9516-72f3b1227b2d.
[05/05/21 03:28:09] Repo ‘backup’ sync state transition from ‘committing’ to ‘uploading’.
[05/05/21 03:28:09] Upload with HTTP sync protocol version 2.
[05/05/21 03:28:09] Transfer repo ‘ad594476’: (‘normal’, ‘init’) --> (‘normal’, ‘check’)
[05/05/21 03:28:09] Transfer repo ‘ad594476’: (‘normal’, ‘check’) --> (‘normal’, ‘commit’)
[05/05/21 03:28:09] Transfer repo ‘ad594476’: (‘normal’, ‘commit’) --> (‘normal’, ‘fs’)
[05/05/21 03:28:09] Transfer repo ‘ad594476’: (‘normal’, ‘fs’) --> (‘normal’, ‘data’)
[05/05/21 03:28:09] Transfer repo ‘ad594476’: (‘normal’, ‘data’) --> (‘normal’, ‘update-branch’)
[05/05/21 03:28:09] Transfer repo ‘ad594476’: (‘normal’, ‘update-branch’) --> (‘finished’, ‘finished’)
[05/05/21 03:28:09] removing blocks for repo ad594476-8be8-4c07-9516-72f3b1227b2d
[05/05/21 03:28:09] Repo ‘backup’ sync state transition from ‘uploading’ to ‘get sync info’.
[05/05/21 03:28:09] Repo ‘backup’ sync state transition from ‘get sync info’ to ‘synchronized’.
[05/05/21 03:28:11] Repo ‘backup’ sync state transition from ‘synchronized’ to ‘committing’.
[05/05/21 03:28:11] CDC: failed to open C:\seadrive\user/My Libraries/backup/zalohy/zfile.AVI.
[05/05/21 03:28:11] Failed to chunk file with CDC.
[05/05/21 03:28:11] Failed to index file C:\seadrive\user/My Libraries/backup/zalohy/zfile.AVI
[05/05/21 03:28:11] All events are processed for repo ad594476-8be8-4c07-9516-72f3b1227b2d.
[05/05/21 03:28:11] Repo ‘backup’ sync state transition from ‘committing’ to ‘synchronized’.
[05/05/21 03:28:18] Repo ‘backup’ sync state transition from ‘synchronized’ to ‘committing’.
[05/05/21 03:28:25] Creating partial commit after adding zfile.AVI in repo backup(ad594476).

The failure occur two times in log, but only once in synchonization error list.

There is one more failure bit earlier:
[05/05/21 03:27:45] Failed to open file C:\seadrive\user/My Libraries/backup/zalohy: 5
[05/05/21 03:27:45] Bad response code for POST example. com/api/v2.1/copy-move-task/: 400.

Thanks

Edit: I updated server to 8.0.4 and seadrive to 2.0.13, problem still persist

Hi Kazz, welcome to the Seafile Forum!

Does SeaDrive throw this error message only with a few large files or is it a general problem? Please try with different files.

Have you played around with the configuration of Seafile’s file server (https://manual.seafile.com/config/seafile-conf/)?

Hi, problem is not related to particular files, tests shows that any file larger then 300MB allways trigger that error, so its general. I have tested it with three different windows machines using local network and internet.

I have not played with config, its exaclty like it is in documentation (or default) under “Deploy Seafile under Linux”. I’m not using docker, only changes i made were - nginx site config to use SSL and seahub_settings.py to use memcached, both exacly like documentation said.

I’ve checked server logs, there is nothing related.

SeaDrive 2.0.16, started testing Seafile yesterday on Windows 11 Insider Preview. This problem happens very often. File 1.9 GB in size. SeaFile Pro is installed on Ubuntu 20.04 VM and deployed within Docker containers (by a docker-compose from your website). Elasticsearch is turned off.

UPD: here a few records from log file. As you can see the file size is changed so “failed to index” error appears. I don’t really think this kind of error should be displayed to user, the app should re-chunk the file and that’s all.
[08/20/21 11:39:29] File size changed while chunking.
[08/20/21 11:39:29] Failed to chunk file with CDC.
[08/20/21 11:39:29] Failed to index file C:/Users/Mikhail/SeaDrive/Mikhail/My Libraries/My Library/VirtualBox VMs/VagrantTest_default_1629448180080_11253/ubuntu-20.04-amd64-disk001.vmdk

Also I created a separate topic related to this problem — SeaDrive tries to continiously sync this .vmdk file, however it’s wrong because VirtualBox machine drive file (VMDK) should not be synced while using, it will be in inconsistent state. Does SeaDrive check file locking? Or VirtualBox don’t lock .vmdk? I don’t know, but it’s definitely a problem for me.

Hello,

Were you able to solve this problem? I have the same errors with small .pdf files that are not edited but viewed.