Files randomly disappear

Tomas_K · March 4, 2021, 9:12am

Hello,
I have connected several SFTP drives (different servers) and all of them suffers from one serious problem. I think it happened previously for other drives types too but I currently use SFTP only.

When files are being edited, they randomly disappear and access to them is lost. The file is not deleted, it still exists on the server, but RaiDrive does not see it so it cannot be accessed by any application. Sometimes whole folder content disappear, but it mostly applies to the single files. Instead, only a file with name “FileName.cpp~RF1284e7.TMP” appears which cannot be accessed.

I need to disconnect and reconnect the drive to return to the correct state. It’s pretty annoying, because it happens very often.

RaiDrive · March 5, 2021, 12:35am

Hi~ @Tomas_K,

We’re trying to reproduce the issue you said. Two pieces of information are required for reproduction. Please send us two pieces of information by e-mail(support@raidrive.com), and we will tell you again after confirmation.

The program used when the issue occurred
All log files in the log folder(C:\ProgramData\OpenBoxLab\RaiDrive\log)

Tomas_K · March 10, 2021, 8:20am

Hello,

I noticed that these TMP files are regulary created by Visual Studio 2019. The question is why the original file disappears and is not accessible again until the drive is remounted. Such behaviour does not appear when accessing files on local drives.

Log files don’t contain anything when this happen. The file is updated for the last time when drive is remounted:

2021-03-10 08:41:27.166 [INFO] CONTROLLER: DriveName : Disconnect Drive Start : Type : SFTP
2021-03-10 08:41:27.166 [INFO] SFTP (DriveName) : Check Change Thread Finished
2021-03-10 08:41:27.166 [INFO] SFTP (DriveName) : Drive Stop
2021-03-10 08:41:27.166 [INFO] SFTP (DriveName) : Drive Stopped
2021-03-10 08:41:27.169 [INFO] FILESYSTEM : DriveName : Delete MountPoint M: Success
2021-03-10 08:41:30.417 [INFO] FILESYSTEM : DriveName : Force Unmount Media Success
2021-03-10 08:41:30.426 [INFO] FILESYSTEM : DriveName : Delete Storage Success
2021-03-10 08:41:30.426 [INFO] FILESYSTEM : DriveName : Unmount Process Done
2021-03-10 08:41:30.558 [INFO] SFTP (DriveName) : Drive Closed
2021-03-10 08:41:30.558 [INFO] CONTROLLER: DriveName : Close Drive : Drive Close Done : Type : SFTP
2021-03-10 08:41:30.560 [INFO] CONTROLLER : DriveName : Disconnect Drive Done : Type : SFTP
2021-03-10 08:41:32.815 [INFO] CONTROLLER: DriveName : User Cache Folder : C:\ProgramData\OpenBoxLab\RaiDrive\Cache\aded816d-da57-4413-924a-93e61e4c2844
2021-03-10 08:41:33.823 [INFO] Lambda Drive Changes Configuration loaded successfully
2021-03-10 08:41:33.823 [INFO] SFTP (DriveName) : Background Folder Refresh : True
2021-03-10 08:41:33.823 [INFO] SFTP (DriveName) : Drive Created
2021-03-10 08:41:33.823 [INFO] CONTROLLER: DriveName : Remote Drive Make Success
2021-03-10 08:41:34.743 [INFO] SFTP API : DriveName : AUTH RESULT : Protocol Version : 3 : ServerType : Unix : BaseInfo : True : Welcome : SSH-2.0-OpenSSH_7.9p1 Raspbian-10+deb10u2
2021-03-10 08:41:35.286 [INFO] SFTP API : DriveName : Data Connection Created
2021-03-10 08:41:35.286 [INFO] CONTROLLER: DriveName : Remote Drive Authentication Success
2021-03-10 08:41:35.287 [INFO] CONTROLLER: DriveName : Create Success
2021-03-10 08:41:35.287 [INFO] FILESYSTEM : DriveName : INIT DONE : DriveLetter : M:, IsNetwork : True, IsGlobal : False, IsReadOnly : False, UseRecyble : True
2021-03-10 08:41:35.287 [INFO] CONTROLLER: DriveName : Init Success
2021-03-10 08:41:35.287 [INFO] FILESYSTEM : DriveName : MOUNT STATE : DriveLetter : M:, IsNetwork : True, IsGlobal : False, IsReadOnly : False, UseMountManager : False
2021-03-10 08:41:35.295 [INFO] FILESYSTEM : DriveName : CreateStorage Success
2021-03-10 08:41:35.299 [INFO] FILESYSTEM : DriveName : Get Volume Label : DriveName
2021-03-10 08:41:35.302 [INFO] FILESYSTEM : DriveName : MountMedia Success
2021-03-10 08:41:35.306 [INFO] FILESYSTEM : DriveName : MountPoint Add M: Success
2021-03-10 08:41:35.306 [INFO] CONTROLLER: DriveName : Mount Success
2021-03-10 08:41:35.306 [INFO] CONTROLLER: DriveName : Drive Connect Success
2021-03-10 08:41:35.873 [INFO] SFTP (DriveName) : Check Change Thread Start

This appears in Process Monitor when such file is tried to be opened in Total Commander (I replaced confidential information with “path”):

9:11:52,9682100 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path SUCCESS Desired Access: Read Data/List Directory, Synchronize, Disposition: Open, Options: Directory, Synchronous IO Non-Alert, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a, OpenResult: Opened
9:11:52,9683147 TOTALCMD64.EXE 10120 QueryDirectory \RaiDrive\path\Calibration.h~RF53a85dd.TMP SUCCESS Filter: Calibration.h~RF53a85dd.TMP, 1: Calibration.h~RF53a85dd.TMP
9:11:52,9685872 TOTALCMD64.EXE 10120 CloseFile \RaiDrive\path SUCCESS
9:11:52,9703737 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path\Calibration.h~RF53a85dd.TMP NAME NOT FOUND Desired Access: Generic Read, Disposition: Open, Options: Synchronous IO Non-Alert, Non-Directory File, Attributes: n/a, ShareMode: Read, Write, AllocationSize: n/a
9:11:52,9708269 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path\Calibration.h~RF53a85dd.TMP NAME NOT FOUND Desired Access: Generic Read, Disposition: Open, Options: Synchronous IO Non-Alert, Non-Directory File, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a
9:11:52,9719448 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path\Calibration.h~RF53a85dd.TMP NAME NOT FOUND Desired Access: Generic Read, Disposition: Open, Options: Synchronous IO Non-Alert, Non-Directory File, Attributes: N, ShareMode: Read, AllocationSize: n/a
9:11:52,9729953 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path\Calibration.h~RF53a85dd.TMP NAME NOT FOUND Desired Access: Generic Read, Disposition: Open, Options: Synchronous IO Non-Alert, Non-Directory File, Attributes: n/a, ShareMode: Read, Write, AllocationSize: n/a
9:11:52,9734310 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path\Calibration.h~RF53a85dd.TMP NAME NOT FOUND Desired Access: Generic Read, Disposition: Open, Options: Synchronous IO Non-Alert, Non-Directory File, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a
9:11:52,9737987 TOTALCMD64.EXE 10120 CreateFile \RaiDrive\path SUCCESS Desired Access: Read Data/List Directory, Synchronize, Disposition: Open, Options: Directory, Synchronous IO Non-Alert, Attributes: n/a, ShareMode: Read, Write, Delete, AllocationSize: n/a, OpenResult: Opened
9:11:52,9738851 TOTALCMD64.EXE 10120 QueryDirectory \RaiDrive\path\Calibration.h~RF53a85dd.TMP SUCCESS Filter: Calibration.h~RF53a85dd.TMP, 1: Calibration.h~RF53a85dd.TMP
9:11:52,9740155 TOTALCMD64.EXE 10120 CloseFile \RaiDrive\path SUCCESS
9:11:55,1279420 TOTALCMD64.EXE 10120 CloseFile \RaiDrive\path SUCCESS

RaiDrive · March 11, 2021, 6:48am

Hi~ @Tomas_K,

Does the issue you mentioned always happen every time you save a file? Or does it happen sometimes?
And when the issue occurred, is there any item indicated as [ERROR] in the log file?
If there is an [ERROR] item, we request that you send the log file(C:\ProgramData\OpenBoxLab\RaiDrive\log) by e-mail(support@raidrive.com) if possible. (Or email the appropriate part of the error)
If possible, could you provide an environment where we can connect and test? (Remote access IP/Port, test account, etc.)

Tomas_K · April 7, 2021, 1:56pm

Hello,
I finally found out in which situation this happens. Everytime the file is opened in preview panel in Visual Studio 2019, edited and saved, the following line appears in services.log file.

2021-04-07 15:47:57.572 [ERROR] SFTPFILE FILE : /home/pi/Thermal/src : AddChild : Error : Exist : Not Same name : /home/pi/Thermal/src/CameraThermalPanel.h : /home/pi/Thermal/src/CameraThermalPanel.h~RF1964cc1.TMP
2021-04-07 15:48:57.724 [ERROR] SFTPFILE FILE : /home/pi/Thermal/src : AddChild : Error : Exist : Not Same name : /home/pi/Thermal/src/CameraMMAL.h : /home/pi/Thermal/src/CameraMMAL.h~RF19737bd.TMP
2021-04-07 15:49:44.220 [ERROR] SFTPFILE FILE : /home/pi/Thermal/src : AddChild : Error : Exist : Not Same name : /home/pi/Thermal/src/ICamera.h : /home/pi/Thermal/src/ICamera.h~RF197ed52.TMP

Unfortunately, I cannot provide access to test environment. But it seems to happen every time when I right click on #include “file.h” line, select “Go To Document” in context menu, edit and save the opened file.

RaiDrive · April 8, 2021, 3:28am

Hi~ @Tomas_K,

We tested it internally according to the method you said, but the issue you mentioned did not occur and it worked normally. Therefore, the entire log file is required to check the status quo.
Please send the log file(C:\ProgramData\OpenBoxLab\RaiDrive\log) by e-mail(support@raidrive.com) and We will tell you again after checking.

RaiDrive · April 13, 2021, 12:04am

Hi~ @Tomas_K ,

We made a Night Build(2020.11.59) that corrected the issue you mentioned. We would appreciate it if you check if the issue is resolved and tell us the result.

Margot_Chiuten · April 27, 2021, 1:44pm

Hi,

I am having the same issue of files disappearing in Windows Explorer but still present on Synology server. Right now it is happening with AutoCAD *.dwg files.

Will the night build solve this as well?

Margot

Tomas_K · April 27, 2021, 3:13pm

Hello,
it seems that the problem does not appear in this night build.
Thank you very much