mbc0 Posted November 14, 2016 Share Posted November 14, 2016 As the title suggests I am unable to copy files to my array In this instance I have 11.4TB and 591GB Free, I am trying to copy 100GB to the array but get told I need a further 82GB of free space to complete the operation. Roughly this is reporting the amount of free space available on my cache drive. I have adjusted the share to not use the cache disk to see if that works but I get the same error (incidentally what is the difference between use cache disk yes/prefer?) I have also tried writing to other shares just in case but get the same result. Any suggestions? Quote Link to comment
itimpi Posted November 14, 2016 Share Posted November 14, 2016 As the title suggests I am unable to copy files to my array In this instance I have 11.4TB and 591GB Free, I am trying to copy 100GB to the array but get told I need a further 82GB of free space to complete the operation. Roughly this is reporting the amount of free space available on my cache drive. I have adjusted the share to not use the cache disk to see if that works but I get the same error (incidentally what is the difference between use cache disk yes/prefer?) I have also tried writing to other shares just in case but get the same result. Any suggestions? it would help if you posted your diagnostics (Tools->Diagnostics) so we can give better informed advice. As to the cache settings, the 'Prefer' setting is a new one that can means if there are any files belonging to the share on the array data drives then the next time mover runs they should be moved to the cache drive (if you have one). Once that happens then 'Prefer' and 'Yes' should behave identically. The purpose of this setting is primarily for the case where you have a share (such as 'appdata') that normally resides on the cache but you do not yet have a cache drive. In such a scenario when you later add a cache drive the files for the share will be automatically migrated from the data drives to the cache drive by mover. Quote Link to comment
mbc0 Posted November 14, 2016 Author Share Posted November 14, 2016 Apologies for not attaching the diagnostics file, I have done this now & many thanks for your detailed reply! I have just noticed that I had 24GB free on my cache disk and so I invoked the mover to find that the free space on the cache disk started going down with the log file reporting that the cache disk is full? surely this should be the opposite? Many Thanks unraidserver-diagnostics-20161114-1039.zip Quote Link to comment
gubbgnutten Posted November 14, 2016 Share Posted November 14, 2016 I have just noticed that I had 24GB free on my cache disk and so I invoked the mover to find that the free space on the cache disk started going down with the log file reporting that the cache disk is full? surely this should be the opposite? Your m---a (media) share cache mode is set to "prefer" which means that it moves files from the array to the cache drive if you have one. It is more common to have use cache set to "Yes" for media shares and "Prefer" for appdata shares than the other way around. Quote Link to comment
mbc0 Posted November 14, 2016 Author Share Posted November 14, 2016 Thanks for the reply :-) I had just changed that to see if it would make any difference to my problem before itimpi explained it. I switched it straight back so all my shares are back to "Yes" which is what they were when I first realized my problem. please see my log file and you can see that it seems to be stuck! I have pages & pages of this.... 2009 Round 05 Spain.mkv": No space left on device (28) Nov 14 13:29:10 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:29:10 UNRAIDSERVER move: rsync error: 11 Nov 14 13:29:10 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:29:10 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 08 Great Britain.mkv Nov 14 13:29:21 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 08 Great Britain.mkv": No space left on device (28) Nov 14 13:29:21 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:29:21 UNRAIDSERVER move: rsync error: 11 Nov 14 13:29:22 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:29:22 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 14 Singapore.mkv Nov 14 13:29:32 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 14 Singapore.mkv": No space left on device (28) Nov 14 13:29:32 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:29:32 UNRAIDSERVER move: rsync error: 11 Nov 14 13:29:32 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:29:32 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 16 Brazil.mkv Nov 14 13:29:43 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 16 Brazil.mkv": No space left on device (28) Nov 14 13:29:43 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:29:43 UNRAIDSERVER move: rsync error: 11 Nov 14 13:29:44 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:29:44 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 02 Malaysia.mkv Nov 14 13:29:55 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 02 Malaysia.mkv": No space left on device (28) Nov 14 13:29:55 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:29:55 UNRAIDSERVER move: rsync error: 11 Nov 14 13:29:55 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:29:55 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 09 Germany.mkv Nov 14 13:30:05 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 09 Germany.mkv": No space left on device (28) Nov 14 13:30:05 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:30:05 UNRAIDSERVER move: rsync error: 11 Nov 14 13:30:05 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:30:05 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 10 Hungary.mkv Nov 14 13:30:09 UNRAIDSERVER shfs/user: cache disk full Nov 14 13:30:09 UNRAIDSERVER shfs/user: cache disk full Nov 14 13:30:12 UNRAIDSERVER shfs/user: cache disk full Nov 14 13:30:15 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 10 Hungary.mkv": No space left on device (28) Nov 14 13:30:15 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:30:15 UNRAIDSERVER move: rsync error: 11 Nov 14 13:30:15 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:30:15 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 12 Belgium.mkv Nov 14 13:30:25 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 12 Belgium.mkv": No space left on device (28) Nov 14 13:30:25 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:30:25 UNRAIDSERVER move: rsync error: 11 Nov 14 13:30:25 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:30:25 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 17 Abu Dhabi.avi Nov 14 13:30:41 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/F1 2009 Round 17 Abu Dhabi.avi": No space left on device (28) Nov 14 13:30:41 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:30:41 UNRAIDSERVER move: rsync error: 11 Nov 14 13:30:41 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races/ Nov 14 13:30:41 UNRAIDSERVER shfs/user0: err: shfs_rmdir: rmdir: /mnt/disk2/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races (39) Directory not empty Nov 14 13:30:41 UNRAIDSERVER move: rmdir: /mnt/user0/./media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Races Directory not empty Nov 14 13:30:41 UNRAIDSERVER root: cd+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Review/ Nov 14 13:30:41 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Review/F1 Season Review 2009.avi Nov 14 13:31:09 UNRAIDSERVER shfs/user: cache disk full Nov 14 13:31:09 UNRAIDSERVER shfs/user: cache disk full Nov 14 13:31:11 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Review/F1 Season Review 2009.avi": No space left on device (28) Nov 14 13:31:11 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:31:11 UNRAIDSERVER move: rsync error: 11 Nov 14 13:31:12 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/ Nov 14 13:31:12 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Review/ Nov 14 13:31:12 UNRAIDSERVER shfs/user0: err: shfs_rmdir: rmdir: /mnt/disk2/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Review (39) Directory not empty Nov 14 13:31:12 UNRAIDSERVER move: rmdir: /mnt/user0/./media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009/Review Directory not empty Nov 14 13:31:12 UNRAIDSERVER shfs/user0: err: shfs_rmdir: rmdir: /mnt/disk2/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009 (39) Directory not empty Nov 14 13:31:12 UNRAIDSERVER move: rmdir: /mnt/user0/./media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2009 Directory not empty Nov 14 13:31:12 UNRAIDSERVER root: cd+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/ Nov 14 13:31:12 UNRAIDSERVER root: cd+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/Races/ Nov 14 13:31:12 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/Races/F1 2011 Round 05 Spain.mkv Nov 14 13:31:49 UNRAIDSERVER root: rsync: write failed on "/mnt/cache/media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/Races/F1 2011 Round 05 Spain.mkv": No space left on device (28) Nov 14 13:31:49 UNRAIDSERVER root: rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2] Nov 14 13:31:49 UNRAIDSERVER move: rsync error: 11 Nov 14 13:31:49 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/ Nov 14 13:31:49 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/ Nov 14 13:31:49 UNRAIDSERVER root: .d..t...... media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/Races/ Nov 14 13:31:49 UNRAIDSERVER root: >f+++++++++ media/Sport/Motorsport/Formula 1/Races, Extras & Reviews/2011/Races/F1 2011 Round 06 Monaco.mkv Nov 14 13:32:09 UNRAIDSERVER shfs/user: cache disk full Nov 14 13:32:09 UNRAIDSERVER shfs/user: cache disk full Quote Link to comment
mbc0 Posted November 14, 2016 Author Share Posted November 14, 2016 Is there any way to stop the mover safely as I cannot stop the array whilst it is running and it looks like it will take weeks to finish a process it cannot do? Many Thanks Quote Link to comment
trurl Posted November 14, 2016 Share Posted November 14, 2016 As to the cache settings, the 'Prefer' setting is a new one that can means if there are any files belonging to the share on the array data drives then the next time mover runs they should be moved to the cache drive (if you have one). Once that happens then 'Prefer' and 'Yes' should behave identically. The purpose of this setting is primarily for the case where you have a share (such as 'appdata') that normally resides on the cache but you do not yet have a cache drive. In such a scenario when you later add a cache drive the files for the share will be automatically migrated from the data drives to the cache drive by mover. One small correction: After moving to cache, Prefer behaves like Only, not like Yes. Quote Link to comment
mbc0 Posted November 14, 2016 Author Share Posted November 14, 2016 Thanks for the clarification, do you know how to safely stop the mover? I cannot use my server until the mover is stopped and cannot write any data as there is "no disk space" Cheers Quote Link to comment
mbc0 Posted November 15, 2016 Author Share Posted November 15, 2016 Mover eventually finished! System would not reboot due to tons of BTRFS errors and could not unmount disks, eventually hit the power button! System booted with no Cache Disk? Shut Down disconnected & reconnected my Cache Disk Physically & Rebooted Everything now working as normal except after copying some data to the server and although I still have 17GB the log is reporting Cache Disk Full? I guess something has got corrupt along the way but is there anything I can do to clean things up? Diag attached... Thanks for looking! Nov 15 01:34:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:35:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:35:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:36:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:36:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:36:46 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:37:20 UNRAIDSERVER kernel: mdcmd (53): spindown 1 Nov 15 01:37:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:37:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:37:26 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:37:26 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:38:21 UNRAIDSERVER shfs/user: cache disk full Nov 15 01:38:21 UNRAIDSERVER shfs/user: cache disk full unraidserver-diagnostics-20161115-0143.zip Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.