Vova Posted May 26, 2017 Share Posted May 26, 2017 Hello. I'm now on trial period, considering to buy unraid. If my unraid setup is uptime for slightly more than 1 day (i currently observe such a pattern), i'm starting to observe weird behavior of my dockers (plex not opening the webUI, transmission the same, transmission not being able to write the file) i'm on the latest version of unraid currently (6.3.4) in /var/log/syslog i see the following: Quote May 26 16:00:58 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:00:58 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15851, flush 1, corrupt 0, gen 0 May 26 16:00:58 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:00:58 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15852, flush 1, corrupt 0, gen 0 May 26 16:00:58 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:00:58 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15853, flush 1, corrupt 0, gen 0 May 26 16:00:58 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:00:58 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15854, flush 1, corrupt 0, gen 0 May 26 16:00:59 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:00:59 Tower shfs/user: err: shfs_write: write: (5) Input/output error May 26 16:01:00 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:01 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:01 Tower shfs/user: err: shfs_write: write: (5) Input/output error May 26 16:01:02 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:02 Tower kernel: blk_update_request: 20 callbacks suppressed May 26 16:01:02 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:02 Tower kernel: btrfs_dev_stat_print_on_error: 20 callbacks suppressed May 26 16:01:02 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15875, flush 1, corrupt 0, gen 0 May 26 16:01:02 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:02 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15876, flush 1, corrupt 0, gen 0 May 26 16:01:02 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:02 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15877, flush 1, corrupt 0, gen 0 May 26 16:01:02 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:02 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15878, flush 1, corrupt 0, gen 0 May 26 16:01:02 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:02 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15879, flush 1, corrupt 0, gen 0 May 26 16:01:02 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:02 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15880, flush 1, corrupt 0, gen 0 May 26 16:01:03 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:03 Tower shfs/user: err: shfs_write: write: (5) Input/output error May 26 16:01:03 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:03 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15881, flush 1, corrupt 0, gen 0 May 26 16:01:03 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:03 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15882, flush 1, corrupt 0, gen 0 May 26 16:01:03 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:03 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15883, flush 1, corrupt 0, gen 0 May 26 16:01:03 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:03 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15884, flush 1, corrupt 0, gen 0 May 26 16:01:04 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:05 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:05 Tower shfs/user: err: shfs_write: write: (5) Input/output error May 26 16:01:06 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:07 Tower kernel: aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 May 26 16:01:07 Tower shfs/user: err: shfs_write: write: (5) Input/output error May 26 16:01:07 Tower kernel: blk_update_request: 20 callbacks suppressed May 26 16:01:07 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:07 Tower kernel: btrfs_dev_stat_print_on_error: 20 callbacks suppressed May 26 16:01:07 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15905, flush 1, corrupt 0, gen 0 May 26 16:01:07 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:07 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15906, flush 1, corrupt 0, gen 0 May 26 16:01:07 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:07 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15907, flush 1, corrupt 0, gen 0 May 26 16:01:07 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:07 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15908, flush 1, corrupt 0, gen 0 May 26 16:01:07 Tower kernel: blk_update_request: I/O error, dev loop0, sector 1029568 May 26 16:01:07 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15909, flush 1, corrupt 0, gen 0 May 26 16:01:07 Tower kernel: blk_update_request: I/O error, dev loop0, sector 3126720 May 26 16:01:07 Tower kernel: BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 15910, flush 1, corrupt 0, gen 0 The Host adapter dead -1 lines i receive each second, even if there is no problem with the unraid. in /mnt/ i see this strange picture: Quote root@Tower:/mnt# ls -la /bin/ls: cannot access 'user': Input/output error /bin/ls: cannot access 'disk1': Input/output error total 0 drwxr-xr-x 6 root root 120 May 25 21:44 ./ drwxr-xr-x 18 root root 400 May 26 10:09 ../ d????????? ? ? ? ? ? disk1/ drwxrwxrwx 3 nobody users 17 May 25 23:06 disk2/ drwxrwxrwx 3 nobody users 60 May 25 23:16 disks/ d????????? ? ? ? ? ? user/ root@Tower:/mnt# What am i doing wrong? attaching full dmesg is full of: Quote [66614.291345] btrfs_dev_stat_print_on_error: 20 callbacks suppressed [66614.291348] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19235, flush 1, corrupt 0, gen 0 [66614.291392] blk_update_request: I/O error, dev loop0, sector 3126720 [66614.291394] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19236, flush 1, corrupt 0, gen 0 [66614.291571] blk_update_request: I/O error, dev loop0, sector 1029568 [66614.291573] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19237, flush 1, corrupt 0, gen 0 [66614.291594] blk_update_request: I/O error, dev loop0, sector 3126720 [66614.291595] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19238, flush 1, corrupt 0, gen 0 [66614.291673] blk_update_request: I/O error, dev loop0, sector 1029568 [66614.291677] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19239, flush 1, corrupt 0, gen 0 [66614.291691] blk_update_request: I/O error, dev loop0, sector 3126720 [66614.291693] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19240, flush 1, corrupt 0, gen 0 [66614.326048] aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 [66615.291837] blk_update_request: I/O error, dev loop0, sector 1029568 [66615.291842] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19241, flush 1, corrupt 0, gen 0 [66615.291861] blk_update_request: I/O error, dev loop0, sector 3126720 [66615.291863] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19242, flush 1, corrupt 0, gen 0 [66615.291968] blk_update_request: I/O error, dev loop0, sector 1029568 [66615.291970] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19243, flush 1, corrupt 0, gen 0 [66615.292228] blk_update_request: I/O error, dev loop0, sector 3126720 [66615.292230] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19244, flush 1, corrupt 0, gen 0 [66615.350036] aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 [66616.310040] aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 [66617.334057] aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 [66618.358064] aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 [66619.294418] blk_update_request: 20 callbacks suppressed [66619.294420] blk_update_request: I/O error, dev loop0, sector 1029568 [66619.294422] btrfs_dev_stat_print_on_error: 20 callbacks suppressed [66619.294425] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19265, flush 1, corrupt 0, gen 0 [66619.294451] blk_update_request: I/O error, dev loop0, sector 3126720 [66619.294453] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19266, flush 1, corrupt 0, gen 0 [66619.294569] blk_update_request: I/O error, dev loop0, sector 1029568 [66619.294572] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19267, flush 1, corrupt 0, gen 0 [66619.294593] blk_update_request: I/O error, dev loop0, sector 3126720 [66619.294595] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19268, flush 1, corrupt 0, gen 0 [66619.294668] blk_update_request: I/O error, dev loop0, sector 1029568 [66619.294670] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19269, flush 1, corrupt 0, gen 0 [66619.294682] blk_update_request: I/O error, dev loop0, sector 3126720 [66619.294684] BTRFS error (device loop0): bdev /dev/loop0 errs: wr 1, rd 19270, flush 1, corrupt 0, gen 0 [66619.318066] aacraid 0000:08:0e.0: AAC0:aac_check_health: Host adapter dead -1 for the system, i'm using HP Microserver G8 with Adaptec 3405. disks are in Volume (JBOD) mode. Please help Quote Link to comment
Squid Posted May 26, 2017 Share Posted May 26, 2017 post the full diagnostics. By itself the loop0 errors simply mean that the docker image is either full or you've managed to corrupt it some how, but taken together with the errors with /mnt/user, it implies that the cache drive also has corruption. Quote Link to comment
Vova Posted May 26, 2017 Author Share Posted May 26, 2017 14 minutes ago, Squid said: post the full diagnostics. Apologize, i didn't know the magic "download diag" button in unraid. attaching. also, it's worth mentioning, i do not have cache neither parity drive now in the setup thanks. tower-diagnostics-20170526-1658.zip Quote Link to comment
Squid Posted May 26, 2017 Share Posted May 26, 2017 May 25 21:42:29 Tower emhttp: shcmd (91): mkdir -p /mnt/disk2 May 25 21:42:29 Tower emhttp: shcmd (92): set -o pipefail ; mount -t btrfs,xfs,reiserfs -o noatime,nodiratime /dev/md2 /mnt/disk2 |& logger May 25 21:42:29 Tower root: mount: wrong fs type, bad option, bad superblock on /dev/md2, May 25 21:42:29 Tower root: missing codepage or helper program, or other error May 25 21:42:29 Tower root: May 25 21:42:29 Tower root: In some cases useful info is found in syslog - try May 25 21:42:29 Tower root: dmesg | tail or so. May 25 21:42:29 Tower emhttp: err: shcmd: shcmd (92): exit status: 32 May 25 21:42:29 Tower emhttp: mount error: No file system (32) Have you already set up disk #2 with files? BTW, whenever you restart unRaid, you should also close any other open browser tabs pointing to it, as you're inundated with wrong_csrf errors Quote Link to comment
Vova Posted May 26, 2017 Author Share Posted May 26, 2017 10 minutes ago, Squid said: Have you already set up disk #2 with files? yes, disk#2 is already with an fs, this was an old error yesterday. i've seen my root error even before i pushed in this new disk. thanks for csrf explanation. now i understand the root cause. Quote Link to comment
Squid Posted May 26, 2017 Share Posted May 26, 2017 In that case then I'm going to leave it up to someone else ( @johnnie.black ?) to help you out, as the HBA dead messages really throws me for a loop here as I've never seen them. Quote Link to comment
JorgeB Posted May 26, 2017 Share Posted May 26, 2017 No experience with those Adaptec controllers, not sure if they are properly supported but don't remember seeing that error before, OP can nuke and redo the docker image and try with the disks connected on Intel onboard ports instead, and see if the problems go away. Quote Link to comment
Vova Posted May 26, 2017 Author Share Posted May 26, 2017 Thanks @johnnie.black i'm now trying other backplane port for this HDD. after that i will try to connect to other controllers. Thanks for fast replies. Quote Link to comment
Vova Posted June 19, 2017 Author Share Posted June 19, 2017 i moved to internal b120i controller and i do not observe the issue any more. thank you. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.