Windows 7 VM, crashes and write "Call traces" in log


Recommended Posts

My Windows 7 VM is working for a couple of days and I'm pretty sure it's producing "trace calls" that I get warning of in the log file. And eventually it craches, it can also be a combo of dockers and vm that is making the "Call traces"

 

Here is my template xml:

<domain type='kvm'>
  <name>Windows 7</name>
  <uuid>59c7b021-79d8-c62c-5dbc-9e3687868a88</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Windows 7" icon="windows7.png" os="windows7"/>
  </metadata>
  <memory unit='KiB'>8388608</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>4</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='0'/>
    <vcpupin vcpu='1' cpuset='1'/>
    <vcpupin vcpu='2' cpuset='2'/>
    <vcpupin vcpu='3' cpuset='3'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.7'>hvm</type>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
      <vendor_id state='on' value='none'/>
    </hyperv>
  </features>
  <cpu mode='host-passthrough'>
    <topology sockets='1' cores='2' threads='2'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='hypervclock' present='yes'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/user/domains/Windows 7/vdisk1.img'/>
      <target dev='hdc' bus='virtio'/>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/Windows 7/Microsoft.Windows.7.SP1/Win7_x64_en-US.iso'/>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <boot order='2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/virtio-win-0.1.126-2.iso'/>
      <target dev='hdb' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:87:37:68'/>
      <source bridge='br0'/>
      <model type='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target port='0'/>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='vnc' port='-1' autoport='yes' websocket='-1' listen='0.0.0.0' keymap='en-us'>
      <listen type='address' address='0.0.0.0'/>
    </graphics>
    <video>
      <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1' primary='yes'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </video>
    <memballoon model='virtio'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </memballoon>
  </devices>
</domain>

And here is a "Call trace" example from the log:
 

Jun 14 03:43:00 Tower kernel: Call Trace:
Jun 14 03:43:00 Tower kernel: [<ffffffff813a4a1b>] dump_stack+0x61/0x7e
Jun 14 03:43:00 Tower kernel: [<ffffffff810cb5b1>] warn_alloc+0x102/0x116
Jun 14 03:43:00 Tower kernel: [<ffffffff810cbb67>] __alloc_pages_nodemask+0x541/0xc71
Jun 14 03:43:00 Tower kernel: [<ffffffff810c4d78>] ? __page_cache_alloc+0x89/0x9f
Jun 14 03:43:00 Tower kernel: [<ffffffff810d0c59>] ? __do_page_cache_readahead+0xf1/0x21f
Jun 14 03:43:00 Tower kernel: [<ffffffff81102d82>] alloc_pages_current+0xbe/0xe8
Jun 14 03:43:00 Tower kernel: [<ffffffff810c4d78>] __page_cache_alloc+0x89/0x9f
Jun 14 03:43:00 Tower kernel: [<ffffffff810c6971>] filemap_fault+0x23d/0x458
Jun 14 03:43:00 Tower kernel: [<ffffffff810e8f38>] __do_fault+0x68/0xbb
Jun 14 03:43:00 Tower kernel: [<ffffffff810edf55>] handle_mm_fault+0x6b1/0xf96
Jun 14 03:43:00 Tower kernel: [<ffffffff81042252>] __do_page_fault+0x24a/0x3ed
Jun 14 03:43:00 Tower kernel: [<ffffffff81042438>] do_page_fault+0x22/0x27
Jun 14 03:43:00 Tower kernel: [<ffffffff81680f18>] page_fault+0x28/0x30
Jun 14 03:43:00 Tower kernel: Mem-Info:
Jun 14 03:43:00 Tower kernel: active_anon:3332978 inactive_anon:10492 isolated_anon:0
Jun 14 03:43:00 Tower kernel: active_file:10496241 inactive_file:1911848 isolated_file:896
Jun 14 03:43:00 Tower kernel: unevictable:0 dirty:1908927 writeback:1319 unstable:0
Jun 14 03:43:00 Tower kernel: slab_reclaimable:220704 slab_unreclaimable:46504
Jun 14 03:43:00 Tower kernel: mapped:26087 shmem:109934 pagetables:12406 bounce:0
Jun 14 03:43:00 Tower kernel: free:99844 free_pcp:0 free_cma:0
Jun 14 03:43:00 Tower kernel: Node 0 active_anon:13331912kB inactive_anon:41968kB active_file:41984964kB inactive_file:7647392kB unevictable:0kB isolated(anon):0kB isolated(file):3584kB mapped:104348kB dirty:7635708kB writeback:5276kB shmem:439736kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 11341824kB writeback_tmp:0kB unstable:0kB pages_scanned:192 all_unreclaimable? no
Jun 14 03:43:00 Tower kernel: Node 0 DMA free:15892kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jun 14 03:43:00 Tower kernel: lowmem_reserve[]: 0 1054 63260 63260
Jun 14 03:43:00 Tower kernel: Node 0 DMA32 free:250876kB min:2252kB low:3328kB high:4404kB active_anon:241464kB inactive_anon:4kB active_file:595684kB inactive_file:109396kB unevictable:0kB writepending:109732kB present:1240076kB managed:1230080kB mlocked:0kB slab_reclaimable:29020kB slab_unreclaimable:1244kB kernel_stack:0kB pagetables:36kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jun 14 03:43:00 Tower kernel: lowmem_reserve[]: 0 0 62206 62206
Jun 14 03:43:00 Tower kernel: Node 0 Normal free:132608kB min:132880kB low:196576kB high:260272kB active_anon:13090448kB inactive_anon:41964kB active_file:41389280kB inactive_file:7538220kB unevictable:0kB writepending:7531736kB present:64733184kB managed:63699800kB mlocked:0kB slab_reclaimable:853796kB slab_unreclaimable:184772kB kernel_stack:18388kB pagetables:49588kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jun 14 03:43:00 Tower kernel: lowmem_reserve[]: 0 0 0 0
Jun 14 03:43:00 Tower kernel: Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (U) 3*4096kB (M) = 15892kB
Jun 14 03:43:00 Tower kernel: Node 0 DMA32: 84*4kB (UMEH) 109*8kB (UMEH) 277*16kB (UMEH) 690*32kB (UMEH) 619*64kB (UMEH) 373*128kB (UMEH) 214*256kB (UMEH) 67*512kB (UMEH) 16*1024kB (UME) 9*2048kB (UMH) 3*4096kB (M) = 251272kB
Jun 14 03:43:00 Tower kernel: Node 0 Normal: 1369*4kB (UMEH) 927*8kB (UMEH) 830*16kB (UMEH) 280*32kB (UMEH) 446*64kB (UMEH) 385*128kB (UMEH) 41*256kB (UMEH) 8*512kB (MEH) 2*1024kB (ME) 2*2048kB (MH) 0*4096kB = 133692kB
Jun 14 03:43:00 Tower kernel: 12519170 total pagecache pages
Jun 14 03:43:00 Tower kernel: 0 pages in swap cache
Jun 14 03:43:00 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0
Jun 14 03:43:00 Tower kernel: Free swap  = 0kB
Jun 14 03:43:00 Tower kernel: Total swap = 0kB
Jun 14 03:43:00 Tower kernel: 16497309 pages RAM
Jun 14 03:43:00 Tower kernel: 0 pages HighMem/MovableOnly
Jun 14 03:43:00 Tower kernel: 260866 pages reserved
Jun 14 03:43:02 Tower kernel: Plex DLNA Serve: page allocation stalls for 13710ms, order:0, mode:0x2400840(GFP_NOFS|__GFP_NOFAIL)
Jun 14 03:43:02 Tower kernel: CPU: 4 PID: 4899 Comm: Plex DLNA Serve Not tainted 4.9.30-unRAID #1
Jun 14 03:43:02 Tower kernel: Hardware name: ASUSTeK COMPUTER INC. P10S WS/P10S WS, BIOS 3003 01/12/2017
Jun 14 03:43:02 Tower kernel: ffffc900072d33a0 ffffffff813a4a1b 0000000000000001 0000000000000000
Jun 14 03:43:02 Tower kernel: ffffc900072d3430 ffffffff810cb5b1 02400840810c9d8d ffffffff8193d4e2
Jun 14 03:43:02 Tower kernel: ffffc900072d33c8 0000000000000010 ffffc900072d3440 ffffc900072d33e0

I have attached a diagnostic file.

tower-diagnostics-20170615-0754.zip

Edited by Hogwind
Link to comment
  • Hogwind changed the title to Windows 7 VM, crashes and write "Call traces" in log
  • 2 weeks later...

Here is a new log sample:

Jun 29 07:07:13 Tower kernel: kworker/u16:5: page allocation failure: order:2, mode:0x2084020(GFP_ATOMIC|__GFP_COMP)
Jun 29 07:07:13 Tower kernel: CPU: 0 PID: 31678 Comm: kworker/u16:5 Not tainted 4.9.30-unRAID #1
Jun 29 07:07:13 Tower kernel: Hardware name: ASUSTeK COMPUTER INC. P10S WS/P10S WS, BIOS 3003 01/12/2017
Jun 29 07:07:13 Tower kernel: Workqueue: btrfs-submit btrfs_submit_helper
Jun 29 07:07:13 Tower kernel: ffffc9002721b860 ffffffff813a4a1b 0000000000000000 0000000000000000
Jun 29 07:07:13 Tower kernel: ffffc9002721b8f0 ffffffff810cb5b1 020840206effab80 ffffffff8193d50c
Jun 29 07:07:13 Tower kernel: ffffc9002721b888 ffffc90000000010 ffffc9002721b900 ffffc9002721b8a0
Jun 29 07:07:13 Tower kernel: Call Trace:
Jun 29 07:07:13 Tower kernel: [<ffffffff813a4a1b>] dump_stack+0x61/0x7e
Jun 29 07:07:13 Tower kernel: [<ffffffff810cb5b1>] warn_alloc+0x102/0x116
Jun 29 07:07:13 Tower kernel: [<ffffffff810cc07f>] __alloc_pages_nodemask+0xa59/0xc71
Jun 29 07:07:13 Tower kernel: [<ffffffff8101dd77>] ? __switch_to+0x256/0x3dd
Jun 29 07:07:13 Tower kernel: [<ffffffff8147934f>] ? device_has_rmrr+0x5a/0x63
Jun 29 07:07:13 Tower kernel: [<ffffffff810902f3>] ? round_jiffies_up+0x15/0x17
Jun 29 07:07:13 Tower kernel: [<ffffffff8138a7d8>] ? blk_rq_timeout+0x1b/0x28
Jun 29 07:07:13 Tower kernel: [<ffffffff81102d82>] alloc_pages_current+0xbe/0xe8
Jun 29 07:07:13 Tower kernel: [<ffffffff810e2c1c>] kmalloc_order+0x13/0x41
Jun 29 07:07:13 Tower kernel: [<ffffffff8110b2fd>] __kmalloc+0x2f/0x125
Jun 29 07:07:13 Tower kernel: [<ffffffffa043a58b>] nvme_queue_rq+0xdc/0x6a7 [nvme]
Jun 29 07:07:13 Tower kernel: [<ffffffff8107c0fd>] ? wake_up_bit+0x25/0x25
Jun 29 07:07:13 Tower kernel: [<ffffffff81381dfb>] ? part_round_stats+0x4b/0x52
Jun 29 07:07:13 Tower kernel: [<ffffffff81384ad6>] ? blk_account_io_start+0x1a1/0x1f8
Jun 29 07:07:13 Tower kernel: [<ffffffff8138de2c>] blk_mq_make_request+0x237/0x373
Jun 29 07:07:13 Tower kernel: [<ffffffff8138e101>] ? blk_mq_flush_plug_list+0xa1/0xfa
Jun 29 07:07:13 Tower kernel: [<ffffffff81383ebf>] generic_make_request+0xe4/0x21b
Jun 29 07:07:13 Tower kernel: [<ffffffff813840f2>] submit_bio+0xfc/0x105
Jun 29 07:07:13 Tower kernel: [<ffffffff813840f2>] ? submit_bio+0xfc/0x105
Jun 29 07:07:13 Tower kernel: [<ffffffff81311e1f>] run_scheduled_bios+0x26f/0x40a
Jun 29 07:07:13 Tower kernel: [<ffffffff81311fca>] pending_bios_fn+0x10/0x12
Jun 29 07:07:13 Tower kernel: [<ffffffff81311fca>] ? pending_bios_fn+0x10/0x12
Jun 29 07:07:13 Tower kernel: [<ffffffff8131b0ff>] btrfs_scrubparity_helper+0xc9/0x182
Jun 29 07:07:13 Tower kernel: [<ffffffff8131b271>] btrfs_submit_helper+0x9/0xb
Jun 29 07:07:13 Tower kernel: [<ffffffff8105ed53>] process_one_work+0x192/0x295
Jun 29 07:07:13 Tower kernel: [<ffffffff8105f752>] worker_thread+0x27d/0x369
Jun 29 07:07:13 Tower kernel: [<ffffffff8105f4d5>] ? rescuer_thread+0x2b1/0x2b1
Jun 29 07:07:13 Tower kernel: [<ffffffff81063939>] kthread+0xdb/0xe3
Jun 29 07:07:13 Tower kernel: [<ffffffff8106385e>] ? kthread_park+0x52/0x52
Jun 29 07:07:13 Tower kernel: [<ffffffff8167f785>] ret_from_fork+0x25/0x30
Jun 29 07:07:13 Tower kernel: Mem-Info:
Jun 29 07:07:13 Tower kernel: active_anon:4036561 inactive_anon:10635 isolated_anon:0
Jun 29 07:07:13 Tower kernel: active_file:6948709 inactive_file:4106955 isolated_file:0
Jun 29 07:07:13 Tower kernel: unevictable:0 dirty:4676 writeback:215653 unstable:0
Jun 29 07:07:13 Tower kernel: slab_reclaimable:526553 slab_unreclaimable:103161
Jun 29 07:07:13 Tower kernel: mapped:38426 shmem:124536 pagetables:13548 bounce:0
Jun 29 07:07:13 Tower kernel: free:400038 free_pcp:598 free_cma:0
Jun 29 07:07:13 Tower kernel: Node 0 active_anon:16146244kB inactive_anon:42540kB active_file:27794836kB inactive_file:16427820kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:153704kB dirty:18704kB writeback:862612kB shmem:498144kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 13877248kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Jun 29 07:07:13 Tower kernel: Node 0 DMA free:15892kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jun 29 07:07:13 Tower kernel: lowmem_reserve[]: 0 1054 63260 63260
Jun 29 07:07:13 Tower kernel: Node 0 DMA32 free:249632kB min:2252kB low:3328kB high:4404kB active_anon:911984kB inactive_anon:0kB active_file:34544kB inactive_file:10432kB unevictable:0kB writepending:16kB present:1240076kB managed:1230080kB mlocked:0kB slab_reclaimable:19844kB slab_unreclaimable:1496kB kernel_stack:16kB pagetables:92kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jun 29 07:07:13 Tower kernel: lowmem_reserve[]: 0 0 62206 62206
Jun 29 07:07:13 Tower kernel: Node 0 Normal free:1334952kB min:132880kB low:196576kB high:260272kB active_anon:15234260kB inactive_anon:42540kB active_file:27760292kB inactive_file:16417388kB unevictable:0kB writepending:880816kB present:64733184kB managed:63699800kB mlocked:0kB slab_reclaimable:2086368kB slab_unreclaimable:411148kB kernel_stack:14560kB pagetables:54100kB bounce:0kB free_pcp:2428kB local_pcp:128kB free_cma:0kB
Jun 29 07:07:13 Tower kernel: lowmem_reserve[]: 0 0 0 0
Jun 29 07:07:13 Tower kernel: Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (U) 3*4096kB (M) = 15892kB
Jun 29 07:07:13 Tower kernel: Node 0 DMA32: 756*4kB (UME) 3076*8kB (UME) 2581*16kB (UME) 1433*32kB (UMEH) 635*64kB (UMEH) 196*128kB (UME) 84*256kB (UM) 39*512kB (UMH) 25*1024kB (UMH) 1*2048kB (M) 0*4096kB = 249632kB
Jun 29 07:07:13 Tower kernel: Node 0 Normal: 126437*4kB (UMEH) 103674*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1335140kB
Jun 29 07:07:13 Tower kernel: 11180246 total pagecache pages
Jun 29 07:07:13 Tower kernel: 0 pages in swap cache
Jun 29 07:07:13 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0
Jun 29 07:07:13 Tower kernel: Free swap  = 0kB
Jun 29 07:07:13 Tower kernel: Total swap = 0kB
Jun 29 07:07:13 Tower kernel: 16497309 pages RAM
Jun 29 07:07:13 Tower kernel: 0 pages HighMem/MovableOnly
Jun 29 07:07:13 Tower kernel: 260866 pages reserved

I have no clue what so ever, the only thing I have changed to see if it helps is to install "tips and tweaks" and set:

vm.dirty_background_ratio = 2 %

vm.dirty_ratio = 3 %

 

But it doesn't help, eventually the log will get 100% full and unraid gets unresponsive and needs a reboot.

tower-diagnostics-20170629-0829.zip

Link to comment
  • 2 weeks later...

I'm testing a Windows 10 VM but I still get Call Traces, here is a sample for that:

Jul  8 14:51:58 Tower kernel: kworker/u16:11: page allocation failure: order:2, mode:0x2084020(GFP_ATOMIC|__GFP_COMP)
Jul  8 14:51:58 Tower kernel: CPU: 1 PID: 4435 Comm: kworker/u16:11 Not tainted 4.9.30-unRAID #1
Jul  8 14:51:58 Tower kernel: Hardware name: ASUSTeK COMPUTER INC. P10S WS/P10S WS, BIOS 3003 01/12/2017
Jul  8 14:51:58 Tower kernel: Workqueue: btrfs-submit btrfs_submit_helper
Jul  8 14:51:58 Tower kernel: ffffc90025ad3860 ffffffff813a4a1b 0000000000000000 0000000000000000
Jul  8 14:51:58 Tower kernel: ffffc90025ad38f0 ffffffff810cb5b1 020840206effab80 ffffffff8193d50c
Jul  8 14:51:58 Tower kernel: ffffc90025ad3888 ffffc90000000010 ffffc90025ad3900 ffffc90025ad38a0
Jul  8 14:51:58 Tower kernel: Call Trace:
Jul  8 14:51:58 Tower kernel: [<ffffffff813a4a1b>] dump_stack+0x61/0x7e
Jul  8 14:51:58 Tower kernel: [<ffffffff810cb5b1>] warn_alloc+0x102/0x116
Jul  8 14:51:58 Tower kernel: [<ffffffff810cc07f>] __alloc_pages_nodemask+0xa59/0xc71
Jul  8 14:51:58 Tower kernel: [<ffffffff8101dd77>] ? __switch_to+0x256/0x3dd
Jul  8 14:51:58 Tower kernel: [<ffffffff8147934f>] ? device_has_rmrr+0x5a/0x63
Jul  8 14:51:58 Tower kernel: [<ffffffff8147934f>] ? device_has_rmrr+0x5a/0x63
Jul  8 14:51:58 Tower kernel: [<ffffffff81102d82>] alloc_pages_current+0xbe/0xe8
Jul  8 14:51:58 Tower kernel: [<ffffffff810e2c1c>] kmalloc_order+0x13/0x41
Jul  8 14:51:58 Tower kernel: [<ffffffff8110b2fd>] __kmalloc+0x2f/0x125
Jul  8 14:51:58 Tower kernel: [<ffffffffa04cd58b>] nvme_queue_rq+0xdc/0x6a7 [nvme]
Jul  8 14:51:58 Tower kernel: [<ffffffff8107c0fd>] ? wake_up_bit+0x25/0x25
Jul  8 14:51:58 Tower kernel: [<ffffffff81381dfb>] ? part_round_stats+0x4b/0x52
Jul  8 14:51:58 Tower kernel: [<ffffffff81384ad6>] ? blk_account_io_start+0x1a1/0x1f8
Jul  8 14:51:58 Tower kernel: [<ffffffff8138de2c>] blk_mq_make_request+0x237/0x373
Jul  8 14:51:58 Tower kernel: [<ffffffff8138e101>] ? blk_mq_flush_plug_list+0xa1/0xfa
Jul  8 14:51:58 Tower kernel: [<ffffffff81383ebf>] generic_make_request+0xe4/0x21b
Jul  8 14:51:58 Tower kernel: [<ffffffff813840f2>] submit_bio+0xfc/0x105
Jul  8 14:51:58 Tower kernel: [<ffffffff813840f2>] ? submit_bio+0xfc/0x105
Jul  8 14:51:58 Tower kernel: [<ffffffff81311e1f>] run_scheduled_bios+0x26f/0x40a
Jul  8 14:51:58 Tower kernel: [<ffffffff81311fca>] pending_bios_fn+0x10/0x12
Jul  8 14:51:58 Tower kernel: [<ffffffff81311fca>] ? pending_bios_fn+0x10/0x12
Jul  8 14:51:58 Tower kernel: [<ffffffff8131b0ff>] btrfs_scrubparity_helper+0xc9/0x182
Jul  8 14:51:58 Tower kernel: [<ffffffff8131b271>] btrfs_submit_helper+0x9/0xb
Jul  8 14:51:58 Tower kernel: [<ffffffff8105ed53>] process_one_work+0x192/0x295
Jul  8 14:51:58 Tower kernel: [<ffffffff8105f752>] worker_thread+0x27d/0x369
Jul  8 14:51:58 Tower kernel: [<ffffffff8105f4d5>] ? rescuer_thread+0x2b1/0x2b1
Jul  8 14:51:58 Tower kernel: [<ffffffff81063939>] kthread+0xdb/0xe3
Jul  8 14:51:58 Tower kernel: [<ffffffff8106385e>] ? kthread_park+0x52/0x52
Jul  8 14:51:58 Tower kernel: [<ffffffff8167f785>] ret_from_fork+0x25/0x30
Jul  8 14:51:58 Tower kernel: Mem-Info:
Jul  8 14:51:58 Tower kernel: active_anon:3650371 inactive_anon:9752 isolated_anon:0
Jul  8 14:51:58 Tower kernel: active_file:9025017 inactive_file:2527045 isolated_file:0
Jul  8 14:51:58 Tower kernel: unevictable:0 dirty:1587 writeback:225595 unstable:0
Jul  8 14:51:58 Tower kernel: slab_reclaimable:502608 slab_unreclaimable:90112
Jul  8 14:51:58 Tower kernel: mapped:37472 shmem:135063 pagetables:13067 bounce:0
Jul  8 14:51:58 Tower kernel: free:324223 free_pcp:1049 free_cma:0
Jul  8 14:51:58 Tower kernel: Node 0 active_anon:14601484kB inactive_anon:39008kB active_file:36100068kB inactive_file:10108180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:149888kB dirty:6348kB writeback:902380kB shmem:540252kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 12136448kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Jul  8 14:51:58 Tower kernel: Node 0 DMA free:15892kB min:32kB low:44kB high:56kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15892kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jul  8 14:51:58 Tower kernel: lowmem_reserve[]: 0 1054 63260 63260
Jul  8 14:51:58 Tower kernel: Node 0 DMA32 free:249640kB min:2252kB low:3328kB high:4404kB active_anon:695860kB inactive_anon:0kB active_file:252748kB inactive_file:2740kB unevictable:0kB writepending:352kB present:1240076kB managed:1230080kB mlocked:0kB slab_reclaimable:23728kB slab_unreclaimable:1128kB kernel_stack:0kB pagetables:104kB bounce:0kB free_pcp:2088kB local_pcp:568kB free_cma:0kB
Jul  8 14:51:58 Tower kernel: lowmem_reserve[]: 0 0 62206 62206
Jul  8 14:51:58 Tower kernel: Node 0 Normal free:1031360kB min:132880kB low:196576kB high:260272kB active_anon:13905624kB inactive_anon:39008kB active_file:35847320kB inactive_file:10105056kB unevictable:0kB writepending:908860kB present:64733184kB managed:63699800kB mlocked:0kB slab_reclaimable:1986704kB slab_unreclaimable:359320kB kernel_stack:15680kB pagetables:52164kB bounce:0kB free_pcp:2048kB local_pcp:144kB free_cma:0kB
Jul  8 14:51:58 Tower kernel: lowmem_reserve[]: 0 0 0 0
Jul  8 14:51:58 Tower kernel: Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (U) 3*4096kB (M) = 15892kB
Jul  8 14:51:58 Tower kernel: Node 0 DMA32: 1519*4kB (UMEH) 2670*8kB (UMEH) 2734*16kB (UMEH) 1637*32kB (UME) 904*64kB (UMEH) 246*128kB (UM) 53*256kB (UMH) 15*512kB (UM) 13*1024kB (UMH) 1*2048kB (H) 0*4096kB = 249516kB
Jul  8 14:51:58 Tower kernel: Node 0 Normal: 139218*4kB (UME) 59339*8kB (UMEH) 1*16kB (M) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1031600kB
Jul  8 14:51:58 Tower kernel: 11687194 total pagecache pages
Jul  8 14:51:58 Tower kernel: 0 pages in swap cache
Jul  8 14:51:58 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0
Jul  8 14:51:58 Tower kernel: Free swap  = 0kB
Jul  8 14:51:58 Tower kernel: Total swap = 0kB
Jul  8 14:51:58 Tower kernel: 16497309 pages RAM
Jul  8 14:51:58 Tower kernel: 0 pages HighMem/MovableOnly
Jul  8 14:51:58 Tower kernel: 260866 pages reserved

I would really appreciate some help with this, I can't have a server I need to restart every week. :(

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.