Closed
Description
(This might be the same as #9897, but since the stack seemed entirely different, I figured I'd file it separately.)
System information
| Type | Version/Name |
|---|---|
| Distribution Name | Debian |
| Distribution Version | buster |
| Linux Kernel | 4.19.0-14-amd64 |
| Architecture | x86_64 |
| ZFS Version | 0.8.6-1~bpo10+1 |
Describe the problem you're observing
While using my headless server with a couple of "long-running" (a day or so) kvm VMs, I got an exciting PANIC in my console, not obviously related to anything I was doing at the moment.
Describe how to reproduce the problem
???
Include any warning/errors/backtraces from the system logs
[5740457.383840] VERIFY(HDR_EMPTY(hdr)) failed
[5740457.383880] PANIC at arc.c:6787:arc_release()
[5740457.383912] Showing stack for process 101406
[5740457.383916] CPU: 14 PID: 101406 Comm: kvm Kdump: loaded Tainted: P OE 4.19.0-14-amd64 #1 Debian 4.19.171-2
[5740457.383917] Hardware name: Supermicro Super Server/X10SDV-TLN4F, BIOS 2.1 11/22/2019
[5740457.383918] Call Trace:
[5740457.383940] dump_stack+0x66/0x81
[5740457.383957] spl_panic+0xd3/0xfb [spl]
[5740457.383961] ? _cond_resched+0x15/0x30
[5740457.384045] ? cityhash4+0x75/0x90 [zfs]
[5740457.384048] ? _cond_resched+0x15/0x30
[5740457.384050] ? mutex_lock+0xe/0x30
[5740457.384136] ? __raw_spin_unlock+0x5/0x10 [zfs]
[5740457.384240] ? multilist_is_empty+0x83/0x150 [zfs]
[5740457.384345] ? zfs_refcount_remove_many+0x118/0x1d0 [zfs]
[5740457.384348] ? _cond_resched+0x15/0x30
[5740457.384437] ? cityhash4+0x75/0x90 [zfs]
[5740457.384440] ? _cond_resched+0x15/0x30
[5740457.384442] ? mutex_lock+0xe/0x30
[5740457.384550] ? __raw_spin_unlock+0x5/0x10 [zfs]
[5740457.384657] ? list_head+0x9/0x20 [zfs]
[5740457.384660] ? _cond_resched+0x15/0x30
[5740457.384662] ? mutex_lock+0xe/0x30
[5740457.384784] ? __raw_spin_unlock+0x5/0x10 [zfs]
[5740457.384793] ? cv_destroy_wakeup+0x34/0x90 [spl]
[5740457.384802] ? waitqueue_active+0x9/0x20 [spl]
[5740457.384811] ? __cv_destroy+0xb0/0x230 [spl]
[5740457.384821] ? spl_kmem_cache_free+0x11c/0x1c0 [spl]
[5740457.384907] arc_release+0xb09/0xce0 [zfs]
[5740457.384997] dbuf_redirty+0x3b/0xc0 [zfs]
[5740457.385086] dmu_buf_will_dirty_impl+0xa9/0x1e0 [zfs]
[5740457.385177] dmu_write_uio_dnode+0x6b/0x1d0 [zfs]
[5740457.385268] dmu_write_uio_dbuf+0x47/0x60 [zfs]
[5740457.385381] zfs_write+0x9fe/0xe80 [zfs]
[5740457.385387] ? __switch_to_asm+0x35/0x70
[5740457.385496] zpl_write_common_iovec+0xac/0x110 [zfs]
[5740457.385606] zpl_iter_write_common+0x7f/0xa0 [zfs]
[5740457.385715] zpl_iter_write+0x4a/0x70 [zfs]
[5740457.385720] do_iter_readv_writev+0x13a/0x1b0
[5740457.385724] do_iter_write+0x80/0x190
[5740457.385727] vfs_writev+0xa7/0x100
[5740457.385733] ? syscall_trace_enter+0x29a/0x2b0
[5740457.385736] do_pwritev+0x89/0xe0
[5740457.385739] do_syscall_64+0x53/0x110
[5740457.385742] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[5740457.385745] RIP: 0033:0x7fe4b18fd69a
[5740457.385748] Code: 89 d4 55 48 89 f5 53 89 fb 48 83 ec 18 e8 ce 60 01 00 45 31 c0 4d 89 ea 44 89 e2 41 89 c1 48 89 ee 89 df b8 28 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 32 44 89 cf 48 89 44 24 08 e8 01 61 01 00 48
[5740457.385749] RSP: 002b:00007fe4acdfe620 EFLAGS: 00000246 ORIG_RAX: 0000000000000128
[5740457.385752] RAX: ffffffffffffffda RBX: 000000000000000d RCX: 00007fe4b18fd69a
[5740457.385754] RDX: 0000000000000005 RSI: 00007fe3a010cf80 RDI: 000000000000000d
[5740457.385755] RBP: 00007fe3a010cf80 R08: 0000000000000000 R09: 0000000000000000
[5740457.385756] R10: 00000002ef06c000 R11: 0000000000000246 R12: 0000000000000005
[5740457.385757] R13: 00000002ef06c000 R14: 00007fe3a002f0f0 R15: 0000555c1a1a1820