[28494.605874] nfsd: last server has exited, flushing export cache
[28494.752038] NFSD: Using nfsdcld client tracking operations.
[28494.752462] NFSD: starting 90-second grace period (net f0000098)
[28550.237900] NFSD: all clients done reclaiming, ending NFSv4 grace period (net f0000098)
[29062.881971] rpc-srv/tcp: nfsd: got error -11 when sending 65664 bytes - shutting down socket
[30293.066082] lockd: couldn't shutdown host module for net f0000098!
[30327.451815] BUG: workqueue lockup - pool cpus=4 node=0 flags=0x0 nice=0 stuck for 34s!
[30327.452367] Showing busy workqueues and worker pools:
[30327.452735] workqueue events: flags=0x0
[30327.453013] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30327.453473] pending: kfree_rcu_monitor
[30327.453841] workqueue mm_percpu_wq: flags=0x8
[30327.454188] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30327.454638] pending: vmstat_update
[30327.454939] workqueue kblockd: flags=0x18
[30327.455200] pwq 9: cpus=4 node=0 flags=0x0 nice=-20 active=1/256 refcnt=2
[30327.455636] pending: blk_mq_run_work_fn
[30353.070356] rcu: INFO: rcu_sched self-detected stall on CPU
[30353.070754] rcu: 4-....: (59999 ticks this GP) idle=dd7/1/0x4000000000000000 softirq=1487839/1487839 fqs=14979 last_accelerate: adac/9814 dyntick_enabled: 1
[30353.071634] (t=60001 jiffies g=7822577 q=36089)
[30353.071940] NMI backtrace for cpu 4
[30353.072175] CPU: 4 PID: 48380 Comm: lockd Tainted: G O 5.15.0-rc3.unstable #4 c74cb40e1c7cfbb76f5f8fab27d10002f7624b68
[30353.072905] Hardware name: Gigabyte Technology Co., Ltd. TRX40 DESIGNARE/TRX40 DESIGNARE, BIOS F4c 03/05/2020
[30353.073513] Call Trace:
[30353.073681]
[30353.073834] dump_stack_lvl+0x45/0x63
[30353.074081] dump_stack+0x10/0x12
[30353.074326] nmi_cpu_backtrace.cold+0x32/0x81
[30353.074623] ? lapic_can_unplug_cpu+0x80/0x80
[30353.074929] nmi_trigger_cpumask_backtrace+0x85/0xc0
[30353.075247] arch_trigger_cpumask_backtrace+0x19/0x40
[30353.075567] rcu_dump_cpu_stacks+0xcb/0xfd
[30353.075854] rcu_sched_clock_irq.cold+0xe8/0x220
[30353.076155] ? account_system_index_time+0x99/0xc0
[30353.076483] update_process_times+0x94/0x100
[30353.076769] tick_sched_handle+0x29/0x80
[30353.077028] tick_sched_timer+0x6b/0x80
[30353.077304] ? tick_sched_handle+0x80/0x80
[30353.077572] __hrtimer_run_queues+0x129/0x280
[30353.077850] hrtimer_interrupt+0x101/0x240
[30353.078138] __sysvec_apic_timer_interrupt+0x56/0x100
[30353.078482] sysvec_apic_timer_interrupt+0x77/0xc0
[30353.078792]
[30353.078943] asm_sysvec_apic_timer_interrupt+0x12/0x20
[30353.079264] RIP: 0010:_raw_spin_lock+0x7/0x40
[30353.079554] Code: 82 5b ff 5d c3 66 66 2e 0f 1f 84 00 00 00 00 00 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 31 c0 01 00 00 00 f0 0f b1 17 75 01 c3 55 89 c6 48 89 e5 e8 22 7f 5b
[30353.080681] RSP: 0018:ffffc90006557e28 EFLAGS: 00000246
[30353.081033] RAX: 0000000000000000 RBX: ffff88816e5cd130 RCX: 0000000000000000
[30353.081484] RDX: ffff8889208d7400 RSI: 0000000000000000 RDI: ffff88816e5cd118
[30353.081950] RBP: ffffc90006557e80 R08: ffff88a018b278c0 R09: 7fffffffffffffff
[30353.082421] R10: 0000000008118c00 R11: 000000000010e778 R12: 0000000000000000
[30353.082850] R13: ffffffff8159e040 R14: ffff88816e5cd118 R15: ffff888bd3635b00
[30353.083300] ? nlmsvc_same_host+0x40/0x40
[30353.083560] ? nlm_traverse_files+0xf8/0x280
[30353.083862] nlmsvc_invalidate_all+0x19/0x40
[30353.084131] lockd+0xef/0x1c0
[30353.084333] ? set_grace_period+0xc0/0xc0
[30353.084615] kthread+0x127/0x180
[30353.084837] ? set_kthread_struct+0x80/0x80
[30353.085102] ret_from_fork+0x1f/0x30
[30387.864386] BUG: workqueue lockup - pool cpus=4 node=0 flags=0x0 nice=0 stuck for 94s!
[30387.864984] Showing busy workqueues and worker pools:
[30387.865373] workqueue events: flags=0x0
[30387.865654] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30387.866106] pending: kfree_rcu_monitor
[30387.866430] workqueue events_power_efficient: flags=0x80
[30387.866783] pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30387.867214] pending: neigh_periodic_work
[30387.867529] workqueue mm_percpu_wq: flags=0x8
[30387.867808] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30387.868221] pending: vmstat_update
[30418.070674] BUG: workqueue lockup - pool cpus=4 node=0 flags=0x0 nice=0 stuck for 124s!
[30418.071292] Showing busy workqueues and worker pools:
[30418.071645] workqueue events: flags=0x0
[30418.071951] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30418.072461] pending: kfree_rcu_monitor
[30418.072819] workqueue mm_percpu_wq: flags=0x8
[30418.073114] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30418.073528] pending: vmstat_update
[30448.276963] BUG: workqueue lockup - pool cpus=4 node=0 flags=0x0 nice=0 stuck for 155s!
[30448.277474] Showing busy workqueues and worker pools:
[30448.277808] workqueue events: flags=0x0
[30448.278081] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30448.278506] pending: kfree_rcu_monitor
[30448.278867] workqueue mm_percpu_wq: flags=0x8
[30448.279206] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30448.279642] pending: vmstat_update
[30469.779855] INFO: task nfsd:48383 blocked for more than 122 seconds.
[30469.780340] Tainted: G O 5.15.0-rc3.unstable #4
[30469.780793] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30469.781332] task:nfsd state:D stack: 0 pid:48383 ppid: 2 flags:0x00004000
[30469.781883] Call Trace:
[30469.782059] __schedule+0x2cb/0x1380
[30469.782294] ? sugov_exit+0xc0/0xc0
[30469.782534] ? enqueue_entity+0x15b/0x700
[30469.782785] schedule+0x4e/0xc0
[30469.782997] schedule_timeout+0xfb/0x140
[30469.783272] ? ttwu_do_activate+0x83/0x140
[30469.783539] wait_for_completion+0x88/0x100
[30469.783845] kthread_stop+0x71/0x180
[30469.784114] lockd_down+0x5e/0xc0
[30469.784335] nfsd_shutdown_net+0x65/0x80
[30469.784594] nfsd_last_thread+0x10b/0x140
[30469.784876] ? svc_close_net+0x54/0x180
[30469.785132] svc_shutdown_net+0x30/0x40
[30469.785382] nfsd_destroy+0x44/0x80
[30469.785623] nfsd+0x12c/0x180
[30469.785818] ? nfsd_shutdown_threads+0xc0/0xc0
[30469.786101] kthread+0x127/0x180
[30469.786325] ? set_kthread_struct+0x80/0x80
[30469.786590] ret_from_fork+0x1f/0x30
[30469.786847] INFO: task exportfs:50946 blocked for more than 122 seconds.
[30469.787255] Tainted: G O 5.15.0-rc3.unstable #4
[30469.787636] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30469.788211] task:exportfs state:D stack: 0 pid:50946 ppid: 1 flags:0x00000004
[30469.788729] Call Trace:
[30469.788913] __schedule+0x2cb/0x1380
[30469.789138] ? terminate_walk+0xdd/0x100
[30469.789406] schedule+0x4e/0xc0
[30469.789617] schedule_preempt_disabled+0xe/0x40
[30469.789960] __mutex_lock.constprop.0+0x2c2/0x480
[30469.790275] __mutex_lock_slowpath+0x13/0x40
[30469.790554] mutex_lock+0x34/0x40
[30469.790792] expkey_flush+0x15/0x40
[30469.791025] write_flush.constprop.0+0xf8/0x140
[30469.791302] write_flush_procfs+0x32/0x40
[30469.791573] proc_reg_write+0x54/0xc0
[30469.791827] ? __cond_resched+0x1a/0x80
[30469.792086] vfs_write+0xc4/0x280
[30469.792326] ksys_write+0x67/0x100
[30469.792565] __x64_sys_write+0x1a/0x40
[30469.792795] do_syscall_64+0x35/0x80
[30469.793037] entry_SYSCALL_64_after_hwframe+0x44/0xae
[30469.793352] RIP: 0033:0x7fa3ee3498d7
[30469.793589] RSP: 002b:00007ffc82865108 EFLAGS: 00000246 ORIG_RAX: 0000000000000001
[30469.794093] RAX: ffffffffffffffda RBX: 00005613767b1a50 RCX: 00007fa3ee3498d7
[30469.794555] RDX: 000000000000000b RSI: 00007ffc828651b0 RDI: 0000000000000004
[30469.794999] RBP: 00005613767accb3 R08: 00000000ffffffff R09: 000000000000001b
[30469.795466] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffc828651d0
[30469.795955] R13: 00007ffc828651b0 R14: 0000000000000004 R15: 00005613767acc94
[30478.483258] BUG: workqueue lockup - pool cpus=4 node=0 flags=0x0 nice=0 stuck for 185s!
[30478.483842] Showing busy workqueues and worker pools:
[30478.484175] workqueue events: flags=0x0
[30478.484494] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30478.484915] pending: kfree_rcu_monitor
[30478.485254] workqueue mm_percpu_wq: flags=0x8
[30478.485532] pwq 8: cpus=4 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
[30478.485984] pending: vmstat_update