Info

Permalink
Function
_raw_spin_unlock_irqrestore
First occurrence
2021-05-16
Last occurrence
2021-05-30
State
NEW
Components
kernel
Quality
-26

Statistics

Operating system Count
CentOS 7 708
Architecture Count
x86_64 708
Related packages Count
kernel 708
 0:3.10.0-957.el7 689
 0:3.10.0-1160.el7 13
 0:3.10.0-1160.24.1.el7 2
 0:3.10.0-1160.25.1.el7 1
 0:3.10.0-1062.el7 1
 0:3.10.0-1062.18.1.el7 1
 0:3.10.0-1160.90.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

No reports in the last 20 weeks.

Report backtrace


Complete report #977245
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff88dba385
Build id: 3.10.0-1160.90.1.el7.x86_64
0x15
2
try_to_del_timer_sync
vmlinux 0xffffffff886b2f0e
Build id: 3.10.0-1160.90.1.el7.x86_64
0x5e
3
del_timer_sync
vmlinux 0xffffffff886b2f92
Build id: 3.10.0-1160.90.1.el7.x86_64
0x52
4
schedule_timeout
vmlinux 0xffffffff88db5780
Build id: 3.10.0-1160.90.1.el7.x86_64
0x170
5
? requeue_timers
vmlinux 0xffffffff886b26a0
Build id: 3.10.0-1160.90.1.el7.x86_64
0x160
6
? prepare_to_wait
vmlinux 0xffffffff886cc266
Build id: 3.10.0-1160.90.1.el7.x86_64
0x56
7
rcu_gp_kthread
vmlinux 0xffffffff88763d69
Build id: 3.10.0-1160.90.1.el7.x86_64
0x359
8
? wake_up_atomic_t
vmlinux 0xffffffff886cc790
Build id: 3.10.0-1160.90.1.el7.x86_64
0x40
9
? rcu_gp_fqs
vmlinux 0xffffffff88763a10
Build id: 3.10.0-1160.90.1.el7.x86_64
0x90
10
kthread
vmlinux 0xffffffff886cb621
Build id: 3.10.0-1160.90.1.el7.x86_64
0xd1
11
? insert_kthread_work
vmlinux 0xffffffff886cb550
Build id: 3.10.0-1160.90.1.el7.x86_64
0x40
12
ret_from_fork_nospec_begin
vmlinux 0xffffffff88dc51dd
Build id: 3.10.0-1160.90.1.el7.x86_64
0x7
13
? insert_kthread_work
vmlinux 0xffffffff886cb550
Build id: 3.10.0-1160.90.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [rcu_sched:9]
Modules linked in: tcp_lp veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter binfmt_misc overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock tun sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_vmci sg i2c_piix4 parport_pc parport ip_tables xfs libcrc32c
sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix e1000 mptspi nfit scsi_transport_spi libata mptscsih libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.90.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9920b84e9080 ti: ffff9920b84f4000 task.ti: ffff9920b84f4000
RIP: 0010:[<ffffffff88dba385>]  [<ffffffff88dba385>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9920b84f7d28  EFLAGS: 00000282
RAX: ffff9922326d3940 RBX: ffffffff8862c5ee RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff9920b84f7d28 R08: ffff9920b84f4000 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000000 R12: ffff9920b84f7d00
R13: ffff9920b84e90e8 R14: ffff99222df42d80 R15: ffff9922326dacc0
FS:  0000000000000000(0000) GS:ffff992232600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003f5a5e48d008 CR3: 00000001a3834000 CR4: 00000000003607f0
Call Trace:
[<ffffffff886b2f0e>] try_to_del_timer_sync+0x5e/0x90
[<ffffffff886b2f92>] del_timer_sync+0x52/0x60
[<ffffffff88db5780>] schedule_timeout+0x170/0x2d0
[<ffffffff886b26a0>] ? requeue_timers+0x160/0x160
[<ffffffff886cc266>] ? prepare_to_wait+0x56/0x90
[<ffffffff88763d69>] rcu_gp_kthread+0x359/0x720
[<ffffffff886cc790>] ? wake_up_atomic_t+0x40/0x40
[<ffffffff88763a10>] ? rcu_gp_fqs+0x90/0x90
[<ffffffff886cb621>] kthread+0xd1/0xe0
[<ffffffff886cb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff88dc51dd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff886cb550>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 cc cc cc cc 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #781363
Frame # Function Binary Source or offset Line
1
try_to_del_timer_sync
vmlinux 0xffffffff8b4aa086
Build id: 3.10.0-957.el7.x86_64
0x6
2
? del_timer_sync
vmlinux 0xffffffff8b4aa162
Build id: 3.10.0-957.el7.x86_64
0x52
3
schedule_timeout
vmlinux 0xffffffff8bb655f0
Build id: 3.10.0-957.el7.x86_64
0x170
4
? __internal_add_timer
vmlinux 0xffffffff8b4a98e0
Build id: 3.10.0-957.el7.x86_64
0x130
5
? prepare_to_wait
vmlinux 0xffffffff8b4c27f6
Build id: 3.10.0-957.el7.x86_64
0x56
6
rcu_gp_kthread
vmlinux 0xffffffff8b5554e9
Build id: 3.10.0-957.el7.x86_64
0x349
7
? wake_up_atomic_t
vmlinux 0xffffffff8b4c2d00
Build id: 3.10.0-957.el7.x86_64
0x30
8
? rcu_gp_fqs
vmlinux 0xffffffff8b5551a0
Build id: 3.10.0-957.el7.x86_64
0x90
9
kthread
vmlinux 0xffffffff8b4c1c31
Build id: 3.10.0-957.el7.x86_64
0xd1
10
? insert_kthread_work
vmlinux 0xffffffff8b4c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
11
ret_from_fork_nospec_begin
vmlinux 0xffffffff8bb74c37
Build id: 3.10.0-957.el7.x86_64
0x21
12
? insert_kthread_work
vmlinux 0xffffffff8b4c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rcu_sched:9]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter sunrpc vfat fat snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic intel_powerclamp coretemp snd_soc_rt5670 snd_intel_sst_acpi intel_rapl kvm_intel snd_intel_sst_core snd_soc_sst_atom_hifi2_platform snd_soc_rt5645 iTCO_wdt ppdev snd_hda_intel iTCO_vendor_support kvm snd_soc_acpi snd_soc_acpi_intel_match snd_soc_rt5640 snd_soc_rl6231 snd_hda_codec snd_soc_core irqbypass crc32_pclmul snd_hda_core ch341 ghash_clmulni_intel snd_hwdep snd_compress cryptd snd_seq sg snd_seq_device
snd_pcm pcspkr parport_pc snd_timer parport snd soundcore regmap_i2c i2c_designware_platform i2c_i801 lpc_ich i2c_designware_core pwm_lpss ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic i915 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw r8169 mii i2c_algo_bit video drm_kms_helper i2c_hid syscopyarea sysfillrect sysimgblt fb_sys_fops sdhci_acpi ahci sdhci drm mmc_core libahci libata iosf_mbi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: ELSKY M219F-6C/M219F-6C, BIOS 5.6.5 10/08/2021
task: ffff90f079869040 ti: ffff90f079870000 task.ti: ffff90f079870000
RIP: 0010:[<ffffffff8b4aa086>]  [<ffffffff8b4aa086>] try_to_del_timer_sync+0x6/0x90
RSP: 0018:ffff90f079873d58  EFLAGS: 00000286
RAX: 00000000ffffffff RBX: 0000000000000101 RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000286 RDI: ffff90f079873d90
RBP: ffff90f079873d70 R08: 0000000000000101 R09: 0000000000000001
R10: 0000000000015bfb R11: ffff90f07fc03536 R12: ffff90f079873cc8
R13: ffffffff8bb75df2 R14: ffff90f079873d70 R15: ffff90f079873d90
FS:  0000000000000000(0000) GS:ffff90f07fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa6c6062000 CR3: 0000000110810000 CR4: 00000000001007f0
Call Trace:
[<ffffffff8b4aa162>] ? del_timer_sync+0x52/0x60
[<ffffffff8bb655f0>] schedule_timeout+0x170/0x2d0
[<ffffffff8b4a98e0>] ? __internal_add_timer+0x130/0x130
[<ffffffff8b4c27f6>] ? prepare_to_wait+0x56/0x90
[<ffffffff8b5554e9>] rcu_gp_kthread+0x349/0x710
[<ffffffff8b4c2d00>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff8b5551a0>] ? rcu_gp_fqs+0x90/0x90
[<ffffffff8b4c1c31>] kthread+0xd1/0xe0
[<ffffffff8b4c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff8bb74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8b4c1b60>] ? insert_kthread_work+0x40/0x40
Code: 0c 25 28 00 00 00 44 89 e0 75 0b 48 83 c4 10 5b 41 5c 41 5d 5d c3 e8 2a d3 fe ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 <48> 89 e5 41 54 48 8d 75 e0 53 48 89 fb 48 8d 7f 18 48 83 ec 10 
Complete report #586989
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8cf89785
Build id: 3.10.0-1160.el7.x86_64
0x15
2
try_to_del_timer_sync
vmlinux 0xffffffff8c8adf0e
Build id: 3.10.0-1160.el7.x86_64
0x5e
3
del_timer_sync
vmlinux 0xffffffff8c8adf92
Build id: 3.10.0-1160.el7.x86_64
0x52
4
schedule_timeout
vmlinux 0xffffffff8cf84ba0
Build id: 3.10.0-1160.el7.x86_64
0x170
5
? __internal_add_timer
vmlinux 0xffffffff8c8ad6e0
Build id: 3.10.0-1160.el7.x86_64
0x130
6
? prepare_to_wait
vmlinux 0xffffffff8c8c6806
Build id: 3.10.0-1160.el7.x86_64
0x56
7
rcu_gp_kthread
vmlinux 0xffffffff8c95b0d9
Build id: 3.10.0-1160.el7.x86_64
0x359
8
? wake_up_atomic_t
vmlinux 0xffffffff8c8c6d10
Build id: 3.10.0-1160.el7.x86_64
0x30
9
? rcu_gp_fqs
vmlinux 0xffffffff8c95ad80
Build id: 3.10.0-1160.el7.x86_64
0x90
10
kthread
vmlinux 0xffffffff8c8c5c21
Build id: 3.10.0-1160.el7.x86_64
0xd1
11
? insert_kthread_work
vmlinux 0xffffffff8c8c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
12
ret_from_fork_nospec_begin
vmlinux 0xffffffff8cf93df7
Build id: 3.10.0-1160.el7.x86_64
0x21
13
? insert_kthread_work
vmlinux 0xffffffff8c8c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 67s! [rcu_sched:9]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi aesni_intel snd_ac97_codec lrw ac97_bus
gf128mul ppdev glue_helper ablk_helper snd_seq snd_seq_device cryptd vmw_balloon snd_pcm snd_timer snd joydev pcspkr soundcore sg i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom ata_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops pata_acpi mptspi ttm scsi_transport_spi crct10dif_pclmul mptscsih crct10dif_common ata_piix drm mptbase nfit e1000 crc32c_intel serio_raw drm_panel_orientation_quirks libata libnvdimm fuse
CPU: 2 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff99a771381080 ti: ffff99a77138c000 task.ti: ffff99a77138c000
RIP: 0010:[<ffffffff8cf89785>]  [<ffffffff8cf89785>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff99a77138fd28  EFLAGS: 00000282
RAX: ffff99a7796d3940 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff99a77138fd28 R08: ffff99a77138c000 R09: 0000000000000001
R10: 0000000000000001 R11: ffff99a6f9793e18 R12: ffff99a77138c000
R13: 0000000000000001 R14: 0000000000000001 R15: ffff99a6f9793e18
FS:  0000000000000000(0000) GS:ffff99a779680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055ed26b9c948 CR3: 00000000b9414000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8c8adf0e>] try_to_del_timer_sync+0x5e/0x90
[<ffffffff8c8adf92>] del_timer_sync+0x52/0x60
[<ffffffff8cf84ba0>] schedule_timeout+0x170/0x2d0
[<ffffffff8c8ad6e0>] ? __internal_add_timer+0x130/0x130
[<ffffffff8c8c6806>] ? prepare_to_wait+0x56/0x90
[<ffffffff8c95b0d9>] rcu_gp_kthread+0x359/0x720
[<ffffffff8c8c6d10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff8c95ad80>] ? rcu_gp_fqs+0x90/0x90
[<ffffffff8c8c5c21>] kthread+0xd1/0xe0
[<ffffffff8c8c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff8cf93df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8c8c5b50>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #582253
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffa918978b
Build id: 3.10.0-1160.el7.x86_64
0x1b
2
? try_to_del_timer_sync
vmlinux 0xffffffffa8aadf0e
Build id: 3.10.0-1160.el7.x86_64
0x5e
3
del_timer_sync
vmlinux 0xffffffffa8aadf92
Build id: 3.10.0-1160.el7.x86_64
0x52
4
schedule_timeout
vmlinux 0xffffffffa9184ba0
Build id: 3.10.0-1160.el7.x86_64
0x170
5
? __internal_add_timer
vmlinux 0xffffffffa8aad6e0
Build id: 3.10.0-1160.el7.x86_64
0x130
6
? prepare_to_wait
vmlinux 0xffffffffa8ac6806
Build id: 3.10.0-1160.el7.x86_64
0x56
7
rcu_gp_kthread
vmlinux 0xffffffffa8b5b0d9
Build id: 3.10.0-1160.el7.x86_64
0x359
8
? wake_up_atomic_t
vmlinux 0xffffffffa8ac6d10
Build id: 3.10.0-1160.el7.x86_64
0x30
9
? rcu_gp_fqs
vmlinux 0xffffffffa8b5ad80
Build id: 3.10.0-1160.el7.x86_64
0x90
10
kthread
vmlinux 0xffffffffa8ac5c21
Build id: 3.10.0-1160.el7.x86_64
0xd1
11
? insert_kthread_work
vmlinux 0xffffffffa8ac5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
12
ret_from_fork_nospec_begin
vmlinux 0xffffffffa9193df7
Build id: 3.10.0-1160.el7.x86_64
0x21
13
? insert_kthread_work
vmlinux 0xffffffffa8ac5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 27s! [rcu_sched:9]
Modules linked in: tcp_lp veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi ppdev snd_ac97_codec ac97_bus aesni_intel
snd_seq lrw gf128mul snd_seq_device glue_helper ablk_helper vmw_balloon snd_pcm cryptd snd_timer joydev pcspkr snd soundcore i2c_piix4 sg vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt ata_generic pata_acpi crct10dif_pclmul mptspi fb_sys_fops crct10dif_common ttm scsi_transport_spi drm ata_piix e1000 mptscsih crc32c_intel serio_raw mptbase nfit libnvdimm libata drm_panel_orientation_quirks fuse
CPU: 1 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8896fe371080 ti: ffff8896fe378000 task.ti: ffff8896fe378000
RIP: 0010:[<ffffffffa918978b>]  [<ffffffffa918978b>] _raw_spin_unlock_irqrestore+0x1b/0x20
RSP: 0018:ffff8896fe37bd30  EFLAGS: 00000282
RAX: ffff8897af293940 RBX: 0000000000000001 RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff8896fe37bd58 R08: ffff8896fe378000 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
R13: ffff8896fe37bd28 R14: ffff8896fe378000 R15: ffff8896fe37bd28
FS:  0000000000000000(0000) GS:ffff8897af240000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe39fc56000 CR3: 0000000146c2c000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa8aadf0e>] ? try_to_del_timer_sync+0x5e/0x90
[<ffffffffa8aadf92>] del_timer_sync+0x52/0x60
[<ffffffffa9184ba0>] schedule_timeout+0x170/0x2d0
[<ffffffffa8aad6e0>] ? __internal_add_timer+0x130/0x130
[<ffffffffa8ac6806>] ? prepare_to_wait+0x56/0x90
[<ffffffffa8b5b0d9>] rcu_gp_kthread+0x359/0x720
[<ffffffffa8ac6d10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffa8b5ad80>] ? rcu_gp_fqs+0x90/0x90
[<ffffffffa8ac5c21>] kthread+0xd1/0xe0
[<ffffffffa8ac5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffa9193df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa8ac5b50>] ? insert_kthread_work+0x40/0x40
Code: 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d 0f 1f 44 00 00 5d <c3> 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 c7 c2 ff ff ff ff 
Complete report #353191
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffa5989785
Build id: 3.10.0-1160.el7.x86_64
0x15
2
schedule_timeout
vmlinux 0xffffffffa5984b93
Build id: 3.10.0-1160.el7.x86_64
0x163
3
? __internal_add_timer
vmlinux 0xffffffffa52ad6e0
Build id: 3.10.0-1160.el7.x86_64
0x130
4
? prepare_to_wait
vmlinux 0xffffffffa52c6806
Build id: 3.10.0-1160.el7.x86_64
0x56
5
rcu_gp_kthread
vmlinux 0xffffffffa535b0d9
Build id: 3.10.0-1160.el7.x86_64
0x359
6
? wake_up_atomic_t
vmlinux 0xffffffffa52c6d10
Build id: 3.10.0-1160.el7.x86_64
0x30
7
? rcu_gp_fqs
vmlinux 0xffffffffa535ad80
Build id: 3.10.0-1160.el7.x86_64
0x90
8
kthread
vmlinux 0xffffffffa52c5c21
Build id: 3.10.0-1160.el7.x86_64
0xd1
9
? insert_kthread_work
vmlinux 0xffffffffa52c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffffa5993df7
Build id: 3.10.0-1160.el7.x86_64
0x21
11
? insert_kthread_work
vmlinux 0xffffffffa52c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rcu_sched:9]
<EOI> 
Modules linked in:
tcp_lp veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) sunrpc vfat fat iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel sg lrw joydev gf128mul glue_helper ablk_helper cryptd hv_balloon hv_utils ptp pps_core pcspkr ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic hv_storvsc scsi_transport_fc hv_netvsc serio_raw scsi_tgt hyperv_fb hyperv_keyboard hid_hyperv crct10dif_pclmul crct10dif_common hv_vmbus crc32c_intel dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 9 Comm: rcu_sched Tainted: G             L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS Hyper-V UEFI Release v4.0 11/01/2019
task: ffff9c652e789080 ti: ffff9c652e790000 task.ti: ffff9c652e790000
RIP: 0010:[<ffffffffa5989785>]  [<ffffffffa5989785>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9c652e793d70  EFLAGS: 00000286
RAX: 000000000001acc0 RBX: ffffffffa6304bc0 RCX: ffff9c6647c00000
RDX: 0000000000000000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9c652e793d70 R08: ffffffffa6305818 R09: 00000000001364ab
R10: ffffffffa5e7a380 R11: 0000000000000293 R12: ffffffffa5986c8f
R13: ffff9c652e793d60 R14: 0000000000000000 R15: ffff9c663ae4ebc0
FS:  0000000000000000(0000) GS:ffff9c6647c00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8c25afc698 CR3: 00000001f9178000 CR4: 00000000003606f0
Call Trace:
[<ffffffffa5984b93>] schedule_timeout+0x163/0x2d0
[<ffffffffa52ad6e0>] ? __internal_add_timer+0x130/0x130
[<ffffffffa52c6806>] ? prepare_to_wait+0x56/0x90
[<ffffffffa535b0d9>] rcu_gp_kthread+0x359/0x720
[<ffffffffa52c6d10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffa535ad80>] ? rcu_gp_fqs+0x90/0x90
[<ffffffffa52c5c21>] kthread+0xd1/0xe0
[<ffffffffa52c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffa5993df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa52c5b50>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #287374
Frame # Function Binary Source or offset Line
1
del_timer_sync
vmlinux 0xffffffffb28adf8a
Build id: 3.10.0-1160.el7.x86_64
0x4a
2
schedule_timeout
vmlinux 0xffffffffb2f84ba0
Build id: 3.10.0-1160.el7.x86_64
0x170
3
? __internal_add_timer
vmlinux 0xffffffffb28ad6e0
Build id: 3.10.0-1160.el7.x86_64
0x130
4
? prepare_to_wait
vmlinux 0xffffffffb28c6806
Build id: 3.10.0-1160.el7.x86_64
0x56
5
rcu_gp_kthread
vmlinux 0xffffffffb295b0d9
Build id: 3.10.0-1160.el7.x86_64
0x359
6
? wake_up_atomic_t
vmlinux 0xffffffffb28c6d10
Build id: 3.10.0-1160.el7.x86_64
0x30
7
? rcu_gp_fqs
vmlinux 0xffffffffb295ad80
Build id: 3.10.0-1160.el7.x86_64
0x90
8
kthread
vmlinux 0xffffffffb28c5c21
Build id: 3.10.0-1160.el7.x86_64
0xd1
9
? insert_kthread_work
vmlinux 0xffffffffb28c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2f93df7
Build id: 3.10.0-1160.el7.x86_64
0x21
11
? insert_kthread_work
vmlinux 0xffffffffb28c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 96s! [rcu_sched:9]
Modules linked in: tcp_lp veth br_netfilter tun devlink overlay(T) bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr sg parport_pc parport snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore vmw_vmci i2c_piix4 xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper ata_piix serio_raw mptspi syscopyarea scsi_transport_spi sysfillrect sysimgblt fb_sys_fops libata ttm mptscsih nfit drm e1000 libnvdimm mptbase drm_panel_orientation_quirks
fuse [last unloaded: ip_tables]
CPU: 2 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff95e082ba1080 ti: ffff95e082bac000 task.ti: ffff95e082bac000
RIP: 0010:[<ffffffffb28adf8a>]  [<ffffffffb28adf8a>] del_timer_sync+0x4a/0x60
RSP: 0018:ffff95e082bafd68  EFLAGS: 00000286
RAX: 00000000ffffffff RBX: 0000000000000282 RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff95e082bafd70 R08: ffff95e082bac000 R09: 0000000000000001
R10: 0000000000000002 R11: 0000000000000000 R12: 0000000000000000
R13: ffff95e0ba6d3940 R14: ffff95e082bac000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff95e0ba680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f47a4e51040 CR3: 0000000034e1c000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb2f84ba0>] schedule_timeout+0x170/0x2d0
[<ffffffffb28ad6e0>] ? __internal_add_timer+0x130/0x130
[<ffffffffb28c6806>] ? prepare_to_wait+0x56/0x90
[<ffffffffb295b0d9>] rcu_gp_kthread+0x359/0x720
[<ffffffffb28c6d10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb295ad80>] ? rcu_gp_fqs+0x90/0x90
[<ffffffffb28c5c21>] kthread+0xd1/0xe0
[<ffffffffb28c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2f93df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb28c5b50>] ? insert_kthread_work+0x40/0x40
Code: fb 74 28 f6 47 18 02 75 22 be 75 04 00 00 48 c7 c7 d8 0d 28 b3 e8 d7 d3 fe ff 48 89 df e8 2f ff ff ff 85 c0 79 11 0f 1f 00 f3 90 <48> 89 df e8 1e ff ff ff 85 c0 78 f2 5b 5d c3 0f 1f 80 00 00 00 
Complete report #284021
Frame # Function Binary Source or offset Line
1
try_to_del_timer_sync
vmlinux 0xffffffffb20ae626
Build id: 3.10.0-1062.18.1.el7.x86_64
0x76
2
del_timer_sync
vmlinux 0xffffffffb20ae692
Build id: 3.10.0-1062.18.1.el7.x86_64
0x52
3
schedule_timeout
vmlinux 0xffffffffb277ec50
Build id: 3.10.0-1062.18.1.el7.x86_64
0x170
4
? __internal_add_timer
vmlinux 0xffffffffb20ade10
Build id: 3.10.0-1062.18.1.el7.x86_64
0x130
5
? prepare_to_wait
vmlinux 0xffffffffb20c6f06
Build id: 3.10.0-1062.18.1.el7.x86_64
0x56
6
rcu_gp_kthread
vmlinux 0xffffffffb215b0a9
Build id: 3.10.0-1062.18.1.el7.x86_64
0x359
7
? wake_up_atomic_t
vmlinux 0xffffffffb20c7410
Build id: 3.10.0-1062.18.1.el7.x86_64
0x30
8
? rcu_gp_fqs
vmlinux 0xffffffffb215ad50
Build id: 3.10.0-1062.18.1.el7.x86_64
0x90
9
kthread
vmlinux 0xffffffffb20c6321
Build id: 3.10.0-1062.18.1.el7.x86_64
0xd1
10
? insert_kthread_work
vmlinux 0xffffffffb20c6250
Build id: 3.10.0-1062.18.1.el7.x86_64
0x40
11
ret_from_fork_nospec_begin
vmlinux 0xffffffffb278dd37
Build id: 3.10.0-1062.18.1.el7.x86_64
0x21
12
? insert_kthread_work
vmlinux 0xffffffffb20c6250
Build id: 3.10.0-1062.18.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rcu_sched:9]
Modules linked in: nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ppdev snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm iosf_mbi sg snd_timer pcspkr snd soundcore parport_pc i2c_piix4 parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic crct10dif_common pata_acpi ahci serio_raw ata_piix e1000 libahci libata dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 9 Comm: rcu_sched Tainted: G               ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff937680e09070 ti: ffff937680e10000 task.ti: ffff937680e10000
RIP: 0010:[<ffffffffb20ae626>]  [<ffffffffb20ae626>] try_to_del_timer_sync+0x76/0x90
RSP: 0018:ffff937680e13d58  EFLAGS: 00000286
RAX: 00000000ffffffff RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff937680e13d58 R08: ffff937680e10000 R09: 0000000000000001
R10: 0000000000000001 R11: 7fffffffffffffff R12: ffff937680e10000
R13: 0000000000000001 R14: 0000000000000001 R15: 7fffffffffffffff
FS:  0000000000000000(0000) GS:ffff937683600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5a1e7e37e0 CR3: 000000001e1a4000 CR4: 00000000000006f0
Call Trace:
[<ffffffffb20ae692>] del_timer_sync+0x52/0x60
[<ffffffffb277ec50>] schedule_timeout+0x170/0x2d0
[<ffffffffb20ade10>] ? __internal_add_timer+0x130/0x130
[<ffffffffb20c6f06>] ? prepare_to_wait+0x56/0x90
[<ffffffffb215b0a9>] rcu_gp_kthread+0x359/0x720
[<ffffffffb20c7410>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb215ad50>] ? rcu_gp_fqs+0x90/0x90
[<ffffffffb20c6321>] kthread+0xd1/0xe0
[<ffffffffb20c6250>] ? insert_kthread_work+0x40/0x40
[<ffffffffb278dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb20c6250>] ? insert_kthread_work+0x40/0x40
Code: e8 30 fe ff ff 89 c3 48 8b 75 e0 4c 89 e7 e8 f2 51 6d 00 48 8b 4d e8 65 48 33 0c 25 28 00 00 00 89 d8 75 10 48 83 c4 10 5b 41 5c <5d> c3 bb ff ff ff ff eb d3 e8 dc d1 fe ff 66 90 66 2e 0f 1f 84 
Complete report #188819
Frame # Function Binary Source or offset Line
1
del_timer_sync
vmlinux 0xffffffff8caad43a
Build id: 3.10.0-1062.el7.x86_64
0x4a
2
schedule_timeout
vmlinux 0xffffffff8d17caa0
Build id: 3.10.0-1062.el7.x86_64
0x170
3
? __internal_add_timer
vmlinux 0xffffffff8caacbc0
Build id: 3.10.0-1062.el7.x86_64
0x130
4
? prepare_to_wait
vmlinux 0xffffffff8cac5cb6
Build id: 3.10.0-1062.el7.x86_64
0x56
5
rcu_gp_kthread
vmlinux 0xffffffff8cb594b9
Build id: 3.10.0-1062.el7.x86_64
0x359
6
? wake_up_atomic_t
vmlinux 0xffffffff8cac61c0
Build id: 3.10.0-1062.el7.x86_64
0x30
7
? rcu_gp_fqs
vmlinux 0xffffffff8cb59160
Build id: 3.10.0-1062.el7.x86_64
0x90
8
kthread
vmlinux 0xffffffff8cac50d1
Build id: 3.10.0-1062.el7.x86_64
0xd1
9
? insert_kthread_work
vmlinux 0xffffffff8cac5000
Build id: 3.10.0-1062.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffff8d18bd37
Build id: 3.10.0-1062.el7.x86_64
0x21
11
? insert_kthread_work
vmlinux 0xffffffff8cac5000
Build id: 3.10.0-1062.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [rcu_sched:9]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun bridge stp llc devlink ipmi_devintf ipmi_msghandler ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 snd_rawmidi vmw_balloon snd_ac97_codec aesni_intel ac97_bus snd_seq lrw gf128mul glue_helper ablk_helper snd_seq_device
cryptd snd_pcm sg joydev pcspkr snd_timer snd soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod vmwgfx crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common nfit crc32c_intel ata_piix libnvdimm mptspi libata scsi_transport_spi mptscsih serio_raw mptbase e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 9 Comm: rcu_sched Kdump: loaded Not tainted 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9224ba6d9070 ti: ffff9224ba6e4000 task.ti: ffff9224ba6e4000
RIP: 0010:[<ffffffff8caad43a>]  [<ffffffff8caad43a>] del_timer_sync+0x4a/0x60
RSP: 0018:ffff9224ba6e7d68  EFLAGS: 00000286
RAX: 00000000ffffffff RBX: 0000000000000286 RCX: 0000000000000000
RDX: 0000000000000001 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9224ba6e7d70 R08: ffff9224ba6e4000 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
R13: ffffffff8db01c00 R14: ffff9224ba6e4000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff9224bb640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4d99511000 CR3: 000000003e104000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8d17caa0>] schedule_timeout+0x170/0x2d0
[<ffffffff8caacbc0>] ? __internal_add_timer+0x130/0x130
[<ffffffff8cac5cb6>] ? prepare_to_wait+0x56/0x90
[<ffffffff8cb594b9>] rcu_gp_kthread+0x359/0x720
[<ffffffff8cac61c0>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff8cb59160>] ? rcu_gp_fqs+0x90/0x90
[<ffffffff8cac50d1>] kthread+0xd1/0xe0
[<ffffffff8cac5000>] ? insert_kthread_work+0x40/0x40
[<ffffffff8d18bd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8cac5000>] ? insert_kthread_work+0x40/0x40
Code: fb 74 28 f6 47 18 02 75 22 be 75 04 00 00 48 c7 c7 17 ce 47 8d e8 77 d5 fe ff 48 89 df e8 2f ff ff ff 85 c0 79 11 0f 1f 00 f3 90 <48> 89 df e8 1e ff ff ff 85 c0 78 f2 5b 5d c3 0f 1f 80 00 00 00 
Complete report #168096
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff9558b565
Build id: 3.10.0-1160.25.1.el7.x86_64
0x15
2
try_to_del_timer_sync
vmlinux 0xffffffff94eae01e
Build id: 3.10.0-1160.25.1.el7.x86_64
0x5e
3
del_timer_sync
vmlinux 0xffffffff94eae0a2
Build id: 3.10.0-1160.25.1.el7.x86_64
0x52
4
schedule_timeout
vmlinux 0xffffffff95586970
Build id: 3.10.0-1160.25.1.el7.x86_64
0x170
5
? requeue_timers
vmlinux 0xffffffff94ead7f0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x170
6
? prepare_to_wait
vmlinux 0xffffffff94ec6986
Build id: 3.10.0-1160.25.1.el7.x86_64
0x56
7
rcu_gp_kthread
vmlinux 0xffffffff94f5b389
Build id: 3.10.0-1160.25.1.el7.x86_64
0x359
8
? wake_up_atomic_t
vmlinux 0xffffffff94ec6e90
Build id: 3.10.0-1160.25.1.el7.x86_64
0x30
9
? rcu_gp_fqs
vmlinux 0xffffffff94f5b030
Build id: 3.10.0-1160.25.1.el7.x86_64
0x90
10
kthread
vmlinux 0xffffffff94ec5da1
Build id: 3.10.0-1160.25.1.el7.x86_64
0xd1
11
? insert_kthread_work
vmlinux 0xffffffff94ec5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x40
12
ret_from_fork_nospec_begin
vmlinux 0xffffffff95595ddd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x7
13
? insert_kthread_work
vmlinux 0xffffffff94ec5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [rcu_sched:9]
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay nf_conntrack_netbios_ns nf_conntrack_broadcast xt_nat xt_mark ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash
dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul snd_ens1371 glue_helper snd_rawmidi ablk_helper snd_ac97_codec ppdev cryptd ac97_bus snd_seq joydev snd_seq_device snd_pcm vmw_balloon pcspkr snd_timer snd soundcore sg vmw_vmci i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sch_fq_codel sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi nfit ata_piix crct10dif_pclmul crct10dif_common scsi_transport_spi libata mptscsih crc32c_intel libnvdimm serio_raw drm_panel_orientation_quirks e1000 mptbase fuse
CPU: 1 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8c18be371080 ti: ffff8c18be378000 task.ti: ffff8c18be378000
RIP: 0010:[<ffffffff9558b565>]  [<ffffffff9558b565>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff8c18be37bd28  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff8c197565acc0 RCX: 0000000000000001
RDX: 0000000000000000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff8c18be37bd28 R08: ffff8c18be378000 R09: 0000000000000001
R10: 0000000000000003 R11: 0000000000000005 R12: ffff8c18be371718
R13: 00000001666f0000 R14: ffff8c1975640000 R15: ffffffff94e2b59e
FS:  0000000000000000(0000) GS:ffff8c1975640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbb2d102f08 CR3: 00000000b4e70000 CR4: 00000000003607e0
Call Trace:
[<ffffffff94eae01e>] try_to_del_timer_sync+0x5e/0x90
[<ffffffff94eae0a2>] del_timer_sync+0x52/0x60
[<ffffffff95586970>] schedule_timeout+0x170/0x2d0
[<ffffffff94ead7f0>] ? requeue_timers+0x170/0x170
[<ffffffff94ec6986>] ? prepare_to_wait+0x56/0x90
[<ffffffff94f5b389>] rcu_gp_kthread+0x359/0x720
[<ffffffff94ec6e90>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff94f5b030>] ? rcu_gp_fqs+0x90/0x90
[<ffffffff94ec5da1>] kthread+0xd1/0xe0
[<ffffffff94ec5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffff95595ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff94ec5cd0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Complete report #158542
Frame # Function Binary Source or offset Line
1
schedule_timeout
vmlinux 0xffffffffbd1868d8
Build id: 3.10.0-1160.24.1.el7.x86_64
0x168
2
? requeue_timers
vmlinux 0xffffffffbcaad7f0
Build id: 3.10.0-1160.24.1.el7.x86_64
0x170
3
? prepare_to_wait
vmlinux 0xffffffffbcac6986
Build id: 3.10.0-1160.24.1.el7.x86_64
0x56
4
rcu_gp_kthread
vmlinux 0xffffffffbcb5b389
Build id: 3.10.0-1160.24.1.el7.x86_64
0x359
5
? wake_up_atomic_t
vmlinux 0xffffffffbcac6e90
Build id: 3.10.0-1160.24.1.el7.x86_64
0x30
6
? rcu_gp_fqs
vmlinux 0xffffffffbcb5b030
Build id: 3.10.0-1160.24.1.el7.x86_64
0x90
7
kthread
vmlinux 0xffffffffbcac5da1
Build id: 3.10.0-1160.24.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffbcac5cd0
Build id: 3.10.0-1160.24.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffbd195df7
Build id: 3.10.0-1160.24.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffffbcac5cd0
Build id: 3.10.0-1160.24.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rcu_sched:9]
Modules linked in: ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect nf_conntrack_ftp xt_LOG xt_limit xt_multiport xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 xt_nat iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter xt_conntrack nf_conntrack tun vmw_vsock_vmci_transport vsock sunrpc coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev parport_pc sg parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod
cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm sd_mod crc_t10dif crct10dif_generic ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 9 Comm: rcu_sched Kdump: loaded Tainted: G             L ------------   3.10.0-1160.24.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8bab79761080 ti: ffff8bab7976c000 task.ti: ffff8bab7976c000
RIP: 0010:[<ffffffffbd1868d8>]  [<ffffffffbd1868d8>] schedule_timeout+0x168/0x2d0
RSP: 0000:ffff8bab7976fd80  EFLAGS: 00010246
RAX: 0000000000000000 RBX: 000000000001acc0 RCX: 0000000000000000
RDX: ffff8bab7976dfd8 RSI: ffff8bab79761080 RDI: ffff8bab79761080
RBP: ffff8bab7976fe20 R08: ffff8bab7976c000 R09: 0000000000000001
R10: 000000000000000b R11: 0000000000000005 R12: ffff8bab7976ffd8
R13: ffff8bab7976ffd8 R14: ffffffffbd1889e7 R15: ffff8bab7976fd60
FS:  0000000000000000(0000) GS:ffff8bae3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2dd6782000 CR3: 00000001733c2000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffbcaad7f0>] ? requeue_timers+0x170/0x170
[<ffffffffbcac6986>] ? prepare_to_wait+0x56/0x90
[<ffffffffbcb5b389>] rcu_gp_kthread+0x359/0x720
[<ffffffffbcac6e90>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffbcb5b030>] ? rcu_gp_fqs+0x90/0x90
[<ffffffffbcac5da1>] kthread+0xd1/0xe0
[<ffffffffbcac5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffffbd195df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbcac5cd0>] ? insert_kthread_work+0x40/0x40
Code: 03 4c 09 f0 48 89 44 24 28 4c 89 e6 4c 89 f7 4c 89 6c 24 20 e8 7a 70 92 ff 48 8b 74 24 08 48 89 df e8 ed 4b 00 00 e8 b8 25 00 00 <4c> 89 e7 e8 70 77 92 ff 48 8b 05 19 57 5e 00 ba 00 00 00 00 49