Info

Permalink
Function
generic_exec_single
First occurrence
2021-06-02
Last occurrence
2026-09-03
State
NEW
Components
kernel
Quality
-44

Statistics

Operating system Count
CentOS 7 13
Architecture Count
x86_64 13
Related packages Count
kernel 13
 0:3.10.0-1160.el7 3
 0:3.10.0-1160.25.1.el7 2
 0:3.10.0-1160.62.1.el7 2
 0:3.10.0-1160.66.1.el7 1
 0:3.10.0-1160.102.1.el7 1
 0:3.10.0-1160.114.2.el7 1
 0:3.10.0-1160.71.1.el7 1
 0:3.10.0-1160.42.2.el7 1
 0:3.10.0-1160.80.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #172019
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff94f16842
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x102
2
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffff94f57f90
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x20
3
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffff94f57f90
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x20
4
smp_call_function_single
vmlinux 0xffffffff94f1695f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5f
5
? mutex_lock
vmlinux 0xffffffff95587192
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x12
6
_rcu_barrier
vmlinux 0xffffffff94f59aed
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1ed
7
rcu_barrier
vmlinux 0xffffffff94f59cc5
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x15
8
netdev_run_todo
vmlinux 0xffffffff9545c4ef
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x6f
9
rtnl_unlock
vmlinux 0xffffffff954698ae
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xe
10
default_device_exit_batch
vmlinux 0xffffffff95452761
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x171
11
? abort_exclusive_wait
vmlinux 0xffffffff94ec6ba0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xa0
12
ops_exit_list.isra.5
vmlinux 0xffffffff9544a7f9
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x59
13
cleanup_net
vmlinux 0xffffffff9544b890
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1d0
14
process_one_work
vmlinux 0xffffffff94ebddcf
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x17f
15
worker_thread
vmlinux 0xffffffff94ebeee6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x126
16
? manage_workers.isra.26
vmlinux 0xffffffff94ebedc0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x2a0
17
kthread
vmlinux 0xffffffff94ec5da1
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd1
18
? insert_kthread_work
vmlinux 0xffffffff94ec5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40
19
ret_from_fork_nospec_begin
vmlinux 0xffffffff95595ddd
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x7
20
? insert_kthread_work
vmlinux 0xffffffff94ec5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 27s! [kworker/u256:0:44835]
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay nf_conntrack_netbios_ns nf_conntrack_broadcast xt_nat xt_mark ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash
dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul snd_ens1371 glue_helper snd_rawmidi ablk_helper snd_ac97_codec ppdev cryptd ac97_bus snd_seq joydev snd_seq_device snd_pcm vmw_balloon pcspkr snd_timer snd soundcore sg vmw_vmci i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sch_fq_codel sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi nfit ata_piix crct10dif_pclmul crct10dif_common scsi_transport_spi libata mptscsih crc32c_intel libnvdimm serio_raw drm_panel_orientation_quirks e1000 mptbase fuse
CPU: 0 PID: 44835 Comm: kworker/u256:0 Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
Workqueue: netns cleanup_net
task: ffff8c19730d2100 ti: ffff8c184803c000 task.ti: ffff8c184803c000
RIP: 0010:[<ffffffff94f16842>]  [<ffffffff94f16842>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8c184803fbc0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8c184803fb90 RCX: 0000000000000004
RDX: ffffffff95613f50 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8c184803fc08 R08: ffffffff95613f48 R09: 0000000000000003
R10: 0000000000000003 R11: 0000000000000400 R12: 0000000000000010
R13: ffffffff94e63c76 R14: ffffffffffffff10 R15: 0000000000000286
FS:  0000000000000000(0000) GS:ffff8c1975600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fff1ff42f60 CR3: 0000000234aee000 CR4: 00000000003607f0
Call Trace:
[<ffffffff94f57f90>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffff94f57f90>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffff94f1695f>] smp_call_function_single+0x5f/0xa0
[<ffffffff95587192>] ? mutex_lock+0x12/0x2f
[<ffffffff94f59aed>] _rcu_barrier+0x1ed/0x370
[<ffffffff94f59cc5>] rcu_barrier+0x15/0x20
[<ffffffff9545c4ef>] netdev_run_todo+0x6f/0x360
[<ffffffff954698ae>] rtnl_unlock+0xe/0x10
[<ffffffff95452761>] default_device_exit_batch+0x171/0x1a0
[<ffffffff94ec6ba0>] ? abort_exclusive_wait+0xa0/0xa0
[<ffffffff9544a7f9>] ops_exit_list.isra.5+0x59/0x70
[<ffffffff9544b890>] cleanup_net+0x1d0/0x2c0
[<ffffffff94ebddcf>] process_one_work+0x17f/0x440
[<ffffffff94ebeee6>] worker_thread+0x126/0x3c0
[<ffffffff94ebedc0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff94ec5da1>] kthread+0xd1/0xe0
[<ffffffff94ec5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffff95595ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff94ec5cd0>] ? insert_kthread_work+0x40/0x40
Code: 89 de 48 03 14 c5 a0 15 b5 95 48 89 df e8 c7 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #426234
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa9316b86
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x106
2
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffffa93582d0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x20
3
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffffa93582d0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x20
4
smp_call_function_single
vmlinux 0xffffffffa9316c9f
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x5f
5
? mutex_lock
vmlinux 0xffffffffa998a812
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x12
6
_rcu_barrier
vmlinux 0xffffffffa9359e2d
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x1ed
7
rcu_barrier
vmlinux 0xffffffffa935a005
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x15
8
kmem_cache_destroy
vmlinux 0xffffffffa93e5f75
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xd5
9
nf_conntrack_cleanup_net_list
nf_conntrack 0xffffffffc08f6a4b
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x17b
10
nf_conntrack_pernet_exit
nf_conntrack 0xffffffffc08f788d
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x6d
11
ops_exit_list.isra.5
vmlinux 0xffffffffa984d7e9
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x59
12
cleanup_net
vmlinux 0xffffffffa984e880
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x1d0
13
process_one_work
vmlinux 0xffffffffa92bdfdf
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x17f
14
worker_thread
vmlinux 0xffffffffa92bf0f6
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x126
15
? manage_workers.isra.26
vmlinux 0xffffffffa92befd0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x2a0
16
kthread
vmlinux 0xffffffffa92c5fb1
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xd1
17
? insert_kthread_work
vmlinux 0xffffffffa92c5ee0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffffa9999df7
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x21
19
? insert_kthread_work
vmlinux 0xffffffffa92c5ee0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/u4:1:47]
Modules linked in: nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ppdev snd_intel8x0 snd_ac97_codec joydev ac97_bus sb_edac snd_seq snd_seq_device snd_pcm snd_timer iosf_mbi pcspkr snd vboxguest(OE) soundcore sg i2c_piix4 parport_pc parport video ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic
crct10dif_common sr_mod cdrom ata_generic vmwgfx pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci crc32c_intel serio_raw e1000 libahci ata_piix libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 47 Comm: kworker/u4:1 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
Workqueue: netns cleanup_net
task: ffff98bc92fb4200 ti: ffff98bc92fec000 task.ti: ffff98bc92fec000
RIP: 0010:[<ffffffffa9316b86>]  [<ffffffffa9316b86>] generic_exec_single+0x106/0x1c0
RSP: 0018:ffff98bc92fefc10  EFLAGS: 00010202
RAX: 00000000000008fd RBX: 00000000000000fb RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff98bc92fefc60 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000000 R11: ffff98bc94fecb80 R12: 0000000000000000
R13: 00000000000008fd R14: 0000000000000001 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff98bc9fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9121ccb750 CR3: 0000000214f60000 CR4: 00000000000206e0
Call Trace:
[<ffffffffa93582d0>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffffa93582d0>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffffa9316c9f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa998a812>] ? mutex_lock+0x12/0x2f
[<ffffffffa9359e2d>] _rcu_barrier+0x1ed/0x370
[<ffffffffa935a005>] rcu_barrier+0x15/0x20
[<ffffffffa93e5f75>] kmem_cache_destroy+0xd5/0x110
[<ffffffffc08f6a4b>] nf_conntrack_cleanup_net_list+0x17b/0x1d0 [nf_conntrack]
[<ffffffffc08f788d>] nf_conntrack_pernet_exit+0x6d/0x80 [nf_conntrack]
[<ffffffffa984d7e9>] ops_exit_list.isra.5+0x59/0x70
[<ffffffffa984e880>] cleanup_net+0x1d0/0x2c0
[<ffffffffa92bdfdf>] process_one_work+0x17f/0x440
[<ffffffffa92bf0f6>] worker_thread+0x126/0x3c0
[<ffffffffa92befd0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa92c5fb1>] kthread+0xd1/0xe0
[<ffffffffa92c5ee0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa9999df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa92c5ee0>] ? insert_kthread_work+0x40/0x40
Code: 14 c5 60 18 f5 a9 48 89 df e8 17 6e 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f
Complete report #383807
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa9f16562
Build id: 3.10.0-1160.el7.x86_64 		0x102
2
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffffa9f57ce0
Build id: 3.10.0-1160.el7.x86_64 		0x20
3
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffffa9f57ce0
Build id: 3.10.0-1160.el7.x86_64 		0x20
4
smp_call_function_single
vmlinux 0xffffffffa9f1667f
Build id: 3.10.0-1160.el7.x86_64 		0x5f
5
? mutex_lock
vmlinux 0xffffffffaa5853c2
Build id: 3.10.0-1160.el7.x86_64 		0x12
6
_rcu_barrier
vmlinux 0xffffffffa9f5983d
Build id: 3.10.0-1160.el7.x86_64 		0x1ed
7
? synchronize_sched_expedited
vmlinux 0xffffffffa9f59b9f
Build id: 3.10.0-1160.el7.x86_64 		0x17f
8
rcu_barrier
vmlinux 0xffffffffa9f59a15
Build id: 3.10.0-1160.el7.x86_64 		0x15
9
netdev_run_todo
vmlinux 0xffffffffaa45a8df
Build id: 3.10.0-1160.el7.x86_64 		0x6f
10
rtnl_unlock
vmlinux 0xffffffffaa467c9e
Build id: 3.10.0-1160.el7.x86_64 		0xe
11
default_device_exit_batch
vmlinux 0xffffffffaa450b51
Build id: 3.10.0-1160.el7.x86_64 		0x171
12
? abort_exclusive_wait
vmlinux 0xffffffffa9ec6a20
Build id: 3.10.0-1160.el7.x86_64 		0xa0
13
ops_exit_list.isra.5
vmlinux 0xffffffffaa448799
Build id: 3.10.0-1160.el7.x86_64 		0x59
14
cleanup_net
vmlinux 0xffffffffaa449830
Build id: 3.10.0-1160.el7.x86_64 		0x1d0
15
process_one_work
vmlinux 0xffffffffa9ebdc4f
Build id: 3.10.0-1160.el7.x86_64 		0x17f
16
worker_thread
vmlinux 0xffffffffa9ebed66
Build id: 3.10.0-1160.el7.x86_64 		0x126
17
? manage_workers.isra.26
vmlinux 0xffffffffa9ebec40
Build id: 3.10.0-1160.el7.x86_64 		0x2a0
18
kthread
vmlinux 0xffffffffa9ec5c21
Build id: 3.10.0-1160.el7.x86_64 		0xd1
19
? insert_kthread_work
vmlinux 0xffffffffa9ec5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40
20
ret_from_fork_nospec_begin
vmlinux 0xffffffffaa593df7
Build id: 3.10.0-1160.el7.x86_64 		0x21
21
? insert_kthread_work
vmlinux 0xffffffffa9ec5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/u6:4:312]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc snd_intel8x0 snd_ac97_codec ppdev ac97_bus snd_seq snd_seq_device iosf_mbi snd_pcm pcspkr sg snd_timer snd video parport_pc soundcore parport i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic
pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw crc32c_intel ahci libahci drm ata_piix e1000 libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 312 Comm: kworker/u6:4 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
Workqueue: netns cleanup_net
task: ffff9b08963eb180 ti: ffff9b08959a8000 task.ti: ffff9b08959a8000
RIP: 0010:[<ffffffffa9f16562>]  [<ffffffffa9f16562>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9b08959abbc0  EFLAGS: 00010202
RAX: 00000000000008fb RBX: ffff9b08959abb58 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff9b08959abc08 R08: 0000000000000001 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000202 R12: ffff9b08959abbe0
R13: 00000000151ee954 R14: 000000000000001f R15: ffff9b08959abbd8
FS:  0000000000000000(0000) GS:ffff9b089fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8f06ef91c8 CR3: 00000001985cc000 CR4: 00000000000206e0
Call Trace:
[<ffffffffa9f57ce0>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffffa9f57ce0>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffffa9f1667f>] smp_call_function_single+0x5f/0xa0
[<ffffffffaa5853c2>] ? mutex_lock+0x12/0x2f
[<ffffffffa9f5983d>] _rcu_barrier+0x1ed/0x370
[<ffffffffa9f59b9f>] ? synchronize_sched_expedited+0x17f/0x1e0
[<ffffffffa9f59a15>] rcu_barrier+0x15/0x20
[<ffffffffaa45a8df>] netdev_run_todo+0x6f/0x360
[<ffffffffaa467c9e>] rtnl_unlock+0xe/0x10
[<ffffffffaa450b51>] default_device_exit_batch+0x171/0x1a0
[<ffffffffa9ec6a20>] ? abort_exclusive_wait+0xa0/0xa0
[<ffffffffaa448799>] ops_exit_list.isra.5+0x59/0x70
[<ffffffffaa449830>] cleanup_net+0x1d0/0x2c0
[<ffffffffa9ebdc4f>] process_one_work+0x17f/0x440
[<ffffffffa9ebed66>] worker_thread+0x126/0x3c0
[<ffffffffa9ebec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa9ec5c21>] kthread+0xd1/0xe0
[<ffffffffa9ec5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffaa593df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa9ec5b50>] ? insert_kthread_work+0x40/0x40
Code: 89 de 48 03 14 c5 e0 13 b5 aa 48 89 df e8 f7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #204276
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb8916842
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x102
2
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffffb8957f90
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x20
3
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffffb8957f90
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x20
4
smp_call_function_single
vmlinux 0xffffffffb891695f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5f
5
? mutex_lock
vmlinux 0xffffffffb8f87192
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x12
6
_rcu_barrier
vmlinux 0xffffffffb8959aed
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1ed
7
rcu_barrier
vmlinux 0xffffffffb8959cc5
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x15
8
kmem_cache_destroy
vmlinux 0xffffffffb89e5865
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd5
9
nf_conntrack_cleanup_net_list
nf_conntrack 0xffffffffc0870a4b
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x17b
10
nf_conntrack_pernet_exit
nf_conntrack 0xffffffffc087188d
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x6d
11
ops_exit_list.isra.5
vmlinux 0xffffffffb8e4a7f9
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x59
12
cleanup_net
vmlinux 0xffffffffb8e4b890
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1d0
13
process_one_work
vmlinux 0xffffffffb88bddcf
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x17f
14
worker_thread
vmlinux 0xffffffffb88beee6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x126
15
? manage_workers.isra.26
vmlinux 0xffffffffb88bedc0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x2a0
16
kthread
vmlinux 0xffffffffb88c5da1
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd1
17
? insert_kthread_work
vmlinux 0xffffffffb88c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffffb8f95df7
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x21
19
? insert_kthread_work
vmlinux 0xffffffffb88c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u256:2:320]
Modules linked in: ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack vmw_vsock_vmci_transport vsock iptable_filter sunrpc snd_seq_midi snd_seq_midi_event vfat fat iosf_mbi kvm_intel kvm xfs irqbypass crc32_pclmul ppdev ghash_clmulni_intel libcrc32c snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device aesni_intel lrw gf128mul vmw_balloon glue_helper ablk_helper cryptd snd_pcm pcspkr joydev snd_timer snd vmw_vmci soundcore sg i2c_piix4 tpm_crb parport_pc parport ip_tables ext4 mbcache jbd2 sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul syscopyarea crct10dif_common sysfillrect sysimgblt fb_sys_fops crc32c_intel ttm nfit drm libnvdimm ata_piix serio_raw mptspi libata scsi_transport_spi
e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 320 Comm: kworker/u256:2 Kdump: loaded Not tainted 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.16722896.B64.2008100651 08/10/2020
Workqueue: netns cleanup_net
task: ffff8dbbf1ff3180 ti: ffff8dbbf14d8000 task.ti: ffff8dbbf14d8000
RIP: 0010:[<ffffffffb8916842>]  [<ffffffffb8916842>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8dbbf14dbc10  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8dbbf14dbbe0 RCX: 0000000000000004
RDX: ffffffffb9013f50 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8dbbf14dbc60 R08: ffffffffb9013f48 R09: 0000000000000003
R10: 0000000000000003 R11: ffff8dbb3ab8f970 R12: ffff8dbb3fc04d00
R13: ffff8dba7b593950 R14: ffff8dbbf14dbb70 R15: ffffffffb88d2b90
FS:  0000000000000000(0000) GS:ffff8dbbf5680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055ad2baa97e0 CR3: 0000000179784000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb8957f90>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffffb8957f90>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffffb891695f>] smp_call_function_single+0x5f/0xa0
[<ffffffffb8f87192>] ? mutex_lock+0x12/0x2f
[<ffffffffb8959aed>] _rcu_barrier+0x1ed/0x370
[<ffffffffb8959cc5>] rcu_barrier+0x15/0x20
[<ffffffffb89e5865>] kmem_cache_destroy+0xd5/0x110
[<ffffffffc0870a4b>] nf_conntrack_cleanup_net_list+0x17b/0x1d0 [nf_conntrack]
[<ffffffffc087188d>] nf_conntrack_pernet_exit+0x6d/0x80 [nf_conntrack]
[<ffffffffb8e4a7f9>] ops_exit_list.isra.5+0x59/0x70
[<ffffffffb8e4b890>] cleanup_net+0x1d0/0x2c0
[<ffffffffb88bddcf>] process_one_work+0x17f/0x440
[<ffffffffb88beee6>] worker_thread+0x126/0x3c0
[<ffffffffb88bedc0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb88c5da1>] kthread+0xd1/0xe0
[<ffffffffb88c5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb8f95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb88c5cd0>] ? insert_kthread_work+0x40/0x40
Code: 89 de 48 03 14 c5 a0 15 55 b9 48 89 df e8 c7 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #269456
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff94516a32
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x102
2
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffff94558180
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x20
3
? synchronize_sched_expedited_cpu_stop
vmlinux 0xffffffff94558180
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x20
4
smp_call_function_single
vmlinux 0xffffffff94516b4f
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x5f
5
? mutex_lock
vmlinux 0xffffffff94b875b2
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x12
6
_rcu_barrier
vmlinux 0xffffffff94559cdd
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x1ed
7
rcu_barrier
vmlinux 0xffffffff94559eb5
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x15
8
netdev_run_todo
vmlinux 0xffffffff94a5c4ef
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x6f
9
rtnl_unlock
vmlinux 0xffffffff94a698ae
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xe
10
default_device_exit_batch
vmlinux 0xffffffff94a52761
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x171
11
? abort_exclusive_wait
vmlinux 0xffffffff944c6c60
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xa0
12
ops_exit_list.isra.5
vmlinux 0xffffffff94a4a7f9
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x59
13
cleanup_net
vmlinux 0xffffffff94a4b890
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x1d0
14
process_one_work
vmlinux 0xffffffff944bde8f
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x17f
15
worker_thread
vmlinux 0xffffffff944befa6
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x126
16
? manage_workers.isra.26
vmlinux 0xffffffff944bee80
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x2a0
17
kthread
vmlinux 0xffffffff944c5e61
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xd1
18
? insert_kthread_work
vmlinux 0xffffffff944c5d90
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x40
19
ret_from_fork_nospec_begin
vmlinux 0xffffffff94b95df7
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x21
20
? insert_kthread_work
vmlinux 0xffffffff944c5d90
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 42s! [kworker/u8:2:26480]
Modules linked in: xt_multiport xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_nat_ftp nf_conntrack_ftp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod squashfs loop sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr virtio_balloon parport_pc parport i2c_piix4 ip_tables
ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx virtio_net net_failover virtio_scsi failover drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw virtio_pci drm_panel_orientation_quirks virtio_ring virtio floppy fuse
CPU: 2 PID: 26480 Comm: kworker/u8:2 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.42.2.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org 04/01/2014
Workqueue: netns cleanup_net
task: ffff97617afee300 ti: ffff976233404000 task.ti: ffff976233404000
RIP: 0010:[<ffffffff94516a32>]  [<ffffffff94516a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff976233407bc0  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff976233407b90 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000286
RBP: ffff976233407c08 R08: ffffffff94c137c0 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000800 R12: ffff97623fc1acc0
R13: ffff976233407bb0 R14: ffff97623fc1acc0 R15: 0000000000763d4a
FS:  0000000000000000(0000) GS:ffff97623fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb0558d7000 CR3: 000000015f010000 CR4: 0000000000360fe0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff94558180>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffff94558180>] ? synchronize_sched_expedited_cpu_stop+0x20/0x20
[<ffffffff94516b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffff94b875b2>] ? mutex_lock+0x12/0x2f
[<ffffffff94559cdd>] _rcu_barrier+0x1ed/0x370
[<ffffffff94559eb5>] rcu_barrier+0x15/0x20
[<ffffffff94a5c4ef>] netdev_run_todo+0x6f/0x360
[<ffffffff94a698ae>] rtnl_unlock+0xe/0x10
[<ffffffff94a52761>] default_device_exit_batch+0x171/0x1a0
[<ffffffff944c6c60>] ? abort_exclusive_wait+0xa0/0xa0
[<ffffffff94a4a7f9>] ops_exit_list.isra.5+0x59/0x70
[<ffffffff94a4b890>] cleanup_net+0x1d0/0x2c0
[<ffffffff944bde8f>] process_one_work+0x17f/0x440
[<ffffffff944befa6>] worker_thread+0x126/0x3c0
[<ffffffff944bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff944c5e61>] kthread+0xd1/0xe0
[<ffffffff944c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff94b95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff944c5d90>] ? insert_kthread_work+0x40/0x40
Code: 89 de 48 03 14 c5 60 15 15 95 48 89 df e8 67 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00