Complete report #23344
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffffa15832db
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffffa15830ae
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffffa0e37c80
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffffa0f017da
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffffa0e5a0c7
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffffa0e000d5
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 31s! [swapper/2:0]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_vmci sg i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi libata scsi_transport_spi crct10dif_pclmul crct10dif_common
mptscsih crc32c_intel e1000 mptbase serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 0 Comm: swapper/2 Kdump: loaded Tainted: G W L ------------ 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff975cf9c3d230 ti: ffff975cf9c50000 task.ti: ffff975cf9c50000
RIP: 0010:[<ffffffffa15832db>] [<ffffffffa15832db>] native_safe_halt+0xb/0x20
RSP: 0018:ffff975cf9c53ea8 EFLAGS: 00000246
RAX: ffffffffa1583090 RBX: 000750b343fd0cc0 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff975cf9c53ea8 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000000 R11: 0007510654b6ff40 R12: 000750b343fd0cc0
R13: 0000000000000002 R14: 000750b343a17f40 R15: be6b4169ec5a11eb
FS: 0000000000000000(0000) GS:ffff975fae680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055bc77a8d000 CR3: 00000000b9e8c000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa15830ae>] default_idle+0x1e/0xc0
[<ffffffffa0e37c80>] arch_cpu_idle+0x20/0xc0
[<ffffffffa0f017da>] cpu_startup_entry+0x14a/0x1e0
[<ffffffffa0e5a0c7>] start_secondary+0x1f7/0x270
[<ffffffffa0e000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d dd 50 08 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d 29 60 08 00 eb f0 0f 1f 80 00 00 00 00
Complete report #1115265
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffffa0b8930b
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffffa0b890de
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffffa0437ca0
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffffa050123a
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffffa045a7f7
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffffa04000d5
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x5
|
|
7
|
start_cpu
|
vmlinux |
0xffffffffa04000d5
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 243s! [swapper/2:0]
Modules linked in: xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci sd_mod drm crc_t10dif crct10dif_generic ata_piix libahci nfit libata libnvdimm crct10dif_pclmul crct10dif_common serio_raw crc32c_intel vmxnet3 vmw_pvscsi
drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 0 Comm: swapper/2 Kdump: loaded Tainted: G L ------------ T 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffffa06105b7d280 ti: ffffa06105f58000 task.ti: ffffa06105f58000
RIP: 0010:[<ffffffffa0b8930b>] [<ffffffffa0b8930b>] native_safe_halt+0xb/0x20
RSP: 0018:ffffa06105f5bea8 EFLAGS: 00000286
RAX: ffffffffa0b890c0 RBX: 000000010a910c4a RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffffa06105f5bea8 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000009 R11: 0000000000000006 R12: 0000a1819b199c40
R13: 7c1afd9b058dd18f R14: ffffa07f7f295568 R15: ffffa07f7f295168
FS: 0000000000000000(0000) GS:ffffa07f7f280000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f78d03149e5 CR3: 00000001c47d0000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffa0b890de>] default_idle+0x1e/0xc0
[<ffffffffa0437ca0>] arch_cpu_idle+0x20/0xc0
[<ffffffffa050123a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffffa045a7f7>] start_secondary+0x1f7/0x270
[<ffffffffa04000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d ed f1 07 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d 19 02 08 00 eb f0 0f 1f 80 00 00 00 00
[<ffffffffa04000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d ed f1 07 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d 19 02 08 00 eb f0 0f 1f 80 00 00 00 00
Complete report #311
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff959832db
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffff959830ae
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff95237c80
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff953017da
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff9525a0c7
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffff952000d5
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [swapper/5:0]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sb_edac coretemp ppdev iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix crct10dif_pclmul crct10dif_common scsi_transport_spi
mptscsih libata crc32c_intel mptbase e1000 serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 0 Comm: swapper/5 Kdump: loaded Tainted: G L ------------ 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff8d6979c79070 ti: ffff8d6979cc0000 task.ti: ffff8d6979cc0000
RIP: 0010:[<ffffffff959832db>] [<ffffffff959832db>] native_safe_halt+0xb/0x20
RSP: 0018:ffff8d6979cc3ea8 EFLAGS: 00000246
RAX: ffffffff95983090 RBX: 00070c86bde49600 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8d6979cc3ea8 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000000 R11: 00070cc846a0c080 R12: 00070c86bde49600
R13: 0000000000000005 R14: 00070c75358b4080 R15: 65974e28d7236fc0
FS: 0000000000000000(0000) GS:ffff8d6c2e740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000017296bd1d010 CR3: 00000000349a4000 CR4: 00000000001607e0
Call Trace:
[<ffffffff959830ae>] default_idle+0x1e/0xc0
[<ffffffff95237c80>] arch_cpu_idle+0x20/0xc0
[<ffffffff953017da>] cpu_startup_entry+0x14a/0x1e0
[<ffffffff9525a0c7>] start_secondary+0x1f7/0x270
[<ffffffff952000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d dd 50 08 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d 29 60 08 00 eb f0 0f 1f 80 00 00 00 00
Complete report #618655
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff9498b25b
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffff9498b02e
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff94237ca0
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff9430181a
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff9425a827
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffff942000d5
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [swapper/2:0]
Modules linked in: binfmt_misc ip_vs_rr xt_ipvs ip_vs xt_REDIRECT nf_nat_redirect vxlan ip6_udp_tunnel udp_tunnel xt_mark xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper
cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 CyProtectDrv(POE) CyProtectDrvOpen(OE) ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops crc_t10dif ahci ttm crct10dif_generic ata_piix libahci drm crct10dif_pclmul nfit crct10dif_common crc32c_intel libata libnvdimm vmxnet3 serio_raw vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 0 Comm: swapper/2 Kdump: loaded Tainted: P W OEL ------------ T 3.10.0-1160.42.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff998df5c8d280 ti: ffff998df5ca4000 task.ti: ffff998df5ca4000
RIP: 0010:[<ffffffff9498b25b>] [<ffffffff9498b25b>] native_safe_halt+0xb/0x20
RSP: 0018:ffff998df5ca7ea8 EFLAGS: 00000246
RAX: ffffffff9498b010 RBX: ffff998df5c8d918 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff998df5ca7ea8 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000400 R11: 00000000000003ff R12: ffff9990ad680000
R13: ffffffff9422b59e R14: ffff998df5ca7e58 R15: ffff998df5ca7e68
FS: 0000000000000000(0000) GS:ffff9990ad680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002b39e932a038 CR3: 0000000141326000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9498b02e>] default_idle+0x1e/0xc0
[<ffffffff94237ca0>] arch_cpu_idle+0x20/0xc0
[<ffffffff9430181a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffff9425a827>] start_secondary+0x1f7/0x270
[<ffffffff942000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d 9d d2 07 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d c9 e2 07 00 eb f0 0f 1f 80 00 00 00 00
Complete report #544525
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff9cb89ebb
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffff9cb89c8e
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff9c437ca0
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff9c50142a
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff9c45a827
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffff9c4000d5
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#21 stuck for 22s! [swapper/21:0]
Modules linked in: dsa_filter(POE) dsa_filter_hook(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon joydev sg parport_pc parport vmw_vmci i2c_piix4 sb_edac pcspkr iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common nfit crc32c_intel mptspi libata scsi_transport_spi libnvdimm mptscsih serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror
dm_region_hash dm_log dm_mod fuse
CPU: 21 PID: 0 Comm: swapper/21 Kdump: loaded Tainted: P OEL ------------ 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8a02a2383180 ti: ffff8a02a2398000 task.ti: ffff8a02a2398000
RIP: 0010:[<ffffffff9cb89ebb>] [<ffffffff9cb89ebb>] native_safe_halt+0xb/0x20
RSP: 0018:ffff8a02a239bea8 EFLAGS: 00000246
RAX: ffffffff9cb89c70 RBX: ffffffff9c4d4d8f RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8a02a239bea8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000400 R11: 00000000000003ff R12: ffff8a02a239be28
R13: 0000000000000246 R14: 0000000000000010 R15: ffffffff9c4d4cfa
FS: 0000000000000000(0000) GS:ffff8a0d8db40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5bdb3dc450 CR3: 0000000454810000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9cb89c8e>] default_idle+0x1e/0xc0
[<ffffffff9c437ca0>] arch_cpu_idle+0x20/0xc0
[<ffffffff9c50142a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffff9c45a827>] start_secondary+0x1f7/0x270
[<ffffffff9c4000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d 3d e6 07 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d 69 f6 07 00 eb f0 0f 1f 80 00 00 00 00
Complete report #532647
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffffa0382b0b
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffffa03828de
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff9fc37c80
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff9fd0159a
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff9fc5a0c7
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffff9fc000d5
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [swapper/4:0]
Modules linked in: ip_set binfmt_misc tcp_diag inet_diag kbase(OE) xt_NFQUEUE nfnetlink_log nfnetlink nfring(OE) tcp_lp fuse vmsecmod(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nf_conntrack_ipv6 nf_defrag_ipv6 nfsv4 nf_conntrack_ipv4 nf_defrag_ipv4 dns_resolver nfs nf_conntrack lockd grace fscache sunrpc ppdev parport_pc sg parport virtio_balloon i2c_piix4 pcspkr joydev ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk virtio_console virtio_scsi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata virtio_pci
virtio_ring floppy serio_raw virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: vmsec_nfq]
CPU: 4 PID: 0 Comm: swapper/4 Kdump: loaded Tainted: GF OEL ------------ 3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff8c92e9680000 ti: ffff8c92e963c000 task.ti: ffff8c92e963c000
RIP: 0010:[<ffffffffa0382b0b>] [<ffffffffa0382b0b>] native_safe_halt+0xb/0x20
RSP: 0018:ffff8c92e963fea8 EFLAGS: 00000246
RAX: ffffffffa03828c0 RBX: ffff8c922b274b00 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8c92e963fea8 R08: 0000000000000000 R09: 0101010101010101
R10: 0000000000000006 R11: 0000000000000005 R12: ffff8ca17cf1ac80
R13: 0000000000000000 R14: ffff8c92e9680698 R15: 00000001e963fe20
FS: 0000000000000000(0000) GS:ffff8ca17cf00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f20850314b1 CR3: 00000009fd810000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa03828de>] default_idle+0x1e/0xc0
[<ffffffff9fc37c80>] arch_cpu_idle+0x20/0xc0
[<ffffffff9fd0159a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffff9fc5a0c7>] start_secondary+0x1f7/0x270
[<ffffffff9fc000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d ad 58 08 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d f9 67 08 00 eb f0 0f 1f 80 00 00 00 00
Complete report #526076
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff82789ebb
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffff82789c8e
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff82037ca0
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff8210142a
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff8205a827
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffff820000d5
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#110 stuck for 22s! [swapper/110:0]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_14203(E) rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache uinput devlink binfmt_misc ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter falcon_lsm_pinned_14108(E) snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm qxl snd_timer ttm drm_kms_helper iTCO_wdt syscopyarea
crc32_pclmul ghash_clmulni_intel aesni_intel lrw sysfillrect gf128mul sysimgblt glue_helper ppdev fb_sys_fops ablk_helper snd iTCO_vendor_support joydev cryptd parport_pc drm virtio_rng pcspkr i2c_i801 lpc_ich soundcore virtio_balloon parport drm_panel_orientation_quirks nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c virtio_net net_failover virtio_console virtio_blk failover crct10dif_pclmul ahci virtio_pci libahci crct10dif_common serio_raw crc32c_intel libata virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 110 PID: 0 Comm: swapper/110 Kdump: loaded Tainted: P EL ------------ 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: Red Hat KVM/RHEL-AV, BIOS 1.13.0-2.module+el8.4.0+534+4680a14e 04/01/2014
task: ffff8b1099359080 ti: ffff8b1099360000 task.ti: ffff8b1099360000
RIP: 0010:[<ffffffff82789ebb>] [<ffffffff82789ebb>] native_safe_halt+0xb/0x20
RSP: 0018:ffff8b1099363ea8 EFLAGS: 00000246
RAX: ffffffff82789c70 RBX: ffff8b1099363e30 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8b1099363ea8 R08: 0000000000000000 R09: 0101010101010101
R10: 0000000000000006 R11: 0000000000000005 R12: ffff8cfbad19b7c0
R13: 0000000000000000 R14: ffff8b1099359718 R15: 0000000199363e20
FS: 0000000000000000(0000) GS:ffff8cfbad180000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6b8b3cc000 CR3: 0000017ce6610000 CR4: 0000000000760ee0
PKRU: 00000000
Call Trace:
[<ffffffff82789c8e>] default_idle+0x1e/0xc0
[<ffffffff82037ca0>] arch_cpu_idle+0x20/0xc0
[<ffffffff8210142a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffff8205a827>] start_secondary+0x1f7/0x270
[<ffffffff820000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d 3d e6 07 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 66 66 66 66 90 fb f4 <5d> c3 0f 1f 00 0f 00 2d 69 f6 07 00 eb f0 0f 1f 80 00 00 00 00
Complete report #324296
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff816ab4a6
Build id: 3.10.0-693.el7.x86_64
|
0x6
|
|
2
|
default_idle
|
vmlinux |
0xffffffff816ab33e
Build id: 3.10.0-693.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff81035006
Build id: 3.10.0-693.el7.x86_64
|
0x26
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff810e7bca
Build id: 3.10.0-693.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff81051af6
Build id: 3.10.0-693.el7.x86_64
|
0x1b6
|
NMI watchdog: BUG: soft lockup - CPU#12 stuck for 21s! [swapper/12:0]
Modules linked in: vmsec_nfq(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables nf_conntrack_ipv6 nf_defrag_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nfnetlink_queue vmsecmod(OE) tun ip_set nfnetlink bridge stp llc nf_conntrack sg i2c_piix4 ppdev pcspkr virtio_balloon joydev parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console virtio_scsi virtio_blk cirrus drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata virtio_pci floppy virtio_ring i2c_core serio_raw virtio dm_mirror dm_region_hash dm_log dm_mod [last unloaded: vmsec_nfq]
CPU: 12 PID: 0 Comm: swapper/12 Tainted: G OEL ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff880174bccf10 ti: ffff880174bec000 task.ti: ffff880174bec000
RIP: 0010:[<ffffffff816ab4a6>] [<ffffffff816ab4a6>] native_safe_halt+0x6/0x10
RSP: 0018:ffff880174befea8 EFLAGS: 00000286
RAX: 00000000ffffffed RBX: ffff880174bcd5a8 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff880174befea8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff81029557
R13: ffff880174befe58 R14: ffffffff810cb62c R15: ffff880174befe20
FS: 0000000000000000(0000) GS:ffff88081dd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000e67000 CR3: 00000000019f2000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff880174befec8 ffffffff816ab33e ffffffff81b1c820 ffff880174bec000
ffff880174befed8 ffffffff81035006 ffff880174beff20 ffffffff810e7bca
664400e4f7abb1ea 0a2ca67b3118a79c ffff880174beff30 0000000000000000
Call Trace:
[<ffffffff816ab33e>] default_idle+0x1e/0xc0
[<ffffffff81035006>] arch_cpu_idle+0x26/0x30
[<ffffffff810e7bca>] cpu_startup_entry+0x14a/0x1c0
[<ffffffff81051af6>] start_secondary+0x1b6/0x230
Code: 00 00 f0 80 a0 3a c0 ff ff 7f 5b 41 5c 41 5d 5d c3 0f 1f 40 00 0f ae bb 38 c0 ff ff eb af 0f 1f 80 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 90 90 90 90
Complete report #230523
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
default_idle
|
vmlinux |
0xffffffffad514dbe
Build id: 3.10.0-862.el7.x86_64
|
0x1e
|
|
2
|
arch_cpu_idle
|
vmlinux |
0xfffffffface3531c
Build id: 3.10.0-862.el7.x86_64
|
0x2c
|
|
3
|
cpu_startup_entry
|
vmlinux |
0xffffffffacef2b6a
Build id: 3.10.0-862.el7.x86_64
|
0x14a
|
|
4
|
start_secondary
|
vmlinux |
0xfffffffface55362
Build id: 3.10.0-862.el7.x86_64
|
0x1f2
|
|
5
|
start_cpu
|
vmlinux |
0xfffffffface000d5
Build id: 3.10.0-862.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 42s! [ksoftirqd/5:34]
[<ffffffffad514dbe>] default_idle+0x1e/0xc0
[<fffffffface3531c>] arch_cpu_idle+0x2c/0x40
[<ffffffffacef2b6a>] cpu_startup_entry+0x14a/0x1e0
[<fffffffface55362>] start_secondary+0x1f2/0x270
[<fffffffface000d5>] start_cpu+0x5/0x14
Complete report #21064
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
default_idle
|
vmlinux |
0xffffffff816b5f5e
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x1e
|
|
2
|
arch_cpu_idle
|
vmlinux |
0xffffffff81034fac
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x2c
|
|
3
|
cpu_startup_entry
|
vmlinux |
0xffffffff810eb6da
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x14a
|
|
4
|
start_secondary
|
vmlinux |
0xffffffff81052222
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x1f2
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 58s! [swapper/1:0]
Modules linked in: rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_statistic vxlan ip6_udp_tunnel udp_tunnel xt_nat xt_recent ipt_REJECT nf_reject_ipv4 ip_set ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables xt_comment xt_mark ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev pcspkr vmw_balloon sg parport_pc parport i2c_piix4 shpchp vmw_vmci nfsd auth_rpcgss nfs_acl
lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel ata_piix serio_raw drm mptspi e1000 scsi_transport_spi libata mptscsih mptbase floppy i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 0 Comm: swapper/1 Tainted: G W ------------ 3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff880175bf1fa0 ti: ffff880175bfc000 task.ti: ffff880175bfc000
RIP: 0010:[<ffffffff816b5f5e>] [<ffffffff816b5f5e>] default_idle+0x1e/0xc0
RSP: 0018:ffff880175bffeb8 EFLAGS: 00010286
RAX: ffffffff816b5f40 RBX: 0000000000000000 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff880175bffec8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 001f2cefe0a4fd00 R12: 0000000000000001
R13: ffff880175bffea8 R14: a9369a4dd8572b4a R15: 0000000000000086
FS: 0000000000000000(0000) GS:ffff88073fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000010a28af6a000 CR3: 0000000098454000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff81034fac>] arch_cpu_idle+0x2c/0x40
[<ffffffff810eb6da>] cpu_startup_entry+0x14a/0x1c0
[<ffffffff81052222>] start_secondary+0x1f2/0x270
Code: e8 78 4c 9d ff 90 90 90 90 90 90 90 90 0f 1f 44 00 00 55 48 89 e5 41 54 53 65 44 8b 25 d0 80 95 7e 0f 1f 44 00 00 e8 c2 01 00 00 <66> 90 65 44 8b 25 bc 80 95 7e 0f 1f 44 00 00 5b 41 5c 5d c3 66
Complete report #1719
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff83387e8b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffff83387c5e
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff82c37ca0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff82d01c7a
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff82c5a727
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffff82c000d5
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 249s! [swapper/5:0]
Modules linked in: mfe_fileaccess_100610110(OE) udp_diag tcp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nfsv3 nfs_acl rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ipt_REJECT nf_reject_ipv4 nf_log_ipv4 nf_log_common xt_LOG xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter mfe_aac_100610110(OE) vmw_vsock_vmci_transport vsock sb_edac ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel
vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 auth_rpcgss sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm e1000e libahci crct10dif_pclmul ata_piix crct10dif_common nfit crc32c_intel libata libnvdimm serio_raw ptp pps_core vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 0 Comm: swapper/5 Kdump: loaded Tainted: G W OEL ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8b8e364b1070 ti: ffff8b8e364bc000 task.ti: ffff8b8e364bc000
RIP: 0010:[<ffffffff83387e8b>] [<ffffffff83387e8b>] native_safe_halt+0xb/0x20
RSP: 0018:ffff8b8e364bfea8 EFLAGS: 00000246
RAX: ffffffff83387c40 RBX: ffff8b92e1a3f6c0 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8b8e364bfea8 R08: 0000000000000000 R09: 0101010101010101
R10: 0000000000000006 R11: 0000000000000005 R12: ffff8b92e735acc0
R13: 0000000000000000 R14: ffff8b8e364b1708 R15: 00000001364bfe20
FS: 0000000000000000(0000) GS:ffff8b92e7340000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f279c0be000 CR3: 0000000602216000 CR4: 00000000001607e0
Call Trace:
[<ffffffff83387c5e>] default_idle+0x1e/0xc0
[<ffffffff82c37ca0>] arch_cpu_idle+0x20/0xc0
[<ffffffff82d01c7a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffff82c5a727>] start_secondary+0x1f7/0x270
[<ffffffff82c000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d 6d 06 08 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d b9 15 08 00 eb f0 0f 1f 80 00 00 00 00
Complete report #15513
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff816ab4a6
Build id: 3.10.0-693.el7.x86_64
|
0x6
|
|
2
|
default_idle
|
vmlinux |
0xffffffff816ab33e
Build id: 3.10.0-693.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff81035006
Build id: 3.10.0-693.el7.x86_64
|
0x26
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff810e7bca
Build id: 3.10.0-693.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff81051af6
Build id: 3.10.0-693.el7.x86_64
|
0x1b6
|
NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [swapper/8:0]
Modules linked in: binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg vmw_balloon joydev pcspkr parport_pc i2c_piix4 vmw_vmci parport shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi ata_piix scsi_transport_spi crct10dif_pclmul mptscsih crct10dif_common libata drm serio_raw crc32c_intel mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 8 PID: 0 Comm: swapper/8 Tainted: G W L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff88017ce28000 ti: ffff88017ce30000 task.ti: ffff88017ce30000
RIP: 0010:[<ffffffff816ab4a6>] [<ffffffff816ab4a6>] native_safe_halt+0x6/0x10
RSP: 0018:ffff88017ce33ea8 EFLAGS: 00000286
RAX: 00000000ffffffed RBX: ffff88017ce28698 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff88017ce33ea8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff81029557
R13: ffff88017ce33e58 R14: ffffffff810cb62c R15: ffff88017ce33e20
FS: 0000000000000000(0000) GS:ffff880237400000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00005584033b4474 CR3: 00000000019f2000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88017ce33ec8 ffffffff816ab33e ffffffff81b1c820 ffff88017ce30000
ffff88017ce33ed8 ffffffff81035006 ffff88017ce33f20 ffffffff810e7bca
117ff29cb34afa33 72c4f05b9a7dbda7 ffff88017ce33f30 0000000000000000
Call Trace:
[<ffffffff816ab33e>] default_idle+0x1e/0xc0
[<ffffffff81035006>] arch_cpu_idle+0x26/0x30
[<ffffffff810e7bca>] cpu_startup_entry+0x14a/0x1c0
[<ffffffff81051af6>] start_secondary+0x1b6/0x230
Code: 00 00 f0 80 a0 3a c0 ff ff 7f 5b 41 5c 41 5d 5d c3 0f 1f 40 00 0f ae bb 38 c0 ff ff eb af 0f 1f 80 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 90 90 90 90
Complete report #37025
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff816ad6f6
Build id: 3.10.0-693.11.6.el7_lustre.x86_64
|
0x6
|
|
2
|
default_idle
|
vmlinux |
0xffffffff816ad52e
Build id: 3.10.0-693.11.6.el7_lustre.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff81034f06
Build id: 3.10.0-693.11.6.el7_lustre.x86_64
|
0x26
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff810e98da
Build id: 3.10.0-693.11.6.el7_lustre.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff81051b36
Build id: 3.10.0-693.11.6.el7_lustre.x86_64
|
0x1d6
|
NMI watchdog: BUG: soft lockup - CPU#18 stuck for 22s! [swapper/18:0]
Modules linked in: osc(OE) osp(OE) ofd(OE) lfsck(OE) ost(OE) mgc(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lustre(OE) lmv(OE) mdc(OE) lov(OE) fid(OE) fld(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) tcp_lp fuse rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_uverbs(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx4_en(OE) mlx4_ib(OE) mlx4_core(OE) dm_mirror dm_region_hash dm_log dm_mod skx_edac edac_core coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd iTCO_wdt iTCO_vendor_support pcspkr ses enclosure scsi_transport_sas joydev sg shpchp i2c_i801 lpc_ich mei_me mei wmi ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd
grace sunrpc knem(OE) ip_tables ext4 mbcache jbd2 mlx5_ib(OE) ib_core(OE) sd_mod crc_t10dif crct10dif_generic i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm i40e ahci libahci megaraid_sas libata mlx5_core(OE) mlxfw(OE) devlink mlx_compat(OE) ptp i2c_core pps_core
CPU: 18 PID: 0 Comm: swapper/18 Tainted: G W OEL ------------ 3.10.0-693.11.6.el7_lustre.x86_64 #1
Hardware name: Sugon S640-G30/60P16-US, BIOS 0JGST031 08/02/2018
task: ffff8808f475dee0 ti: ffff8808f477c000 task.ti: ffff8808f477c000
RIP: 0010:[<ffffffff816ad6f6>] [<ffffffff816ad6f6>] native_safe_halt+0x6/0x10
RSP: 0018:ffff8808f477fea8 EFLAGS: 00000286
RAX: 00000000ffffffed RBX: 0000000000000202 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8808f477fea8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff88105db98a00
R13: 0000000000000000 R14: ffff8808f475e578 R15: 0000000152e79038
FS: 0000000000000000(0000) GS:ffff88105db80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000056297f38a2c8 CR3: 00000000019fa000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff816ad52e>] default_idle+0x1e/0xc0
[<ffffffff81034f06>] arch_cpu_idle+0x26/0x30
[<ffffffff810e98da>] cpu_startup_entry+0x14a/0x1c0
[<ffffffff81051b36>] start_secondary+0x1d6/0x250
Code: 0f 1f 44 00 00 65 8b 05 31 f9 95 7e a8 01 0f 84 73 ff ff ff 31 c0 b9 48 00 00 00 89 c2 0f 30 e9 66 ff ff ff 90 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 90 90 90 90
Complete report #4532
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffffa0b87e8b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb
|
|
2
|
default_idle
|
vmlinux |
0xffffffffa0b87c5e
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x1e
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffffa0437ca0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x20
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffffa0501c7a
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x14a
|
|
5
|
start_secondary
|
vmlinux |
0xffffffffa045a727
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x1f7
|
|
6
|
start_cpu
|
vmlinux |
0xffffffffa04000d5
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [swapper/5:0]
Modules linked in: xt_CHECKSUM tun devlink ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype br_netfilter fuse vmhgfs(OE) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 ppdev snd_rawmidi snd_ac97_codec ac97_bus vmw_balloon snd_seq snd_seq_device
btusb snd_pcm btrtl aesni_intel btbcm btintel lrw gf128mul glue_helper ablk_helper bluetooth cryptd joydev snd_timer snd pcspkr rfkill i2c_piix4 sg vmw_vmci soundcore parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common mptbase libata nfit crc32c_intel libnvdimm e1000 serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 0 Comm: swapper/5 Kdump: loaded Tainted: G OE ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8cd077421070 ti: ffff8cd077428000 task.ti: ffff8cd077428000
RIP: 0010:[<ffffffffa0b87e8b>] [<ffffffffa0b87e8b>] native_safe_halt+0xb/0x20
RSP: 0018:ffff8cd07742bea8 EFLAGS: 00000246
RAX: ffffffffa0b87c40 RBX: ffffffffa04dfde2 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff8cd07742bea8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: ffff8cd40406eb40 R12: ffffffffa0c1e320
R13: ffff8cd077421658 R14: ffff8cd41775acc0 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8cd417740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f84479b5bd0 CR3: 0000000107a10000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa0b87c5e>] default_idle+0x1e/0xc0
[<ffffffffa0437ca0>] arch_cpu_idle+0x20/0xc0
[<ffffffffa0501c7a>] cpu_startup_entry+0x14a/0x1e0
[<ffffffffa045a727>] start_secondary+0x1f7/0x270
[<ffffffffa04000d5>] start_cpu+0x5/0x14
Code: ff ff 66 0f 1f 44 00 00 0f 00 2d 6d 06 08 00 e9 14 ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 55 48 89 e5 0f 1f 44 00 00 fb f4 <5d> c3 0f 1f 00 0f 00 2d b9 15 08 00 eb f0 0f 1f 80 00 00 00 00
Complete report #1433
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_safe_halt
|
vmlinux |
0xffffffff81058e96
Build id: 3.10.0-327.36.3.el7.x86_64
|
0x6
|
|
2
|
default_idle
|
vmlinux |
0xffffffff8101dbff
Build id: 3.10.0-327.36.3.el7.x86_64
|
0x1f
|
|
3
|
arch_cpu_idle
|
vmlinux |
0xffffffff8101e506
Build id: 3.10.0-327.36.3.el7.x86_64
|
0x26
|
|
4
|
cpu_startup_entry
|
vmlinux |
0xffffffff810d64a5
Build id: 3.10.0-327.36.3.el7.x86_64
|
0x245
|
|
5
|
start_secondary
|
vmlinux |
0xffffffff8104768a
Build id: 3.10.0-327.36.3.el7.x86_64
|
0x1ba
|
BUG: soft lockup - CPU#1 stuck for 21s! [swapper/1:0]
Modules linked in: tcp_diag inet_diag ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop binfmt_misc vmw_vsock_vmci_transport vsock coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon ppdev pcspkr sg i2c_piix4 vmw_vmci shpchp parport_pc parport nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod vmwgfx crc_t10dif crct10dif_generic drm_kms_helper ttm drm ata_piix crct10dif_pclmul crct10dif_common vmxnet3 libata serio_raw crc32c_intel i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 0 Comm: swapper/1 Tainted: G L ------------ 3.10.0-327.36.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013
task: ffff88042813c500 ti: ffff88042817c000 task.ti: ffff88042817c000
RIP: 0010:[<ffffffff81058e96>] [<ffffffff81058e96>] native_safe_halt+0x6/0x10
RSP: 0018:ffff88042817fe98 EFLAGS: 00000286
RAX: 00000000ffffffed RBX: ffff88042e64cf00 RCX: 0100000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046
RBP: ffff88042817fe98 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000001d R11: 000000000000001a R12: 00058cddeea4ebc0
R13: ffff88042e64fbc0 R14: bd6e4a0b4d5e8c9e R15: 0000000000000086
FS: 0000000000000000(0000) GS:ffff88042e640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f8b67e44220 CR3: 000000000194a000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88042817feb8 ffffffff8101dbff ffff88042817c000 ffffffff81a691a0
ffff88042817fec8 ffffffff8101e506 ffff88042817ff20 ffffffff810d64a5
ffff88042817ffd8 ffff88042817c000 bd6e4a0b4d5e8c9e 79af41a1b071e675
Call Trace:
[<ffffffff8101dbff>] default_idle+0x1f/0xc0
[<ffffffff8101e506>] arch_cpu_idle+0x26/0x30
[<ffffffff810d64a5>] cpu_startup_entry+0x245/0x290
[<ffffffff8104768a>] start_secondary+0x1ba/0x230
Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84