Complete report #1415452
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8351173e
Build id: 3.10.0-957.el7.x86_64
|
0x20e
|
|
2
|
|
vmlinux |
0xffffffff835bf550
Build id: 3.10.0-957.el7.x86_64
|
0xb0
|
|
3
|
on_each_cpu_mask
|
vmlinux |
0xffffffff83511889
Build id: 3.10.0-957.el7.x86_64
|
0x29
|
|
4
|
drain_all_pages
|
vmlinux |
0xffffffff835bc435
Build id: 3.10.0-957.el7.x86_64
|
0xb5
|
|
5
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff83b5d228
Build id: 3.10.0-957.el7.x86_64
|
0x510
|
|
6
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff835c0e95
Build id: 3.10.0-957.el7.x86_64
|
0x405
|
|
7
|
alloc_pages_current
|
vmlinux |
0xffffffff8360dcf8
Build id: 3.10.0-957.el7.x86_64
|
0x98
|
|
8
|
get_huge_zero_page
|
vmlinux |
0xffffffff83628595
Build id: 3.10.0-957.el7.x86_64
|
0x45
|
|
9
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff8362d205
Build id: 3.10.0-957.el7.x86_64
|
0x2f5
|
|
10
|
handle_mm_fault
|
vmlinux |
0xffffffff835ec162
Build id: 3.10.0-957.el7.x86_64
|
0x892
|
|
11
|
__do_page_fault
|
vmlinux |
0xffffffff83b6f5e3
Build id: 3.10.0-957.el7.x86_64
|
0x203
|
|
12
|
trace_do_page_fault
|
vmlinux |
0xffffffff83b6f9c6
Build id: 3.10.0-957.el7.x86_64
|
0x56
|
|
13
|
do_async_page_fault
|
vmlinux |
0xffffffff83b6ef42
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
|
14
|
async_page_fault
|
vmlinux |
0xffffffff83b6b788
Build id: 3.10.0-957.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#26 stuck for 22s! [vmsec_update:216967]
Modules linked in: yaloopback(OE) vmsec_nfq(OE) tcp_diag inet_diag sbd_fun_linux(OE) pv_channel(OE) kvm_ivshmem(OE) sd_mod crc_t10dif crct10dif_generic nls_utf8 isofs tcp_lp fuse nfnetlink_queue nfnetlink vmsecmod(OE) syshook_linux(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter cls_bpf nf_conntrack_ipv6 nf_defrag_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack sunrpc crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg virtio_balloon pcspkr i2c_piix4 binfmt_misc replicator(OE) ip_tables xfs libcrc32c bochs_drm virtio_rng virtio_scsi sr_mod cdrom ata_generic
pata_acpi virtio_console virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul drm crct10dif_common ata_piix crc32c_intel libata serio_raw drm_panel_orientation_quirks floppy virtio_pci virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod disksbd_linux(OE) [last unloaded: yaloopback]
CPU: 26 PID: 216967 Comm: vmsec_update Kdump: loaded Tainted: G OEL ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.15.0-0-g2dd4b9b-20230913_171516-szxrtosci10000 04/01/2014
task: ffff92c9eeb4a080 ti: ffff92c159150000 task.ti: ffff92c159150000
RIP: 0010:[<ffffffff8351173e>] [<ffffffff8351173e>] smp_call_function_many+0x20e/0x270
RSP: 0018:ffff92c159153ae0 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 000c0000835bf550 RCX: ffff92e0bb6a07d0
RDX: 0000000000000002 RSI: 00000000000000ff RDI: 0000000000000000
RBP: ffff92c159153b18 R08: ffff92c253147c00 R09: ffffffff837755c9
R10: ffff92e0bbc9f160 R11: ffffed607a3eb400 R12: 0000000000000286
R13: 0000000000000286 R14: ffff92c159153a90 R15: 0000000001320122
FS: 00007f4aae7c7740(0000) GS:ffff92e0bbc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4aacdea000 CR3: 0000000082266000 CR4: 0000000000360ee0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff835bf550>] ? drain_pages+0xb0/0xb0
[<ffffffff83511889>] on_each_cpu_mask+0x29/0x70
[<ffffffff835bc435>] drain_all_pages+0xb5/0xc0
[<ffffffff83b5d228>] __alloc_pages_slowpath+0x510/0x724
[<ffffffff835c0e95>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff8360dcf8>] alloc_pages_current+0x98/0x110
[<ffffffff83628595>] get_huge_zero_page+0x45/0xb0
[<ffffffff8362d205>] do_huge_pmd_anonymous_page+0x2f5/0x4d0
[<ffffffff835ec162>] handle_mm_fault+0x892/0x9b0
[<ffffffff83b6f5e3>] __do_page_fault+0x203/0x500
[<ffffffff83b6f9c6>] trace_do_page_fault+0x56/0x150
[<ffffffff83b6ef42>] do_async_page_fault+0x22/0xf0
[<ffffffff83b6b788>] async_page_fault+0x28/0x30
Code: 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 14 84 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee
Complete report #584027
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9e91173a
Build id: 3.10.0-957.el7.x86_64
|
0x20a
|
|
2
|
|
vmlinux |
0xffffffff9e9bf550
Build id: 3.10.0-957.el7.x86_64
|
0xb0
|
|
3
|
on_each_cpu_mask
|
vmlinux |
0xffffffff9e911889
Build id: 3.10.0-957.el7.x86_64
|
0x29
|
|
4
|
drain_all_pages
|
vmlinux |
0xffffffff9e9bc435
Build id: 3.10.0-957.el7.x86_64
|
0xb5
|
|
5
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff9ef5d228
Build id: 3.10.0-957.el7.x86_64
|
0x510
|
|
6
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9e9c0e95
Build id: 3.10.0-957.el7.x86_64
|
0x405
|
|
7
|
alloc_pages_current
|
vmlinux |
0xffffffff9ea0dcf8
Build id: 3.10.0-957.el7.x86_64
|
0x98
|
|
8
|
get_huge_zero_page
|
vmlinux |
0xffffffff9ea28595
Build id: 3.10.0-957.el7.x86_64
|
0x45
|
|
9
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff9ea2d205
Build id: 3.10.0-957.el7.x86_64
|
0x2f5
|
|
10
|
handle_mm_fault
|
vmlinux |
0xffffffff9e9ec162
Build id: 3.10.0-957.el7.x86_64
|
0x892
|
|
11
|
__do_page_fault
|
vmlinux |
0xffffffff9ef6f5e3
Build id: 3.10.0-957.el7.x86_64
|
0x203
|
|
12
|
do_page_fault
|
vmlinux |
0xffffffff9ef6f915
Build id: 3.10.0-957.el7.x86_64
|
0x35
|
|
13
|
page_fault
|
vmlinux |
0xffffffff9ef6b758
Build id: 3.10.0-957.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [java:5813]
Modules linked in: binfmt_misc vmw_vsock_vmci_transport vsock sunrpc vfat fat ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper sg cryptd vmw_vmci pcspkr joydev parport_pc parport i2c_piix4 tpm_crb ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic e1000e crct10dif_pclmul crct10dif_common vmwgfx crc32c_intel serio_raw mptsas ptp pps_core scsi_transport_sas drm_kms_helper mptscsih mptbase syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm ata_piix nfit libata libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 5813 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
task: ffff924cdfe80000 ti: ffff924ebe3ac000 task.ti: ffff924ebe3ac000
RIP: 0010:[<ffffffff9e91173a>] [<ffffffff9e91173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff924ebe3afb10 EFLAGS: 00000202
RAX: 000000000000000e RBX: 000800009e9bf550 RCX: ffff92549f5a0628
RDX: 000000000000000e RSI: 0000000000000010 RDI: 0000000000000000
RBP: ffff924ebe3afb48 R08: ffff924df4bfc000 R09: ffffffff9eb755c9
R10: ffff92549f31f160 R11: fffff1434197ba00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff924ebe3afac0 R15: 0000000001320122
FS: 00007f89fe6ae700(0000) GS:ffff92549f300000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe0e2ffd9c8 CR3: 000000000d564000 CR4: 0000000000760fe0
PKRU: 55555554
Call Trace:
[<ffffffff9e9bf550>] ? drain_pages+0xb0/0xb0
[<ffffffff9e911889>] on_each_cpu_mask+0x29/0x70
[<ffffffff9e9bc435>] drain_all_pages+0xb5/0xc0
[<ffffffff9ef5d228>] __alloc_pages_slowpath+0x510/0x724
[<ffffffff9e9c0e95>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff9ea0dcf8>] alloc_pages_current+0x98/0x110
[<ffffffff9ea28595>] get_huge_zero_page+0x45/0xb0
[<ffffffff9ea2d205>] do_huge_pmd_anonymous_page+0x2f5/0x4d0
[<ffffffff9e9ec162>] handle_mm_fault+0x892/0x9b0
[<ffffffff9ef6f5e3>] __do_page_fault+0x203/0x500
[<ffffffff9ef6f915>] do_page_fault+0x35/0x90
[<ffffffff9ef6b758>] page_fault+0x28/0x30
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 54 9f f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89