Complete report #1412136
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
sync_inodes_sb
|
vmlinux |
0xffffffff9c87f49b
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x19b
|
|
2
|
|
vmlinux |
0xffffffff9c8840a0
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x70
|
|
3
|
sync_inodes_one_sb
|
vmlinux |
0xffffffff9c8840b9
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x19
|
|
4
|
iterate_supers
|
vmlinux |
0xffffffff9c852933
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0xc3
|
|
5
|
sys_sync
|
vmlinux |
0xffffffff9c884394
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x44
|
|
6
|
system_call_fastpath
|
vmlinux |
0xffffffff9cd95f92
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#12 stuck for 22s! [dsync:132327]
Modules linked in: ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt i40iw rdma_ucm ib_iser libiscsi ib_umad ib_ipoib scsi_transport_iscsi mlx5_ib ib_uverbs rpcrdma rdma_cm iw_cm ib_cm ib_core rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag mmfs26(OE) mmfslinux(OE) tracedev(OE) bonding ip6table_filter ip6table_raw ip6_tables xt_comment xt_multiport xt_conntrack iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw sunrpc dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel
aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr lpc_ich i2c_i801 joydev mei_me mei wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mlx5_core i40e ahci drm mlxfw libahci devlink megaraid_sas crct10dif_pclmul ptp crct10dif_common libata crc32c_intel drm_panel_orientation_quirks pps_core nfit libnvdimm
CPU: 12 PID: 132327 Comm: dsync Kdump: loaded Tainted: G W OE ------------ 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: Supermicro SYS-1019P-WTR/X11SPW-TF, BIOS 3.2 10/17/2019
task: ffffa055c7983180 ti: ffffa01a260dc000 task.ti: ffffa01a260dc000
RIP: 0010:[<ffffffff9c87f49b>] [<ffffffff9c87f49b>] sync_inodes_sb+0x19b/0x3d0
RSP: 0018:ffffa01a260dfe20 EFLAGS: 00000202
RAX: ffffa034524b9330 RBX: 0000000000000002 RCX: 00000000c0000100
RDX: 0000000000000001 RSI: ffffa055c7983180 RDI: ffffa034524b92b0
RBP: ffffa01a260dfed8 R08: ffffa01a260dc000 R09: 0000000000000001
R10: 0000000000000002 R11: 0000000000000206 R12: ffffa01a260dfda0
R13: ffffa01a260dfed8 R14: 00000000ffffffff R15: ffffa055c7983180
FS: 00007fbb82e6f740(0000) GS:ffffa0723cb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2d70cd7d70 CR3: 00000004fdc42000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff9c8840a0>] ? generic_write_sync+0x70/0x70
[<ffffffff9c8840b9>] sync_inodes_one_sb+0x19/0x20
[<ffffffff9c852933>] iterate_supers+0xc3/0x120
[<ffffffff9c884394>] sys_sync+0x44/0xb0
[<ffffffff9cd95f92>] system_call_fastpath+0x25/0x2a
Code: 48 89 df c6 07 00 0f 1f 40 00 49 8b 87 08 01 00 00 49 39 c5 4c 8d b8 f8 fe ff ff 74 93 49 8d 9f 88 00 00 00 4d 8b 67 30 48 89 df <e8> e0 c5 50 00 41 f6 87 a0 00 00 00 38 75 c6 49 83 7c 24 60 00
Complete report #406773
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
sync_inodes_sb
|
vmlinux |
0xffffffff8404a344
Build id: 3.10.0-862.el7.x86_64
|
0x194
|
|
2
|
|
vmlinux |
0xffffffff8404ec20
Build id: 3.10.0-862.el7.x86_64
|
0x70
|
|
3
|
sync_inodes_one_sb
|
vmlinux |
0xffffffff8404ec39
Build id: 3.10.0-862.el7.x86_64
|
0x19
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [systemd:10574]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event btusb btrtl btbcm btintel bluetooth iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel rfkill lrw gf128mul glue_helper nfit ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec libnvdimm ac97_bus pcspkr snd_seq snd_seq_device snd_pcm joydev snd_timer sg snd soundcore ppdev vmw_balloon parport_pc parport vmw_vmci shpchp i2c_piix4 ip_tables
ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common drm crc32c_intel libata mptspi scsi_transport_spi serio_raw e1000 mptscsih mptbase i2c_core
CPU: 1 PID: 10574 Comm: systemd Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9e869e769fa0 ti: ffff9e86cbda4000 task.ti: ffff9e86cbda4000
RIP: 0010:[<ffffffff8404a344>] [<ffffffff8404a344>] sync_inodes_sb+0x194/0x3d0
RSP: 0018:ffff9e86cbda7e20 EFLAGS: 00010202
RAX: ffff9e866fe1ae30 RBX: 0000000000000000 RCX: ffff9e86cbda7fd8
RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff9e866fe1b1b8
RBP: ffff9e86cbda7ed8 R08: ffff9e86cbda7d60 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000000 R12: 7fffffffffffffff
R13: ffff9e86cbda7ed8 R14: ffffffff83eb13e0 R15: 0000000023736a13
FS: 00007f14bca1c700(0000) GS:ffff9e8779640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f105e814f40 CR3: 0000000035f8e000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8404ec20>] ? generic_write_sync+0x70/0x70
[<ffffffff8404ec39>] sync_inodes_one_sb+0x19/0x20
Complete report #18002
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
sync_inodes_sb
|
vmlinux |
0xffffffff81232bfc
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x11c
|
|
2
|
|
vmlinux |
0xffffffff812382e0
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x70
|
|
3
|
sync_inodes_one_sb
|
vmlinux |
0xffffffff812382f9
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x19
|
|
4
|
iterate_supers
|
vmlinux |
0xffffffff81209833
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xc3
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [sync:23256]
Modules linked in: iptable_filter fuse binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev ppdev vmw_balloon sg parport_pc vmw_vmci parport shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul libata mptspi crct10dif_common crc32c_intel scsi_transport_spi serio_raw mptscsih e1000 mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 23256 Comm: sync Tainted: G W L ------------ 3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff88070ceb4f10 ti: ffff880059698000 task.ti: ffff880059698000
RIP: 0010:[<ffffffff81232bfc>] [<ffffffff81232bfc>] sync_inodes_sb+0x11c/0x1f0
RSP: 0018:ffff88005969be48 EFLAGS: 00010212
RAX: ffff88001c340d98 RBX: 0000000000000100 RCX: ffff88005969bfd8
RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff88001c3410d8
RBP: ffff88005969bed8 R08: ffff88005969bd88 R09: 0000000000000000
R10: 0000000000000100 R11: 0000000000000001 R12: ffff88005969bfd8
R13: ffff88005969bfd8 R14: ffff88005969bfd8 R15: ffff88070ceb4f10
FS: 00007f2cdd10c740(0000) GS:ffff88073fcc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000006e8360 CR3: 0000000020b58000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff812382e0>] ? generic_write_sync+0x70/0x70
[<ffffffff812382f9>] sync_inodes_one_sb+0x19/0x20
[<ffffffff81209833>] iterate_supers+0xc3/0x120