Info

Permalink
Function
__do_softirq
First occurrence
2020-09-22
Last occurrence
2024-04-15
State
NEW
Components
kernel
Quality
-2

Graphs

Statistics

Operating system Count
CentOS 7 22,662
Fedora 38 737
Fedora 37 440
Show more… (3)
Fedora 36 8
Fedora 35 4
Fedora 39 1
Architecture Count
x86_64 23,434
Related packages Count
kernel 22,614
 0:3.10.0-514.el7 3,555
 0:3.10.0-1160.el7 3,078
 0:3.10.0-1160.71.1.el7 1,736
 0:3.10.0-957.el7 1,246
 0:3.10.0-862.el7 1,011
 0:3.10.0-1160.6.1.el7 916
 0:3.10.0-1160.15.2.el7 600
 0:3.10.0-1127.19.1.el7 551
 0:3.10.0-693.el7 534
 0:3.10.0-1062.el7 527
 0:3.10.0-1127.el7 462
 0:3.10.0-1160.53.1.el7 427
 0:3.10.0-1160.76.1.el7 409
 0:3.10.0-1160.88.1.el7 326
 0:3.10.0-1160.80.1.el7 324
 0:3.10.0-1160.59.1.el7 322
 0:3.10.0-1160.49.1.el7 316
 0:3.10.0-1160.25.1.el7 270
 0:3.10.0-1160.24.1.el7 244
 0:3.10.0-1160.45.1.el7 237
 0:3.10.0-1160.95.1.el7 209
 0:3.10.0-327.4.5.el7 208
 0:3.10.0-1160.11.1.el7 201
 0:3.10.0-1160.81.1.el7 201
 0:3.10.0-1160.36.2.el7 197
 0:3.10.0-514.10.2.el7 196
 0:3.10.0-1062.4.1.el7 189
 0:3.10.0-1062.9.1.el7 189
 0:3.10.0-1160.62.1.el7 188
 0:3.10.0-957.21.3.el7 180
 0:3.10.0-1160.66.1.el7 178
 0:3.10.0-957.12.2.el7 178
 0:3.10.0-1062.18.1.el7 174
 0:3.10.0-957.5.1.el7 170
 0:3.10.0-1127.10.1.el7 152
 0:3.10.0-862.11.6.el7 143
 0:3.10.0-1062.12.1.el7 126
 0:3.10.0-1160.92.1.el7 122
 0:3.10.0-1160.42.2.el7 111
 0:3.10.0-1160.31.1.el7 104
 0:3.10.0-1160.41.1.el7 104
 0:3.10.0-1160.90.1.el7 104
 0:3.10.0-1160.83.1.el7 102
 0:3.10.0-1127.13.1.el7 101
 0:3.10.0-327.el7 99
 0:3.10.0-957.1.3.el7 99
 0:3.10.0-862.2.3.el7 90
 0:3.10.0-862.14.4.el7 88
 0:3.10.0-1062.1.2.el7 88
 0:3.10.0-693.21.1.el7 83
 0:3.10.0-1160.21.1.el7 79
 0:3.10.0-957.10.1.el7 75
 0:3.10.0-1160.108.1.el7 74
 0:3.10.0-1062.1.1.el7 72
 0:3.10.0-1062.4.3.el7 65
 0:3.10.0-1160.105.1.el7 60
 0:3.10.0-1127.18.2.el7 58
 0:3.10.0-123.20.1.el7 58
 0:3.10.0-327.10.1.el7 55
 0:3.10.0-514.26.2.el7 54
 0:3.10.0-862.3.2.el7 52
 0:3.10.0-957.27.2.el7 45
 0:3.10.0-957.12.1.el7 38
 0:3.10.0-693.11.1.el7 37
 0:3.10.0-693.5.2.el7 35
 0:3.10.0-1160.99.1.el7 28
 0:3.10.0-693.2.2.el7 26
 0:3.10.0-1160.102.1.el7 23
 0:3.10.0-1160.114.2.el7 22
 0:3.10.0-1127.8.2.el7 20
 0:3.10.0-327.36.2.el7 18
 0:3.10.0-327.28.3.el7 17
 0:3.10.0-327.13.1.el7 12
 0:3.10.0-514.16.1.el7 12
 0:3.10.0-229.el7 12
 0:3.10.0-327.18.2.el7 11
 0:3.10.0-862.9.1.el7 11
 0:3.10.0-1160.2.2.el7 9
 0:3.10.0-514.21.1.el7 9
 0:3.10.0-693.17.1.el7 9
 0:3.10.0-327.22.2.el7 8
 0:3.10.0-327.28.2.el7 8
 0:3.10.0-327.36.3.el7 5
 0:3.10.0-693.11.6.el7 5
 0:3.10.0-514.6.1.el7 4
 0:3.10.0-862.6.3.el7 3
 0:3.10.0-514.21.2.el7 3
 0:3.10.0-514.6.2.el7 2
 0:4.9.41+-2 2
 0:3.10.0-123.el7 2
 0:3.10.0-327.36.1.el7 2
 0:3.10.0-514.2.2.el7 2
 0:3.10.0-514.26.1.el7 2
 0:3.10.0-327.3.1.el7 1
 0:3.10.0-693.11.6.el7_lustre 1
 0:3.10.0-862.3.3.el7 1
 0:3.10.0-957.21.2.el7 1
 0:3.10.0-229.14.1.el7 1
kernel-core 767
 0:6.2.0-0.rc3.20230110git5a41237ad1d4.25.fc38 547
 0:6.2.0-0.rc3.20230113gitd9fc1511728c.28.fc38 170
 0:6.0.0-0.rc5.20220914git3245cb65fd91.39.fc38 19
 0:5.18.0-0.rc3.20220422gitd569e86915b7f2f.31.fc37 12
 0:5.18.0-0.rc0.20220324gited4643521e6a.6.fc37 3
 0:5.18.0-0.rc0.20220325git34af78c4e616.7.fc37 3
 0:5.18.0-0.rc0.20220401gite8b767f5e04097a.15.fc37 2
 0:5.17.0-0.rc2.20220204gitdcb85f85fa6f.86.fc36 2
 0:4.5.5-300.el7.centos 2
 0:5.18.0-0.rc5.20220504git107c948d1d3e61d.42.fc37 1
 0:5.18.0-0.rc5.20220505gita7391ad3572431a.43.fc37 1
 0:5.18.0-0.rc6.20220513gitf3f19f939c11925.51.fc37 1
 0:5.19.0-0.rc0.20220531git8ab2afa23bd1.8.fc37 1
 0:5.19.0-0.rc4.20220630gitd9b2ba67917c.35.fc37 1
 0:6.1.0-0.rc0.20221014git9c9155a3509a.11.fc38 1
 0:6.1.0-0.rc3.20221102git8f71a2b3f435.29.fc38 1
kernel-lt 45
 0:4.4.15-1.el7.elrepo 31
 0:4.4.189-1.el7.elrepo 3
 0:4.4.60-1.el7.elrepo 3
 0:4.4.241-1.el7.elrepo 2
 0:4.4.245-1.el7.elrepo 2
 0:4.4.219-1.el7.elrepo 1
 0:4.4.228-2.el7.elrepo 1
 0:4.4.237-1.el7.elrepo 1
 0:4.4.66-1.el7.elrepo 1
Show more… (2)
kernel-debug-core 5
 0:5.18.0-0.rc1.18.fc37 4
 0:6.4.12-200.fc38 1
kernel-ml 1
 0:4.6.3-1.el7.elrepo 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #914063
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffffbd6a953a
Build id: 3.10.0-1160.90.1.el7.x86_64
0x9a
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 25s! [kworker/2:2:5544]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_16108(E) falcon_lsm_pinned_16004(E) nls_utf8 cifs ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sb_edac joydev iosf_mbi hv_utils sg ptp pps_core hv_balloon pcspkr i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic crct10dif_common ata_generic pata_acpi ata_piix hv_storvsc
hv_netvsc scsi_transport_fc hyperv_keyboard hid_hyperv scsi_tgt libata hyperv_fb hv_vmbus floppy serio_raw dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 2 PID: 5544 Comm: kworker/2:2 Kdump: loaded Tainted: P        W   EL ------------   3.10.0-1160.90.1.el7.x86_64 #1
Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090007  05/18/2018
Workqueue: xfs-data/dm-0 xfs_end_io [xfs]
task: ffff952ec1599080 ti: ffff952ec1948000 task.ti: ffff952ec1948000
RIP: 0010:[<ffffffffbd6a953a>]  [<ffffffffbd6a953a>] __do_softirq+0x9a/0x290
RSP: 0018:ffff952fc1683f20  EFLAGS: 00000206
RAX: ffff952ec194bfd8 RBX: ffffffffbd6b321f RCX: 0000000000000002
RDX: 000000019f72dcb1 RSI: 00000000ef2fd5ab RDI: ffff952ec1599080
RBP: ffff952fc1683f80 R08: 000000000013f5d6 R09: 2ece9a3750080000
R10: a30a98b5aea1e840 R11: 0000000000000000 R12: ffff952fc1683e98
R13: ffffffffbddc9042 R14: ffff952fc1683f80 R15: ffff952ec194bfd8
FS:  0000000000000000(0000) GS:ffff952fc1680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c000689000 CR3: 0000000001430000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
Complete report #410
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff992a5637
Build id: 3.10.0-1127.19.1.el7.x86_64
0x97
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [NetworkManager:957]
Modules linked in: tun fuse drbg ansi_cprng ccm rt2800usb rt2x00usb rt2800lib crc_ccitt rt2x00lib rfcomm cmac ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack bnep iptable_filter sunrpc edac_mce_amd kvm_amd vfat fat kvm arc4 rtl8723be btcoexist irqbypass crc32_pclmul ghash_clmulni_intel rtl8723_common rtl_pci rtlwifi mac80211 hp_wmi sparse_keymap snd_hda_codec_realtek snd_hda_codec_hdmi snd_hda_codec_generic aesni_intel snd_hda_intel
lrw gf128mul glue_helper ablk_helper btusb cryptd snd_hda_codec joydev wdat_wdt btrtl pcspkr btbcm snd_hda_core btintel snd_hwdep snd_seq bluetooth uvcvideo cfg80211 snd_seq_device videobuf2_vmalloc snd_pcm videobuf2_memops videobuf2_core videodev sg fam15h_power i2c_piix4 snd_timer snd rfkill soundcore wmi video pinctrl_amd hp_wireless tpm_crb i2c_designware_platform i2c_designware_core acpi_cpufreq ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic uas usb_storage amdgpu radeon chash amd_iommu_v2 gpu_sched i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw r8169 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 957 Comm: NetworkManager Kdump: loaded Tainted: G        W    L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: HP HP Laptop 15-bw0xx/8331, BIOS F.02 04/07/2017
task: ffff9d383d4ec1c0 ti: ffff9d3705930000 task.ti: ffff9d3705930000
RIP: 0010:[<ffffffff992a5637>]  [<ffffffff992a5637>] __do_softirq+0x97/0x280
RSP: 0018:ffff9d384ec83f20  EFLAGS: 00000206
RAX: ffff9d3705933fd8 RBX: ffff9d384ec95ad8 RCX: 0000000000000001
RDX: 000000010063e420 RSI: 0000000000001840 RDI: ffff9d383d4ec1c0
RBP: ffff9d384ec83f80 R08: 0000063a110e0000 R09: ffff9d384ec83de0
R10: 0000000000000004 R11: 0000000000000005 R12: ffff9d384ec83e98
R13: ffffffff99993efa R14: ffff9d384ec83f80 R15: ffff9d3705933fd8
FS:  00007f54ff600940(0000) GS:ffff9d384ec80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff980bb5000 CR3: 00000002042ac000 CR4: 00000000001407e0
Call Trace:
Complete report #607716
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff81084af8
Build id: 3.10.0-327.28.2.el7.x86_64
0x98
BUG: soft lockup - CPU#2 stuck for 22s! [postgres:29013]
BUG: soft lockup - CPU#0 stuck for 23s! [swapper/0:0]
Modules linked in: zram(C) vmw_vsock_vmci_transport vsock ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack nf_conntrack ip6table_filter ip6_tables iptable_filter coretemp crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon pcspkr sg vmxnet3 vmw_vmci i2c_piix4 shpchp parport_pc parport sch_fq_codel binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common serio_raw drm_kms_helper ttm ahci libahci vmw_pvscsi drm i2c_core ata_piix libata floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 0 Comm: swapper/0 Tainted: G         C     ------------   3.10.0-327.28.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffffffff81951440 ti: ffffffff8193c000 task.ti: ffffffff8193c000
RIP: 0010:[<ffffffff81084af8>]  [<ffffffff81084af8>] __do_softirq+0x98/0x280
RSP: 0018:ffff88017fc03ed0  EFLAGS: 00000206
RAX: ffffffff8193ffd8 RBX: 0000000000000046 RCX: 0000000000000000
RDX: 00000008aa3403f3 RSI: ffffffff81951440 RDI: ffffffff81951440
RBP: ffff88017fc03f30 R08: 0000000000000000 R09: 0000000001f65420
R10: 000000003b9aca00 R11: ffff880177e3d800 R12: ffff88017fc03e48
R13: ffffffff8164789d R14: ffff88017fc03f30 R15: ffffffff8193ffd8
FS:  0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000ddf018 CR3: 0000000151649000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
 ffffffff8193ffd8 0000000a00200000 00000008aa3403f5 0000000000000046
 ffffffff8193ffd8 ffffffff8193ffd8 0000000500000000 ffffffff8193ffd8
 0000000000000046 ffffffff8193c000 ffffffff8193c000 ffffffff8193ffa8
Call Trace:
Complete report #280
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff81090af7
Build id: 3.10.0-693.5.2.el7.x86_64
0x97
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 34s! [kworker/u256:0:24724]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter xt_set ip_set nfnetlink ip_vs nf_conntrack vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event sb_edac edac_core coretemp iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi aesni_intel snd_ac97_codec lrw gf128mul ac97_bus snd_seq glue_helper ablk_helper snd_seq_device ppdev cryptd snd_pcm vmw_balloon snd_timer snd joydev pcspkr soundcore vmw_vmci sg i2c_piix4 shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs
libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi libata crct10dif_pclmul e1000 crct10dif_common mptscsih crc32c_intel mptbase serio_raw i2c_core
CPU: 0 PID: 24724 Comm: kworker/u256:0 Tainted: G             L ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
Workqueue: writeback bdi_writeback_workfn (flush-8:0)
task: ffff8800b265af70 ti: ffff8800a2838000 task.ti: ffff8800a2838000
RIP: 0010:[<ffffffff81090af7>]  [<ffffffff81090af7>] __do_softirq+0x97/0x280
RSP: 0018:ffff880139603ee0  EFLAGS: 00000206
RAX: ffff8800a283bfd8 RBX: 0000000000000046 RCX: 0000000000000000
RDX: 0000000172af4b63 RSI: 0000000024157cf2 RDI: ffff8800b265af70
RBP: ffff880139603f40 R08: 0006d6388e1c5cc0 R09: 0000000000000001
R10: 0000000000000000 R11: ffff880139603da8 R12: ffff880139603e58
R13: ffffffff816b5cdd R14: ffff880139603f40 R15: ffff8800a283bfd8
FS:  0000000000000000(0000) GS:ffff880139600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007ff4ecdbd4f0 CR3: 00000000019f2000 CR4: 00000000000407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff8800a283bfd8 0000000a04a08060 0000000172af4b65 ffff880139603f20
ffff8800a283bfd8 ffff8800a283bfd8 ffff880100000000 ffff8800a283bfd8
0000000000000046 ffff880035702bc0 ffff880035509000 ffff8800a2b58000
Call Trace:
Complete report #551380
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux kernel/softirq.c 545
BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1498
in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 1508, name: llvmpipe-0
preempt_count: 100, expected: 0
RCU nest depth: 2, expected: 0
INFO: lockdep is turned off.
Preemption disabled at:
[<ffffffff82200059>] __do_softirq+0x59/0x59a
CPU: 3 PID: 1508 Comm: llvmpipe-0 Tainted: G        W  OE     5.19.8-200.fc36.x86_64+debug #1
Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1ubuntu1.1 04/01/2014
Complete report #550245
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff81077aeb
Build id: 3.10.0-229.14.1.el7.x86_64
0x9b
BUG: soft lockup - CPU#7 stuck for 32s! [scsi_eh_0:643]
Modules linked in: binfmt_misc tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables dahdi(OF) crc_ccitt netatop(OF) xt_CHECKSUM iptable_mangle xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype iptable_nat nf_nat_ipv4 nf_nat nf_log_ipv4 nf_log_common xt_LOG ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_recent xt_multiport xt_mark xt_conntrack nf_conntrack iptable_filter ext4 mbcache jbd2 coretemp snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus snd_seq ghash_clmulni_intel snd_seq_device snd_pcm aesni_intel lrw ppdev snd_timer gf128mul glue_helper snd vmw_balloon ablk_helper cryptd ahci soundcore pcspkr libahci i2c_piix4 sg vmw_vmci shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod
crc_t10dif crct10dif_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper crc32c_intel ttm serio_raw mptspi scsi_transport_spi ata_piix drm e1000 mptscsih libata mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 643 Comm: scsi_eh_0 Tainted: GF          O--------------   3.10.0-229.14.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff88032ca84fa0 ti: ffff880326bc4000 task.ti: ffff880326bc4000
RIP: 0010:[<ffffffff81077aeb>]  [<ffffffff81077aeb>] __do_softirq+0x9b/0x280
RSP: 0018:ffff8803326e3ee8  EFLAGS: 00000206
RAX: ffff880326bc7fd8 RBX: ffff8803326e3e70 RCX: 0000000000000007
RDX: 00000001047e7047 RSI: 0000000000000000 RDI: ffff88032ca84fa0
RBP: ffff8803326e3f48 R08: ffffffff81a23f08 R09: ffff88033fbd5740
R10: 000000000000009c R11: 0000000000000002 R12: ffff8803326e3e58
R13: ffffffff81614fdd R14: ffff8803326e3f48 R15: ffff880326bc7fd8
FS:  0000000000000000(0000) GS:ffff8803326e0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc76807e978 CR3: 00000000ba4e5000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880326bc7fd8 0000000a0020a040 00000001047e7049 ffff8803326e3f10
ffff880326bc7fd8 ffff880326bc7fd8 ffffffff00000007 ffff880326bc7fd8
0000000000000046 ffffffffa00828e0 ffffffffa0081760 0000000000000202
Call Trace:
Complete report #540787
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffffa92a4d2a
Build id: 3.10.0-1160.76.1.el7.x86_64
0x9a
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [gmain:2766]
Modules linked in: vfio_pci irqbypass vfio_iommu_type1 vfio tcp_lp rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus btusb aesni_intel snd_seq btrtl
vmw_balloon btbcm lrw gf128mul glue_helper btintel snd_seq_device ablk_helper cryptd bluetooth snd_pcm joydev pcspkr snd_timer snd rfkill sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix nfit crct10dif_pclmul crct10dif_common crc32c_intel drm libnvdimm libata serio_raw mptspi scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks fuse
CPU: 1 PID: 2766 Comm: gmain Kdump: loaded Tainted: G     U       L ------------   3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9ae795b4d280 ti: ffff9ae78f658000 task.ti: ffff9ae78f658000
RIP: 0010:[<ffffffffa92a4d2a>]  [<ffffffffa92a4d2a>] __do_softirq+0x9a/0x280
RSP: 0000:ffff9ae7b5643f20  EFLAGS: 00000206
RAX: ffff9ae78f65bfd8 RBX: ffff9ae7b5655ad8 RCX: 0000000000000001
RDX: 00000000fffec840 RSI: 00000000f2c40d05 RDI: ffff9ae795b4d280
RBP: ffff9ae7b5643f80 R08: 0000003344774800 R09: 0000000000000001
R10: 0000000000000005 R11: 0000000000000000 R12: ffff9ae7b5643e98
R13: ffffffffa999afba R14: ffff9ae7b5643f80 R15: ffff9ae78f65bfd8
FS:  00007f3e11b59700(0000) GS:ffff9ae7b5640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd1791f69a0 CR3: 000000020f480000 CR4: 00000000003607e0
Call Trace:
Complete report #128
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff8daa5637
Build id: 3.10.0-1127.13.1.el7.x86_64
0x97
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 27s! [kworker/0:1:23769]
Modules linked in: nf_conntrack_netlink nfnetlink binfmt_misc vboxnetadp(OE) vboxnetflt(OE) xt_conntrack iptable_filter xt_REDIRECT nf_nat_redirect vboxdrv(OE) iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ppdev sg virtio_balloon parport_pc parport i2c_piix4 pcspkr joydev auth_rpcgss sunrpc ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi virtio_net virtio_scsi net_failover virtio_console failover bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crc32c_intel serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 23769 Comm: kworker/0:1 Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org 04/01/2014
Workqueue: events_freezable update_balloon_stats_func [virtio_balloon]
task: ffff8ecf64d95230 ti: ffff8ecfbb5ac000 task.ti: ffff8ecfbb5ac000
RIP: 0010:[<ffffffff8daa5637>]  [<ffffffff8daa5637>] __do_softirq+0x97/0x280
RSP: 0018:ffff8ed1bfc03f20  EFLAGS: 00000206
RAX: ffff8ecfbb5affd8 RBX: ffff8ed1bfc15ad8 RCX: 0000000000000000
RDX: 00000001007c0a04 RSI: 0000000025470238 RDI: ffff8ecf64d95230
RBP: ffff8ed1bfc03f80 R08: 00000000e1dfdbc7 R09: 0000000000000101
R10: 000000000000ba7e R11: 0000000000000005 R12: ffff8ed1bfc03e98
R13: ffffffff8e193efa R14: ffff8ed1bfc03f80 R15: ffff8ecfbb5affd8
FS:  0000000000000000(0000) GS:ffff8ed1bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055ea52f90cb8 CR3: 000000026667e000 CR4: 00000000000007f0
Call Trace:
Complete report #444863
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffffb0ea4b3a
Build id: 3.10.0-1160.el7.x86_64
0x9a
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [gitaly:3085]
Modules linked in: veth br_netfilter tun devlink overlay(T) bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi crc32_pclmul ac97_bus ghash_clmulni_intel snd_seq snd_seq_device aesni_intel snd_pcm lrw gf128mul ppdev glue_helper ablk_helper cryptd snd_timer vmw_balloon snd soundcore joydev sg pcspkr i2c_piix4 vmw_vmci parport_pc parport xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea sysfillrect crc32c_intel sysimgblt fb_sys_fops ttm nfit libnvdimm drm serio_raw mptspi e1000 scsi_transport_spi ata_piix mptscsih libata mptbase drm_panel_orientation_quirks
fuse [last unloaded: ip_tables]
CPU: 1 PID: 3085 Comm: gitaly Kdump: loaded Tainted: G    B        L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9c84f7b6d280 ti: ffff9c85a047c000 task.ti: ffff9c85a047c000
RIP: 0010:[<ffffffffb0ea4b3a>]  [<ffffffffb0ea4b3a>] __do_softirq+0x9a/0x280
RSP: 0018:ffff9c85b9643f00  EFLAGS: 00000206
RAX: ffff9c85a047ffd8 RBX: ffff9c85afd66000 RCX: 0000000000000001
RDX: 000000021ffae720 RSI: 0000000000000000 RDI: ffff9c84f7b6d280
RBP: ffff9c85b9643f60 R08: 00000000003c265b R09: ffff9c85a047fe18
R10: 0000000000000001 R11: 000000000000bb95 R12: ffff9c85b9643e78
R13: ffffffffb1594fba R14: ffff9c85b9643f60 R15: ffff9c85a047ffd8
FS:  00007fe1475fe700(0000) GS:ffff9c85b9640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4cd058d400 CR3: 000000012d9aa000 CR4: 00000000003607e0
Call Trace:
Complete report #411189
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff8e200059
Build id: 5.18.0-0.rc0.20220325git34af78c4e616.7.fc37.x86_64
0x59
BUG: sleeping function called from invalid context at block/blk-sysfs.c:766
in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 9677, name: gnome-shell
preempt_count: 100, expected: 0
RCU nest depth: 0, expected: 0
INFO: lockdep is turned off.
Preemption disabled at:
[<ffffffff8e200059>] __do_softirq+0x59/0x597
CPU: 0 PID: 9677 Comm: gnome-shell Tainted: G    B   W        --------- ---  5.18.0-0.rc0.20220325git34af78c4e616.7.fc37.x86_64 #1
Hardware name: Dell Inc. Latitude 5480/0R75NX, BIOS 1.23.1 12/15/2021
Complete report #393312
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffffb0200059
Build id: 5.18.0-0.rc1.18.fc37.x86_64+debug
0x59
BUG: sleeping function called from invalid context at include/linux/sched/mm.h:257
in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 420060, name: WebExtensions
preempt_count: 102, expected: 0
RCU nest depth: 0, expected: 0
INFO: lockdep is turned off.
irq event stamp: 0
hardirqs last  enabled at (0): [<0000000000000000>] 0x0
hardirqs last disabled at (0): [<ffffffffaf0e88c1>] copy_process+0x9f1/0x1e20
softirqs last  enabled at (0): [<ffffffffaf0e88c1>] copy_process+0x9f1/0x1e20
softirqs last disabled at (0): [<0000000000000000>] 0x0
Preemption disabled at:
[<ffffffffb0200059>] __do_softirq+0x59/0x597
CPU: 18 PID: 420060 Comm: WebExtensions Tainted: G    B   W  OEL   --------- ---  5.18.0-0.rc1.18.fc37.x86_64+debug #1
Hardware name: System manufacturer System Product Name/ROG STRIX X570-I GAMING, BIOS 4204 02/24/2022
Complete report #69846
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffffb02a4b37
Build id: 3.10.0-1160.11.1.el7.x86_64
0x97
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [khugepaged:47]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_10912(E) xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc cmac arc4 md4 nls_utf8 cifs ccm dns_resolver overlay(T) vmw_vsock_vmci_transport vsock ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common
crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect serio_raw sysimgblt fb_sys_fops ttm ahci drm vmxnet3 libahci ata_piix vmw_pvscsi libata nfit libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 47 Comm: khugepaged Kdump: loaded Tainted: P            EL ------------ T 3.10.0-1160.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9b04f6ba5280 ti: ffff9b04f7fd0000 task.ti: ffff9b04f7fd0000
RIP: 0010:[<ffffffffb02a4b37>]  [<ffffffffb02a4b37>] __do_softirq+0x97/0x280
RSP: 0018:ffff9b07ad683f10  EFLAGS: 00000206
RAX: ffff9b04f7fd3fd8 RBX: ffff9b07ad683ea0 RCX: 0000000000000002
RDX: 000000016279ac52 RSI: 0000000000000086 RDI: ffff9b04f6ba5280
RBP: ffff9b07ad683f70 R08: ffffffffb0a1e640 R09: ffff9b04f6ba5280
R10: 0000000000000000 R11: 0000000000000000 R12: ffff9b07ad683e88
R13: ffffffffb0994fba R14: ffff9b07ad683f70 R15: ffff9b04f7fd3fd8
FS:  0000000000000000(0000) GS:ffff9b07ad680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5442628698 CR3: 000000042ae0c000 CR4: 00000000000007e0
Call Trace:
Complete report #21573
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffffaaca0eea
Build id: 3.10.0-957.5.1.el7.x86_64
0x9a
NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [lspci:9935]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:0:5216]
Modules linked in: plda(OE) sunrpc dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd wdat_wdt pcspkr sg igb i2c_i801 nvme ixgbe i2c_algo_bit nvme_core lpc_ich ioatdma ptp pps_core mdio dca ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ahci libahci crct10dif_pclmul crct10dif_common crc32c_intel libata
CPU: 0 PID: 5216 Comm: kworker/0:0 Kdump: loaded Tainted: G        W IOE  ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: Inspur AliMoC-MD2-02/AliMoC-MD2-02, BIOS 1.0.GV.AL.P.012.01 06/19/2019
Workqueue: events aer_isr
task: ffff921ace2f0000 ti: ffff921a9d338000 task.ti: ffff921a9d338000
RIP: 0010:[<ffffffffaaca0eea>]  [<ffffffffaaca0eea>] __do_softirq+0x9a/0x280
RSP: 0018:ffff921adf403f20  EFLAGS: 00000206
RAX: ffff921a9d33bfd8 RBX: ffff921adf415a98 RCX: 0000000000000000
RDX: 0000000117b8bcde RSI: 000000007ad01909 RDI: ffff921ace2f0000
RBP: ffff921adf403f80 R08: 00016a3c7937e940 R09: 0000000000000a40
R10: 0000000000000000 R11: ffff921adf403de8 R12: ffff921adf403e98
R13: ffffffffab375df2 R14: ffff921adf403f80 R15: ffff921a9d33bfd8
FS:  0000000000000000(0000) GS:ffff921adf400000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f42080062e8 CR3: 00000005c5010000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
Complete report #17354
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff85aa5637
Build id: 3.10.0-1127.19.1.el7.x86_64
0x97
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 24s! [kworker/u64:0:16505]
Modules linked in: arc4 md4 nls_utf8 cifs ccm dns_resolver fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ppdev vmw_balloon pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_common vmwgfx
drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel ata_piix serio_raw drm libata mptspi scsi_transport_spi nfit libnvdimm mptscsih vmxnet3 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: vmfsrtx_bridge_helper]
CPU: 1 PID: 16505 Comm: kworker/u64:0 Kdump: loaded Tainted: P        W  OEL ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: writeback bdi_writeback_workfn (flush-253:0)
task: ffff92a4f65762a0 ti: ffff92a44b2bc000 task.ti: ffff92a44b2bc000
RIP: 0010:[<ffffffff85aa5637>]  [<ffffffff85aa5637>] __do_softirq+0x97/0x280
RSP: 0018:ffff92a57ae43f10  EFLAGS: 00000206
RAX: ffff92a44b2bffd8 RBX: ffff92a57ae43ea0 RCX: 0000000000000001
RDX: 000000013756a8d4 RSI: 0000000000000082 RDI: ffff92a4f65762a0
RBP: ffff92a57ae43f70 R08: ffffffff8621e540 R09: ffff92a4f65762a0
R10: ffff92a4754a1400 R11: ffff92a4432a7800 R12: ffff92a57ae43e88
R13: ffffffff86193efa R14: ffff92a57ae43f70 R15: ffff92a44b2bffd8
FS:  0000000000000000(0000) GS:ffff92a57ae40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000034158c2470e0 CR3: 000000001ae10000 CR4: 00000000000007e0
Call Trace:
Complete report #10974
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff8108f27b
Build id: 3.10.0-514.10.2.el7.x86_64
0x9b
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [chebBaroCavity_:192509]
Modules linked in: osc(OE) mgc(OE) lustre(OE) lmv(OE) fld(OE) mdc(OE) fid(OE) lov(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) sha512_ssse3 sha512_generic crypto_null libcfs(OE) rpcsec_gss_krb5 dell_rbu nfsv4 dns_resolver nfs fscache dm_mirror dm_region_hash dm_log dm_mod intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass mgag200 crc32_pclmul ttm ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt aesni_intel fb_sys_fops lrw gf128mul iTCO_wdt glue_helper drm ablk_helper cryptd iTCO_vendor_support dcdbas mxm_wmi sb_edac cdc_ether mei_me usbnet mei edac_core lpc_ich pcspkr mii shpchp wmi tpm_crb acpi_power_meter rpcrdma ib_isert iscsi_target_mod target_core_mod crc_t10dif crct10dif_generic ib_iser libiscsi scsi_transport_iscsi ib_ipoib rdma_ucm ib_ucm ib_uverbs
ib_umad rdma_cm ib_cm iw_cm nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ipmi_devintf hfi1(OE) ahci rdmavt(OE) libahci ixgbe dca mdio ib_core crct10dif_pclmul ptp crct10dif_common i2c_algo_bit pps_core ipmi_si crc32c_intel libata i2c_core fjes ipmi_msghandler
CPU: 0 PID: 192509 Comm: chebBaroCavity_ Tainted: G        W  OE  ------------   3.10.0-514.10.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge C6320/082F9M, BIOS 2.1.5 04/12/2016
task: ffff8816b1a01f60 ti: ffff8816b57a0000 task.ti: ffff8816b57a0000
RIP: 0010:[<ffffffff8108f27b>]  [<ffffffff8108f27b>] __do_softirq+0x9b/0x280
RSP: 0018:ffff88103e603ee0  EFLAGS: 00000206
RAX: ffff8816b57a3fd8 RBX: ffff88103e603e88 RCX: 0000000000000000
RDX: 00000001e75a4cdc RSI: 000000001c103bef RDI: ffff8816b1a01f60
RBP: ffff88103e603f40 R08: 000dca6f78aca700 R09: ffff88103e603d98
R10: 0000000000000000 R11: ffff88103e603da0 R12: ffff88103e603e58
R13: ffffffff8169775d R14: ffff88103e603f40 R15: ffff8816b57a3fd8
FS:  00007f8f91948740(0000) GS:ffff88103e600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8f89c05940 CR3: 0000002030e5f000 CR4: 00000000003407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff8816b57a3fd8 0000000a00402100 00000001e75a4cde ffffffff810f0e6b
ffff8816b57a3fd8 ffff8816b57a3fd8 ffff881000000000 ffff8816b57a3fd8
0000000000000046 0000000000000004 0000000000000009 00007f8f00000000
Call Trace:
Complete report #2497
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff8108f0ab
Build id: 3.10.0-514.el7.x86_64
0x9b
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 26s! [grep:22407]
Modules linked in: arc4 md4 nls_utf8 cifs dns_resolver ext4 mbcache jbd2 loop fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dvfd(OE) hcpdriver(POE) vmw_vsock_vmci_transport vsock intel_powerclamp coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon i2c_piix4 sg parport_pc vmw_vmci shpchp parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
mptspi sysimgblt fb_sys_fops ata_piix scsi_transport_spi mptscsih ttm crct10dif_pclmul crct10dif_common serio_raw crc32c_intel drm vmxnet3 libata mptbase i2c_core floppy fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 22407 Comm: grep Tainted: P           OEL ------------   3.10.0-514.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff8800b06a0000 ti: ffff88009ed80000 task.ti: ffff88009ed80000
RIP: 0010:[<ffffffff8108f0ab>]  [<ffffffff8108f0ab>] __do_softirq+0x9b/0x280
RSP: 0000:ffff88023fd03ee0  EFLAGS: 00000206
RAX: ffff88009ed83fd8 RBX: 0000000000004b77 RCX: 0000000000000004
RDX: 00000001013805ed RSI: 0000000000000da3 RDI: ffff8800b06a0000
RBP: ffff88023fd03f40 R08: 000012de24d55380 R09: 0000000000000dc9
R10: 0000000000000000 R11: ffff88023fd03da0 R12: ffff88023fd03e58
R13: ffffffff8169721d R14: ffff88023fd03f40 R15: ffff88009ed83fd8
FS:  00007f2798468740(0000) GS:ffff88023fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001046008 CR3: 0000000230b7d000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88009ed83fd8 0000000a00402000 00000001013805ef ffffffff810f0c6b
ffff88009ed83fd8 ffff88009ed83fd8 ffff880200000004 ffff88009ed83fd8
0000000000000046 ffff8802306a4040 0000000000000000 ffff880224f2c948
Call Trace:
Complete report #3459
Frame # Function Binary Source or offset Line
1
__do_softirq
vmlinux 0xffffffff8108f0a8
Build id: 3.10.0-514.el7.x86_64
0x98
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [python3:26895]
Modules linked in: xt_REDIRECT nf_nat_redirect ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_nat_ipv4 nf_nat br_netfilter bridge stp llc overlay(T) ipmi_devintf gpio_ich iTCO_wdt iTCO_vendor_support dcdbas intel_powerclamp coretemp kvm irqbypass ipmi_ssif pcspkr sg ipmi_si ipmi_msghandler lpc_ich i7core_edac edac_core shpchp wmi acpi_power_meter nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_common sr_mod cdrom ata_generic pata_acpi mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crc32c_intel drm serio_raw
mptsas libata scsi_transport_sas mptscsih i2c_core mptbase bnx2 fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 26895 Comm: python3 Tainted: G        W I  L ------------ T 3.10.0-514.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R410/0WWR83, BIOS 1.11.0 07/20/2012
task: ffff8806cc15edd0 ti: ffff88069ab20000 task.ti: ffff88069ab20000
RIP: 0010:[<ffffffff8108f0a8>]  [<ffffffff8108f0a8>] __do_softirq+0x98/0x280
RSP: 0018:ffff88042fa83ee8  EFLAGS: 00000206
RAX: ffff88069ab23fd8 RBX: ffffffff815700b0 RCX: 0000000000000005
RDX: 000000012190fa36 RSI: 0000000000000000 RDI: ffff8806cc15edd0
RBP: ffff88042fa83f48 R08: 0000000000000000 R09: ffff88082cea6f00
R10: 00000000000003ff R11: 0000000000000001 R12: ffff88042fa83e58
R13: ffffffff8169721d R14: ffff88042fa83f48 R15: ffff88069ab23fd8
FS:  00007faff0ff9700(0000) GS:ffff88042fa80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbef4115ba0 CR3: 000000021ce7c000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88069ab23fd8 0000000a00402040 000000012190fa38 0000000000000003
ffff88069ab23fd8 ffff88069ab23fd8 0000010000000005 ffff88069ab23fd8
0000000000000046 ffffffff81dd4114 0000000000000003 00000000000000a3
Call Trace: