| Operating system | Count |
|---|---|
| CentOS 7 | 55 |
| Architecture | Count |
|---|---|
| x86_64 | 55 |
| Related packages | Count |
|---|---|
| kernel | 55 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
No reports in the last 20 days.
No reports in the last 20 weeks.
WARNING: CPU: 1 PID: 32531 at /tmp/selfgz35379/NVIDIA-Linux-x86_64-440.100/kernel/nvidia/nv.c:4391 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache dm_mirror dm_region_hash dm_log dm_mod nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel snd_hda_codec_hdmi nvidia(POE) kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq pcspkr snd_seq_device joydev snd_pcm ipmi_ssif snd_timer snd i2c_i801 sg mei_me soundcore lpc_ich mei ioatdma shpchp ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mxm_wmi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci igb libahci crct10dif_pclmul crct10dif_common ptp libata crc32c_intel pps_core dca i2c_algo_bit i2c_core wmi CPU: 1 PID: 32531 Comm: python3 Kdump: loaded Tainted: P OE ------------ 3.10.0-862.9.1.el7.x86_64 #1 Hardware name: Supermicro SYS-4028GR-TR/X10DRG-O+-CPU, BIOS 3.0b 04/12/2018 Call Trace: [<ffffffffa610e84e>] dump_stack+0x19/0x1b [<ffffffffa5a91e18>] __warn+0xd8/0x100 [<ffffffffa5a91f5d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc0a0fcda>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc0a1f6bd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc205895d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc205e1d8>] uvm_va_space_destroy+0x3c8/0x420 [nvidia_uvm] [<ffffffffc204cfc0>] uvm_release.isra.4+0x80/0xa0 [nvidia_uvm] [<ffffffffc204d0a4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffa5c1d74c>] __fput+0xec/0x260 [<ffffffffa5c1d9ae>] ____fput+0xe/0x10 [<ffffffffa5ab803b>] task_work_run+0xbb/0xe0 [<ffffffffa5a97f21>] do_exit+0x2d1/0xa40 [<ffffffffa5a54e82>] ? native_smp_send_reschedule+0x52/0x70 [<ffffffffa5ac4f0a>] ? kick_process+0x4a/0x50 [<ffffffffa5aa68fa>] ? signal_wake_up_state+0x2a/0x30 [<ffffffffa5aa7ce2>] ? zap_other_threads+0x92/0xc0 [<ffffffffa5a9870f>] do_group_exit+0x3f/0xa0 [<ffffffffa5aa8fbe>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffa5a2a527>] do_signal+0x57/0x6e0 [<ffffffffa5a2ac22>] do_notify_resume+0x72/0xc0 [<ffffffffa6120adb>] int_signal+0x12/0x17
WARNING: CPU: 10 PID: 18057 at /tmp/selfgz30101/NVIDIA-Linux-x86_64-550.127.05/kernel/nvidia/nv.c:5197 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: tcp_diag inet_diag 8021q garp mrp veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache nvidia_uvm(OE) rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt sunrpc ib_ipoib rdma_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support bnxt_re ib_core nfit libnvdimm intel_powerclamp coretemp intel_rapl iosf_mbi vfat fat kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd dell_smbios dcdbas dell_wmi_descriptor pcspkr sg i2c_i801 mei_me mei ipmi_si ipmi_devintf ipmi_msghandler pinctrl_lewisburg pinctrl_intel acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif nvidia_drm(POE) crct10dif_generic nvidia_modeset(POE) nvidia(POE) mgag200 i2c_algo_bit drm_kms_helper syscopyarea ttm sysfillrect sysimgblt fb_sys_fops ahci drm libahci bnxt_en megaraid_sas crct10dif_pclmul tg3 crct10dif_common crc32c_intel libata devlink ptp pps_core drm_panel_orientation_quirks wmi fuse CPU: 10 PID: 18057 Comm: python Kdump: loaded Tainted: P OE ------------ T 3.10.0-1160.el7.x86_64 #1 Hardware name: Dell Inc. PowerEdge R750/0K8F35, BIOS 1.13.2 12/19/2023 Call Trace: [<ffffffff86f81340>] dump_stack+0x19/0x1b [<ffffffff8689b228>] __warn+0xd8/0x100 [<ffffffff8689b36d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc060f26a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc062255d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc46ff219>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc47053cd>] uvm_va_space_destroy+0x35d/0x400 [nvidia_uvm] [<ffffffffc46ef6b0>] uvm_release.isra.12+0xa0/0x130 [nvidia_uvm] [<ffffffffc46ef804>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff86a4fe4c>] __fput+0xec/0x230 [<ffffffff86a5007e>] ____fput+0xe/0x10 [<ffffffff868c275b>] task_work_run+0xbb/0xe0 [<ffffffff868a1904>] do_exit+0x2d4/0xa20 [<ffffffff86912f3f>] ? futex_wait+0x11f/0x280 [<ffffffff868e43cc>] ? update_curr+0x14c/0x1e0 [<ffffffff868a20cf>] do_group_exit+0x3f/0xa0 [<ffffffff868b307e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff8682c527>] do_signal+0x57/0x6f0 [<ffffffff86914d06>] ? do_futex+0x106/0x5a0 [<ffffffff86f87169>] ? schedule+0x29/0x70 [<ffffffff8682cc32>] do_notify_resume+0x72/0xc0 [<ffffffff86f942ef>] int_signal+0x12/0x17
WARNING: CPU: 30 PID: 4992 at /tmp/selfgz9047/NVIDIA-Linux-x86_64-525.89.02/kernel/nvidia/nv.c:4796 nvidia_dev_put_uuid+0x5e/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter lm75 sunrpc dm_mirror dm_region_hash dm_log eeepc_wmi asus_wmi iTCO_wdt sparse_keymap rfkill iTCO_vendor_support video mxm_wmi intel_wmi_thunderbolt nvidia_drm(POE) nvidia_modeset(POE) raid456 nvidia(POE) async_raid6_recov async_memcpy async_pq snd_hda_codec_hdmi intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel raid6_pq kvm libcrc32c async_xor xor snd_hda_codec_realtek async_tx snd_hda_codec_generic irqbypass drm_kms_helper crc32_pclmul ghash_clmulni_intel aesni_intel syscopyarea sysfillrect snd_hda_intel sysimgblt fb_sys_fops lrw gf128mul glue_helper snd_hda_codec ablk_helper drm cryptd snd_hda_core snd_seq pcspkr snd_hwdep snd_seq_device dm_mod snd_pcm joydev drm_panel_orientation_quirks snd_timer snd i2c_i801 sg soundcore mei_me mei wmi ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ixgbe ahci libahci crct10dif_pclmul crct10dif_common crc32c_intel libata mdio ptp pps_core serio_raw dca nvme nvme_core nfit libnvdimm fuse CPU: 30 PID: 4992 Comm: cuda-EvtHandlr Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.119.1.el7.x86_64 #1 Hardware name: System manufacturer System Product Name/WS X299 SAGE/10G, BIOS 3203 06/10/2020 Call Trace: [<ffffffffb41b1bec>] dump_stack+0x19/0x1f [<ffffffffb3a9f868>] __warn+0xd8/0x100 [<ffffffffb3a9f9ad>] warn_slowpath_null+0x1d/0x30 [<ffffffffc1db22ce>] nvidia_dev_put_uuid+0x5e/0x60 [nvidia] [<ffffffffc1dc598d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc0cd8b19>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc0cde720>] uvm_va_space_destroy+0x330/0x3c0 [nvidia_uvm] [<ffffffffc0cca8c8>] uvm_release.isra.4+0x88/0xa0 [nvidia_uvm] [<ffffffffc0cca9a4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffb3c5dfcc>] __fput+0xec/0x230 [<ffffffffb3c5e1fe>] ____fput+0xe/0x20 [<ffffffffb3ac7f6b>] task_work_run+0xbb/0xe0 [<ffffffffb3aa6174>] do_exit+0x2d4/0xa30 [<ffffffffb3aa694f>] do_group_exit+0x3f/0xa0 [<ffffffffb3ab825e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffb3a2d5b7>] do_signal+0x57/0x6f0 [<ffffffffb3a2dcca>] do_notify_resume+0x7a/0xd0 [<ffffffffb41c56f7>] int_signal+0x12/0x17
WARNING: CPU: 53 PID: 44995 at /tmp/selfgz185146/NVIDIA-Linux-x86_64-550.127.08/kernel/nvidia/nv.c:5197 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: tcp_diag udp_diag inet_diag unix_diag nvidia_uvm(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc iTCO_wdt iTCO_vendor_support nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel vfat fat kvm snd_hda_codec_realtek irqbypass crc32_pclmul snd_hda_codec_generic ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper snd_hda_intel cryptd snd_hda_codec snd_hda_core pcspkr intel_wmi_thunderbolt snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd i2c_i801 lpc_ich soundcore sg mei_me joydev mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm ahci crc32c_intel ixgbe libahci libata nvme mdio ptp nvme_core pps_core nfit drm_panel_orientation_quirks dca wmi libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 53 PID: 44995 Comm: cuda00001800007 Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.el7.x86_64 #1 Hardware name: Supermicro SYS-7049GP-TRT/X11DPG-QT, BIOS 3.4a 03/15/2021 Call Trace: [<ffffffff8e781340>] dump_stack+0x19/0x1b [<ffffffff8e09b228>] __warn+0xd8/0x100 [<ffffffff8e09b36d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc4b1726a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc4b2a55d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc177b219>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc17813cd>] uvm_va_space_destroy+0x35d/0x400 [nvidia_uvm] [<ffffffffc176b6b0>] uvm_release.isra.12+0xa0/0x130 [nvidia_uvm] [<ffffffffc176b804>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff8e24fe4c>] __fput+0xec/0x230 [<ffffffff8e25007e>] ____fput+0xe/0x10 [<ffffffff8e0c275b>] task_work_run+0xbb/0xe0 [<ffffffff8e0a1904>] do_exit+0x2d4/0xa20 [<ffffffff8e263e50>] ? __pollwait+0xf0/0xf0 [<ffffffff8e0a20cf>] do_group_exit+0x3f/0xa0 [<ffffffff8e0b307e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff8e02c527>] do_signal+0x57/0x6f0 [<ffffffff8e02cc32>] do_notify_resume+0x72/0xc0 [<ffffffff8e7942ef>] int_signal+0x12/0x17
WARNING: CPU: 90 PID: 68201 at /tmp/selfgz185146/NVIDIA-Linux-x86_64-550.127.08/kernel/nvidia/nv.c:5197 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc iTCO_wdt iTCO_vendor_support nvidia_drm(POE) nvidia_modeset(POE) skx_edac intel_powerclamp coretemp intel_rapl nvidia(POE) iosf_mbi vfat fat kvm_intel kvm snd_hda_codec_realtek snd_hda_codec_generic irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw snd_hda_intel gf128mul glue_helper ablk_helper cryptd snd_hda_codec snd_hda_core snd_hwdep pcspkr intel_wmi_thunderbolt snd_seq snd_seq_device snd_pcm snd_timer i2c_i801 snd lpc_ich soundcore sg mei_me joydev mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast crct10dif_pclmul crct10dif_common i2c_algo_bit crc32c_intel ixgbe drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm nvme libata mdio ptp nvme_core pps_core dca drm_panel_orientation_quirks wmi nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 90 PID: 68201 Comm: python Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.el7.x86_64 #1 Hardware name: Supermicro SYS-7049GP-TRT/X11DPG-QT, BIOS 3.4a 03/15/2021 Call Trace: [<ffffffffa4b81340>] dump_stack+0x19/0x1b [<ffffffffa449b228>] __warn+0xd8/0x100 [<ffffffffa449b36d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc152026a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc153355d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc48de219>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc48e43cd>] uvm_va_space_destroy+0x35d/0x400 [nvidia_uvm] [<ffffffffc48ce6b0>] uvm_release.isra.12+0xa0/0x130 [nvidia_uvm] [<ffffffffc48ce804>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffa464fe4c>] __fput+0xec/0x230 [<ffffffffa465007e>] ____fput+0xe/0x10 [<ffffffffa44c275b>] task_work_run+0xbb/0xe0 [<ffffffffa44a1904>] do_exit+0x2d4/0xa20 [<ffffffffa4512f3f>] ? futex_wait+0x11f/0x280 [<ffffffffa44d7229>] ? ttwu_do_wakeup+0x19/0xe0 [<ffffffffa44a20cf>] do_group_exit+0x3f/0xa0 [<ffffffffa44b307e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffa442c527>] do_signal+0x57/0x6f0 [<ffffffffa4514d06>] ? do_futex+0x106/0x5a0 [<ffffffffa442cc32>] do_notify_resume+0x72/0xc0 [<ffffffffa4b942ef>] int_signal+0x12/0x17
WARNING: CPU: 26 PID: 13639 at /tmp/selfgz185146/NVIDIA-Linux-x86_64-550.127.08/kernel/nvidia/nv.c:5197 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: tcp_diag udp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter nvidia_uvm(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc iTCO_wdt iTCO_vendor_support nvidia_drm(POE) nvidia_modeset(POE) vfat fat nvidia(POE) skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_realtek lrw gf128mul glue_helper snd_hda_codec_generic ablk_helper cryptd snd_hda_intel pcspkr snd_hda_codec intel_wmi_thunderbolt snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd i2c_i801 lpc_ich soundcore joydev sg mei_me mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea sysfillrect crc32c_intel sysimgblt fb_sys_fops ttm ahci drm libahci ixgbe libata nvme mdio nvme_core ptp nfit drm_panel_orientation_quirks pps_core dca wmi libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 26 PID: 13639 Comm: cuda00001800007 Kdump: loaded Tainted: P W OE ------------ 3.10.0-1160.el7.x86_64 #1 Hardware name: Supermicro SYS-7049GP-TRT/X11DPG-QT, BIOS 3.4a 03/15/2021 Call Trace: [<ffffffff89d81340>] dump_stack+0x19/0x1b [<ffffffff8969b228>] __warn+0xd8/0x100 [<ffffffff8969b36d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc159526a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc15a855d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc4953219>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc49593cd>] uvm_va_space_destroy+0x35d/0x400 [nvidia_uvm] [<ffffffffc49436b0>] uvm_release.isra.12+0xa0/0x130 [nvidia_uvm] [<ffffffffc4943804>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff8984fe4c>] __fput+0xec/0x230 [<ffffffff8985007e>] ____fput+0xe/0x10 [<ffffffff896c275b>] task_work_run+0xbb/0xe0 [<ffffffff896a1904>] do_exit+0x2d4/0xa20 [<ffffffff89863e50>] ? __pollwait+0xf0/0xf0 [<ffffffff896a20cf>] do_group_exit+0x3f/0xa0 [<ffffffff896b307e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff8962c527>] do_signal+0x57/0x6f0 [<ffffffff8962cc32>] do_notify_resume+0x72/0xc0 [<ffffffff89d942ef>] int_signal+0x12/0x17
WARNING: CPU: 69 PID: 29811 at /tmp/selfgz185146/NVIDIA-Linux-x86_64-550.127.08/kernel/nvidia/nv.c:5197 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc iTCO_wdt iTCO_vendor_support nvidia_drm(POE) nvidia_modeset(POE) vfat fat snd_hda_codec_realtek nvidia(POE) snd_hda_codec_generic skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel pcspkr intel_wmi_thunderbolt snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd lpc_ich i2c_i801 soundcore joydev mei_me sg mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ahci ixgbe libahci nvme libata nvme_core mdio drm_panel_orientation_quirks ptp pps_core dca wmi nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 69 PID: 29811 Comm: python Kdump: loaded Tainted: P W OE ------------ 3.10.0-1160.el7.x86_64 #1 Hardware name: Supermicro SYS-7049GP-TRT/X11DPG-QT, BIOS 3.4a 03/15/2021 Call Trace: [<ffffffffb6181340>] dump_stack+0x19/0x1b [<ffffffffb5a9b228>] __warn+0xd8/0x100 [<ffffffffb5a9b36d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc154e26a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc156155d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc490c219>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc49123cd>] uvm_va_space_destroy+0x35d/0x400 [nvidia_uvm] [<ffffffffc48fc6b0>] uvm_release.isra.12+0xa0/0x130 [nvidia_uvm] [<ffffffffc48fc804>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffb5c4fe4c>] __fput+0xec/0x230 [<ffffffffb5c5007e>] ____fput+0xe/0x10 [<ffffffffb5ac275b>] task_work_run+0xbb/0xe0 [<ffffffffb5aa1904>] do_exit+0x2d4/0xa20 [<ffffffffb5b12f3f>] ? futex_wait+0x11f/0x280 [<ffffffffb5aa20cf>] do_group_exit+0x3f/0xa0 [<ffffffffb5ab307e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffb5a2c527>] do_signal+0x57/0x6f0 [<ffffffffb5b14d06>] ? do_futex+0x106/0x5a0 [<ffffffffb5a2cc32>] do_notify_resume+0x72/0xc0 [<ffffffffb61942ef>] int_signal+0x12/0x17
WARNING: CPU: 3 PID: 7368 at /var/lib/dkms/nvidia/470.74/build/nvidia/nv.c:4833 nvidia_dev_put_uuid+0x5e/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_CHECKSUM tun devlink ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc vfat fat iTCO_wdt iTCO_vendor_support nfit snd_hda_codec_hdmi libnvdimm intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel snd_hda_codec_realtek kvm snd_hda_codec_generic snd_hda_intel irqbypass crc32_pclmul snd_hda_codec ghash_clmulni_intel snd_hda_core aesni_intel snd_hwdep lrw gf128mul snd_seq glue_helper ablk_helper cryptd eeepc_wmi asus_wmi snd_seq_device sparse_keymap rfkill snd_pcm video intel_wmi_thunderbolt pcspkr sg snd_timer snd i2c_i801 soundcore mei_me mei ip_tables xfs libcrc32c nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci drm libahci igb libata e1000e crct10dif_pclmul crct10dif_common crc32c_intel mxm_wmi serio_raw dca ptp drm_panel_orientation_quirks pps_core i2c_algo_bit wmi dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 3 PID: 7368 Comm: pmemd.cuda Kdump: loaded Tainted: P OE ------------ T 3.10.0-1160.119.1.el7.x86_64 #1 Hardware name: System manufacturer System Product Name/WS X299 SAGE, BIOS 2002 10/03/2019 Call Trace: [<ffffffff8c9b1bec>] dump_stack+0x19/0x1f [<ffffffff8c29f868>] __warn+0xd8/0x100 [<ffffffff8c29f9ad>] warn_slowpath_null+0x1d/0x30 [<ffffffffc058737e>] nvidia_dev_put_uuid+0x5e/0x60 [nvidia] [<ffffffffc059917d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc2db9c6c>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc2dbf9b0>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc2dad068>] uvm_release.isra.5+0x88/0xa0 [nvidia_uvm] [<ffffffffc2dad144>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff8c45dfcc>] __fput+0xec/0x230 [<ffffffff8c45e1fe>] ____fput+0xe/0x20 [<ffffffff8c2c7f6b>] task_work_run+0xbb/0xe0 [<ffffffff8c2a6174>] do_exit+0x2d4/0xa30 [<ffffffff8c2e5134>] ? task_cputime+0x44/0x80 [<ffffffff8c2a694f>] do_group_exit+0x3f/0xa0 [<ffffffff8c2b825e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff8c22d5b7>] do_signal+0x57/0x6f0 [<ffffffff8c4588ba>] ? __check_object_size+0x1ca/0x250 [<ffffffff8c458810>] ? __check_object_size+0x120/0x250 [<ffffffff8c22dcca>] do_notify_resume+0x7a/0xd0 [<ffffffff8c9c56f7>] int_signal+0x12/0x17
WARNING: CPU: 1 PID: 17320 at /tmp/selfgz23050/NVIDIA-Linux-x86_64-550.67/kernel/nvidia/nv.c:5203 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_CHECKSUM tun devlink nfsv3 nfs_acl xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter bridge stp llc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nct6775 hwmon_vid sunrpc dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm snd_hda_codec_hdmi irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg snd_hda_intel snd_hda_codec i2c_i801 lpc_ich snd_hda_core snd_seq snd_hwdep snd_seq_device snd_pcm snd_timer snd soundcore mei_me mei shpchp ipmi_ssif ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables ext4 mbcache jbd2 nvidia_drm(POE) nvidia_modeset(POE) sd_mod crc_t10dif crct10dif_generic nvidia(POE) mxm_wmi ahci ast ttm libahci drm_kms_helper igb libata crct10dif_pclmul crct10dif_common syscopyarea sysfillrect crc32c_intel sysimgblt fb_sys_fops ixgbe drm i2c_algo_bit mdio ptp i2c_core pps_core dca wmi CPU: 1 PID: 17320 Comm: python Kdump: loaded Tainted: P OE ------------ T 3.10.0-862.el7.x86_64 #1 Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./EP2C612D16FM, BIOS L2.52C 07/17/2018 Call Trace: [<ffffffffa8f0d768>] dump_stack+0x19/0x1b [<ffffffffa88916d8>] __warn+0xd8/0x100 [<ffffffffa889181d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc074926a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc075c5ad>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc4026509>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc402c6bd>] uvm_va_space_destroy+0x35d/0x410 [nvidia_uvm] [<ffffffffc4016e68>] uvm_release.isra.12+0x98/0x120 [nvidia_uvm] [<ffffffffc4016fb4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffa8a1cf8c>] __fput+0xec/0x260 [<ffffffffa8a1d1ee>] ____fput+0xe/0x10 [<ffffffffa88b784b>] task_work_run+0xbb/0xe0 [<ffffffffa88977e1>] do_exit+0x2d1/0xa40 [<ffffffffa8904265>] ? futex_wait+0x1a5/0x280 [<ffffffffa8897fcf>] do_group_exit+0x3f/0xa0 [<ffffffffa88a887e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffa882a527>] do_signal+0x57/0x6e0 [<ffffffffa8905f96>] ? do_futex+0x106/0x5a0 [<ffffffffa8e061f0>] ? sk_run_filter+0x550/0x760 [<ffffffffa892f3d6>] ? __audit_syscall_exit+0x1e6/0x280 [<ffffffffa882ac22>] do_notify_resume+0x72/0xc0 [<ffffffffa8f1fb1d>] int_signal+0x12/0x17
WARNING: CPU: 89 PID: 291376 at /tmp/selfgz185146/NVIDIA-Linux-x86_64-550.127.08/kernel/nvidia/nv.c:5197 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter devlink ebtables ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc iTCO_wdt iTCO_vendor_support nvidia_drm(POE) nvidia_modeset(POE) vfat fat nvidia(POE) skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_realtek lrw gf128mul glue_helper ablk_helper cryptd snd_hda_codec_generic snd_hda_intel snd_hda_codec pcspkr intel_wmi_thunderbolt snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd i2c_i801 soundcore lpc_ich joydev mei_me sg mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci crct10dif_pclmul ixgbe crct10dif_common crc32c_intel libata nvme mdio ptp nvme_core pps_core drm_panel_orientation_quirks dca nfit wmi libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 89 PID: 291376 Comm: run_alphafold.p Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.el7.x86_64 #1 Hardware name: Supermicro SYS-7049GP-TRT/X11DPG-QT, BIOS 3.4a 03/15/2021 Call Trace: [<ffffffff9cd81340>] dump_stack+0x19/0x1b [<ffffffff9c69b228>] __warn+0xd8/0x100 [<ffffffff9c69b36d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc150826a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc151b55d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc48c6219>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc48cc3cd>] uvm_va_space_destroy+0x35d/0x400 [nvidia_uvm] [<ffffffffc48b66b0>] uvm_release.isra.12+0xa0/0x130 [nvidia_uvm] [<ffffffffc48b6804>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff9c84fe4c>] __fput+0xec/0x230 [<ffffffff9c85007e>] ____fput+0xe/0x10 [<ffffffff9c6c275b>] task_work_run+0xbb/0xe0 [<ffffffff9c6a1904>] do_exit+0x2d4/0xa20 [<ffffffff9c6afcc3>] ? __sigqueue_free.part.13+0x33/0x40 [<ffffffff9c6a20cf>] do_group_exit+0x3f/0xa0 [<ffffffff9c6b307e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff9c62c527>] do_signal+0x57/0x6f0 [<ffffffff9c6b1fa5>] ? do_send_specific+0x75/0xa0 [<ffffffff9c62cc32>] do_notify_resume+0x72/0xc0 [<ffffffff9cd942ef>] int_signal+0x12/0x17
WARNING: CPU: 5 PID: 87435 at /var/lib/dkms/nvidia/525.125.06/build/nvidia/nv.c:4814 nvidia_dev_put_uuid+0x5e/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) veth xt_nat nf_conntrack_netlink xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 nfs fscache cmac arc4 md4 nls_utf8 cifs ccm dns_resolver overlay(T) dm_mirror dm_region_hash dm_log dm_mod nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) iTCO_wdt iTCO_vendor_support snd_hda_codec_hdmi skx_edac coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass snd_hda_intel crc32_pclmul snd_hda_codec ghash_clmulni_intel aesni_intel snd_hda_core lrw gf128mul glue_helper ablk_helper cryptd snd_hwdep snd_seq pcspkr snd_seq_device snd_pcm sg joydev snd_timer snd soundcore lpc_ich i2c_i801 mei_me mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter sch_fq_codel nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm i40e crct10dif_pclmul ahci crct10dif_common crc32c_intel megaraid_sas libahci libata ptp pps_core drm_panel_orientation_quirks wmi nfit libnvdimm fuse br_netfilter bridge stp llc CPU: 5 PID: 87435 Comm: python3 Kdump: loaded Tainted: P OE ------------ T 3.10.0-1160.90.1.el7.x86_64 #1 Hardware name: Inspur NF5280M5/YZMB-01360-102, BIOS 3.1.1 06/10/2019 Call Trace: [<ffffffff99db1bec>] dump_stack+0x19/0x1f [<ffffffff9969f868>] __warn+0xd8/0x100 [<ffffffff9969f9ad>] warn_slowpath_null+0x1d/0x30 [<ffffffffc0be031e>] nvidia_dev_put_uuid+0x5e/0x60 [nvidia] [<ffffffffc0bf3bbd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc42c3b19>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc42c9720>] uvm_va_space_destroy+0x330/0x3c0 [nvidia_uvm] [<ffffffffc42b58c8>] uvm_release.isra.5+0x88/0xa0 [nvidia_uvm] [<ffffffffc42b59a4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff9985df0c>] __fput+0xec/0x230 [<ffffffff9985e13e>] ____fput+0xe/0x20 [<ffffffff996c7f6b>] task_work_run+0xbb/0xe0 [<ffffffff996a6174>] do_exit+0x2d4/0xa30 [<ffffffff9982784b>] ? change_prot_numa+0x1b/0x40 [<ffffffff996e60c6>] ? task_numa_work+0x296/0x370 [<ffffffff996a694f>] do_group_exit+0x3f/0xa0 [<ffffffff996b825e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffc0bdf7eb>] ? nvidia_ioctl+0x12b/0x820 [nvidia] [<ffffffff9962d5b7>] do_signal+0x57/0x6f0 [<ffffffff99871918>] ? do_vfs_ioctl+0x3a8/0x5c0 [<ffffffff9962dcca>] do_notify_resume+0x7a/0xd0 [<ffffffff99dc56f7>] int_signal+0x12/0x17
WARNING: CPU: 5 PID: 1646 at /var/lib/dkms/nvidia/450.51.05/build/nvidia/nv.c:4699 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: ipheth veth xt_CHECKSUM tun devlink nfsv3 nfs_acl xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter bridge stp llc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nct6775 hwmon_vid sunrpc dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm snd_hda_codec_hdmi irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg snd_hda_intel mei_me lpc_ich snd_hda_codec i2c_i801 mei snd_hda_core snd_seq snd_hwdep snd_seq_device snd_pcm snd_timer ixgbe snd soundcore mdio shpchp ipmi_ssif ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter ip_tables ext4 mbcache jbd2 nvidia_drm(POE) nvidia_modeset(POE) nvidia_uvm(OE) nvidia(POE) sd_mod crc_t10dif crct10dif_generic mxm_wmi ast ahci ttm drm_kms_helper libahci igb libata syscopyarea crct10dif_pclmul sysfillrect crct10dif_common sysimgblt crc32c_intel fb_sys_fops ptp drm pps_core dca i2c_algo_bit i2c_core wmi CPU: 5 PID: 1646 Comm: cuda-EvtHandlr Kdump: loaded Tainted: P OE ------------ T 3.10.0-862.el7.x86_64 #1 Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./EP2C612D16FM, BIOS L2.52C 07/17/2018 Call Trace: [<ffffffffb0d0d768>] dump_stack+0x19/0x1b [<ffffffffb06916d8>] __warn+0xd8/0x100 [<ffffffffb069181d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc05c242a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc05d2edd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc041d98c>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc0423630>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc0411550>] uvm_release.isra.4+0x80/0xa0 [nvidia_uvm] [<ffffffffc0411634>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffb081cf8c>] __fput+0xec/0x260 [<ffffffffb081d1ee>] ____fput+0xe/0x10 [<ffffffffb06b784b>] task_work_run+0xbb/0xe0 [<ffffffffb06977e1>] do_exit+0x2d1/0xa40 [<ffffffffb0830830>] ? poll_select_copy_remaining+0x150/0x150 [<ffffffffb0697fcf>] do_group_exit+0x3f/0xa0 [<ffffffffb06a887e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffb062a527>] do_signal+0x57/0x6e0 [<ffffffffb072f3d6>] ? __audit_syscall_exit+0x1e6/0x280 [<ffffffffb062ac22>] do_notify_resume+0x72/0xc0 [<ffffffffb0d1fb1d>] int_signal+0x12/0x17
WARNING: CPU: 7 PID: 5007 at /tmp/selfgz2815/NVIDIA-Linux-x86_64-525.105.17/kernel/nvidia/nv.c:4814 nvidia_dev_put_uuid+0x61/0x70 [nvidia] Modules linked in: tcp_lp cmac rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun nvidia_uvm(OE) devlink bff(OE) afe(OE) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep sunrpc arc4 vfat fat iTCO_wdt iTCO_vendor_support iwlmvm mei_wdt mac80211 intel_pmc_core intel_powerclamp coretemp iwlwifi intel_rapl kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd cfg80211 pcspkr nvidia_drm(POE) nvidia_modeset(POE) i2c_i801 gpumemlock(OE) sg mei_me mei snd_hda_codec_hdmi nouveau snd_hda_codec_realtek snd_hda_codec_generic btusb btrtl btbcm btintel bluetooth snd_hda_intel snd_hda_codec nvidia(POE) snd_hda_core rfkill snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd mxm_wmi soundcore ttm wmi pinctrl_cannonlake pinctrl_intel acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic i915 iosf_mbi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci e1000e drm libahci igb libata crct10dif_pclmul crct10dif_common dca crc32c_intel ptp pps_core i2c_algo_bit drm_panel_orientation_quirks video i2c_hid dm_mirror dm_region_hash dm_log dm_mod fuse i2c_dev [last unloaded: afe] CPU: 7 PID: 5007 Comm: k3900_server Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.92.1.el7.x86_64 #1 Hardware name: Default string Default string/Default string, BIOS V2.02 02/04/2020 Call Trace: [<ffffffff9a1b1bec>] dump_stack+0x19/0x1f [<ffffffff99a9f868>] __warn+0xd8/0x100 [<ffffffff99a9f9ad>] warn_slowpath_null+0x1d/0x30 [<ffffffffc07fa891>] nvidia_dev_put_uuid+0x61/0x70 [nvidia] [<ffffffffc080e53d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc4657819>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc465dc30>] uvm_va_space_destroy+0x360/0x3e0 [nvidia_uvm] [<ffffffffc46498f8>] uvm_release.isra.5+0x88/0xa0 [nvidia_uvm] [<ffffffffc46499fc>] uvm_release_entry+0x7c/0xb0 [nvidia_uvm] [<ffffffff99c5df0c>] __fput+0xec/0x230 [<ffffffff99c5e13e>] ____fput+0xe/0x20 [<ffffffff99ac7f6b>] task_work_run+0xbb/0xe0 [<ffffffff99aa6174>] do_exit+0x2d4/0xa30 [<ffffffff99ae91dc>] ? dequeue_entity+0x11c/0x5d0 [<ffffffff99c0d98c>] ? page_add_file_rmap+0x8c/0xc0 [<ffffffff99aa694f>] do_group_exit+0x3f/0xa0 [<ffffffff99ab825e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff99a2d5b7>] do_signal+0x57/0x6f0 [<ffffffff99acf340>] ? hrtimer_get_res+0x50/0x50 [<ffffffff99a2dcca>] do_notify_resume+0x7a/0xd0 [<ffffffff9a1c56f7>] int_signal+0x12/0x17
WARNING: CPU: 4 PID: 7373 at /tmp/selfgz2815/NVIDIA-Linux-x86_64-525.105.17/kernel/nvidia/nv.c:4814 nvidia_dev_put_uuid+0x61/0x70 [nvidia] Modules linked in: tcp_lp cmac rfcomm nvidia_uvm(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink bff(OE) afe(OE) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep sunrpc arc4 vfat fat iwlmvm iTCO_wdt mac80211 iTCO_vendor_support intel_pmc_core mei_wdt iwlwifi intel_powerclamp coretemp intel_rapl kvm_intel kvm nvidia_drm(POE) irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel cfg80211 lrw gf128mul glue_helper ablk_helper cryptd pcspkr nvidia_modeset(POE) i2c_i801 gpumemlock(OE) sg snd_hda_codec_hdmi nouveau snd_hda_codec_realtek snd_hda_codec_generic mei_me mei btusb btrtl btbcm btintel snd_hda_intel bluetooth snd_hda_codec nvidia(POE) snd_hda_core snd_hwdep snd_seq rfkill snd_seq_device snd_pcm snd_timer mxm_wmi snd ttm soundcore wmi pinctrl_cannonlake pinctrl_intel acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic i915 iosf_mbi drm_kms_helper ahci syscopyarea sysfillrect sysimgblt fb_sys_fops libahci drm e1000e igb libata crct10dif_pclmul crct10dif_common dca crc32c_intel ptp pps_core i2c_algo_bit drm_panel_orientation_quirks video i2c_hid dm_mirror dm_region_hash dm_log dm_mod fuse i2c_dev [last unloaded: afe] CPU: 4 PID: 7373 Comm: grpcpp_sync_ser Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.92.1.el7.x86_64 #1 Hardware name: Default string Default string/Default string, BIOS V2.02 02/04/2020 Call Trace: [<ffffffffa8bb1bec>] dump_stack+0x19/0x1f [<ffffffffa849f868>] __warn+0xd8/0x100 [<ffffffffa849f9ad>] warn_slowpath_null+0x1d/0x30 [<ffffffffc0988891>] nvidia_dev_put_uuid+0x61/0x70 [nvidia] [<ffffffffc099c53d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc4795819>] uvm_gpu_release_locked+0x49/0x50 [nvidia_uvm] [<ffffffffc479bc30>] uvm_va_space_destroy+0x360/0x3e0 [nvidia_uvm] [<ffffffffc47878f8>] uvm_release.isra.5+0x88/0xa0 [nvidia_uvm] [<ffffffffc47879fc>] uvm_release_entry+0x7c/0xb0 [nvidia_uvm] [<ffffffffa865df0c>] __fput+0xec/0x230 [<ffffffffa865e13e>] ____fput+0xe/0x20 [<ffffffffa84c7f6b>] task_work_run+0xbb/0xe0 [<ffffffffa84a6174>] do_exit+0x2d4/0xa30 [<ffffffffa84e91dc>] ? dequeue_entity+0x11c/0x5d0 [<ffffffffa84a694f>] do_group_exit+0x3f/0xa0 [<ffffffffa84b825e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffa842d5b7>] do_signal+0x57/0x6f0 [<ffffffffa8bb6e5a>] ? do_nanosleep+0x9a/0x100 [<ffffffffa84cf340>] ? hrtimer_get_res+0x50/0x50 [<ffffffffa842dcca>] do_notify_resume+0x7a/0xd0 [<ffffffffa8bc56f7>] int_signal+0x12/0x17
WARNING: CPU: 1 PID: 4379 at /tmp/selfgz15369/NVIDIA-Linux-x86_64-470.129.06/kernel/nvidia/nv.c:4841 nvidia_dev_put_uuid+0x5e/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) tcp_lp br_netfilter tun devlink overlay(T) bridge stp llc ip_set sunrpc nvidia_drm(POE) nvidia_modeset(POE) vfat fat nvidia(POE) iTCO_wdt iTCO_vendor_support sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev ipmi_ssif pcspkr sg lpc_ich i2c_i801 mei_me mei ioatdma ipmi_si ipmi_devintf ipmi_msghandler acpi_pad xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm isci drm ixgbe ahci libsas scsi_transport_sas libahci igb crct10dif_pclmul crct10dif_common libata crc32c_intel mdio ptp pps_core drm_panel_orientation_quirks dca i2c_algo_bit wmi dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables] CPU: 1 PID: 4379 Comm: python Kdump: loaded Tainted: P W OE ------------ T 3.10.0-1160.83.1.el7.x86_64 #1 Hardware name: Sugon I420r-G10/X9DB3-TPF, BIOS 3.3 10/01/2018 Call Trace: [<ffffffffb5bb1bec>] dump_stack+0x19/0x1f [<ffffffffb549f858>] __warn+0xd8/0x100 [<ffffffffb549f99d>] warn_slowpath_null+0x1d/0x30 [<ffffffffc0a1d37e>] nvidia_dev_put_uuid+0x5e/0x60 [nvidia] [<ffffffffc0a2f39d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc2bd2c6c>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc2bd89e0>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc2bc6068>] uvm_release.isra.5+0x88/0xa0 [nvidia_uvm] [<ffffffffc2bc6144>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffb565db8c>] __fput+0xec/0x230 [<ffffffffb565ddbe>] ____fput+0xe/0x20 [<ffffffffb54c7e5b>] task_work_run+0xbb/0xe0 [<ffffffffb54a6164>] do_exit+0x2d4/0xa30 [<ffffffffb551a47f>] ? futex_wait+0x11f/0x290 [<ffffffffb5629d94>] ? mpol_misplaced+0x194/0x1e0 [<ffffffffb54a693f>] do_group_exit+0x3f/0xa0 [<ffffffffb54b814e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffb542d5b7>] do_signal+0x57/0x6f0 [<ffffffffb551c1d6>] ? do_futex+0x106/0x4d0 [<ffffffffb54effee>] ? pick_next_task_fair+0x62e/0x880 [<ffffffffb54e4235>] ? sched_clock_cpu+0x85/0xc0 [<ffffffffb542dcca>] do_notify_resume+0x7a/0xd0 [<ffffffffb5bc56f7>] int_signal+0x12/0x17
WARNING: CPU: 5 PID: 19363 at /tmp/selfgz6901/NVIDIA-Linux-x86_64-470.129.06/kernel/nvidia/nv.c:4841 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache 8021q garp mrp stp llc snd_hda_codec_hdmi nvidia_drm(POE) nvidia_modeset(POE) ip6_tables iptable_filter nvidia(POE) rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi sb_edac scsi_transport_iscsi iTCO_wdt iTCO_vendor_support ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm pcspkr irqbypass snd_hda_intel crc32_pclmul snd_hda_codec ghash_clmulni_intel cryptd snd_hda_core snd_hwdep snd_seq ib_ipoib snd_seq_device raid0 snd_pcm snd_timer joydev rdma_ucm snd soundcore mei_me ib_ucm sg mei lpc_ich ioatdma shpchp i2c_i801 ib_uverbs ib_umad rdma_cm ib_cm ipmi_si ipmi_devintf iw_cm ipmi_msghandler ib_core acpi_power_meter acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm igb drm ahci libahci crct10dif_pclmul crct10dif_common crc32c_intel libata ptp pps_core dca i2c_algo_bit i2c_core wmi CPU: 5 PID: 19363 Comm: terachem Tainted: P OE ------------ 3.10.0-693.5.2.el7.x86_64 #1 Hardware name: Supermicro SYS-4028GR-TR/X10DRG-O+-CPU, BIOS 1.0a 10/16/2015 0000000000000000 00000000ecf6cb9b ffff8802f1ee7a90 ffffffff816a3e51 ffff8802f1ee7ad0 ffffffff810879d8 000012e900000000 ffff885fa47b2000 ffff882f23ac0000 ffffc9003b868010 ffffc9003b4f4010 0000000000000029 Call Trace: [<ffffffff816a3e51>] dump_stack+0x19/0x1b [<ffffffff810879d8>] __warn+0xd8/0x100 [<ffffffff81087b1d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc51ce10a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc51df03d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc09ee4dc>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc09f3fc0>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc09e34b0>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc09e3594>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff812187c4>] ? dentry_kill+0x154/0x1b0 [<ffffffff81202f39>] __fput+0xe9/0x260 [<ffffffff8120319e>] ____fput+0xe/0x10 [<ffffffff810ad275>] task_work_run+0xc5/0xf0 [<ffffffff8108da11>] do_exit+0x2d1/0xa40 [<ffffffff811d28fb>] ? change_prot_numa+0x1b/0x40 [<ffffffff810c9316>] ? task_numa_work+0x286/0x350 [<ffffffff8108e1ff>] do_group_exit+0x3f/0xa0 [<ffffffff8109e32e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff8102a467>] do_signal+0x57/0x6c0 [<ffffffff810cb63c>] ? set_next_entity+0x3c/0xe0 [<ffffffff810295da>] ? __switch_to+0x15a/0x510 [<ffffffff8102ab2f>] do_notify_resume+0x5f/0xb0 [<ffffffff816b533d>] int_signal+0x12/0x17
WARNING: CPU: 39 PID: 35259 at /tmp/selfgz66002/NVIDIA-Linux-x86_64-495.29.05/kernel/nvidia/nv.c:4943 nvidia_dev_put_uuid+0x61/0x70 [nvidia] Modules linked in: nvidia_uvm(OE) ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel snd_hda_codec_hdmi aesni_intel lrw gf128mul glue_helper ablk_helper cryptd nvidia(POE) ipmi_ssif pcspkr snd_hda_intel snd_hda_codec snd_hda_core snd_seq snd_seq_device snd_hwdep snd_pcm joydev snd_timer snd soundcore lpc_ich i2c_i801 sg mei_me mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci crct10dif_pclmul crct10dif_common drm crc32c_intel libahci i40e libata megaraid_sas ptp pps_core drm_panel_orientation_quirks wmi nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod CPU: 39 PID: 35259 Comm: python Kdump: loaded Tainted: P OE ------------ T 3.10.0-1160.45.1.el7.x86_64 #1 Hardware name: Supermicro SYS-4029GP-TRT/X11DPG-OT-CPU, BIOS 3.1 04/30/2019 Call Trace: [<ffffffffbbd83539>] dump_stack+0x19/0x1b [<ffffffffbb69b278>] __warn+0xd8/0x100 [<ffffffffbb69b3bd>] warn_slowpath_null+0x1d/0x20 [<ffffffffc744f501>] nvidia_dev_put_uuid+0x61/0x70 [nvidia] [<ffffffffc74617bd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc0ae12ec>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc0ae6993>] uvm_va_space_destroy+0x3f3/0x480 [nvidia_uvm] [<ffffffffc0ad4040>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc0ad4144>] uvm_release_entry+0x74/0xa0 [nvidia_uvm] [<ffffffffbb85088c>] __fput+0xec/0x230 [<ffffffffbb850abe>] ____fput+0xe/0x10 [<ffffffffbb6c299b>] task_work_run+0xbb/0xe0 [<ffffffffbb6a1954>] do_exit+0x2d4/0xa30 [<ffffffffbb71358f>] ? futex_wait+0x11f/0x280 [<ffffffffbb6a212f>] do_group_exit+0x3f/0xa0 [<ffffffffbb6b328e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffbb62c527>] do_signal+0x57/0x6f0 [<ffffffffbb7152a6>] ? do_futex+0x106/0x4d0 [<ffffffffbb6e9d2e>] ? pick_next_task_fair+0x61e/0x870 [<ffffffffbb6de305>] ? sched_clock_cpu+0x85/0xc0 [<ffffffffbb62cc32>] do_notify_resume+0x72/0xc0 [<ffffffffbbd962ef>] int_signal+0x12/0x17
WARNING: CPU: 3 PID: 63754 at /var/lib/dkms/nvidia/440.44/build/nvidia/nv.c:4379 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) tcp_diag inet_diag unix_diag rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel snd_hda_codec_hdmi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd joydev soundcore i2c_i801 sg lpc_ich mei_me mei ipmi_si acpi_power_meter acpi_pad ip_tables xfs libcrc32c nvidia_drm(POE) nvidia_modeset(POE) raid1 nvidia(POE) sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper ttm i40e crct10dif_pclmul syscopyarea sysfillrect crct10dif_common sysimgblt crc32c_intel fb_sys_fops ahci drm nvme libahci nvme_core ptp libata pps_core drm_panel_orientation_quirks wmi nfit libnvdimm ipmi_devintf ipmi_msghandler fuse CPU: 3 PID: 63754 Comm: MotionCor2_1.3. Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.36.2.el7.x86_64 #1 Hardware name: Silicon Mechanics iPG-42-224-10SR_(R358.1)/X11DPG-OT-CPU, BIOS 3.1 04/30/2019 Call Trace: [<ffffffffaf383559>] dump_stack+0x19/0x1b [<ffffffffaec9b258>] __warn+0xd8/0x100 [<ffffffffaec9b39d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc0475d1a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc04854bd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc1fe9a2d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc1fef788>] uvm_va_space_destroy+0x3b8/0x410 [nvidia_uvm] [<ffffffffc1fddd70>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc1fdde54>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffaee5083c>] __fput+0xec/0x230 [<ffffffffaee50a6e>] ____fput+0xe/0x10 [<ffffffffaecc297b>] task_work_run+0xbb/0xe0 [<ffffffffaeca1934>] do_exit+0x2d4/0xa30 [<ffffffffaed135f5>] ? futex_wait+0x1a5/0x280 [<ffffffffaee1d90c>] ? mpol_misplaced+0x18c/0x1e0 [<ffffffffaeca210f>] do_group_exit+0x3f/0xa0 [<ffffffffaecb326e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffaec2c527>] do_signal+0x57/0x6f0 [<ffffffffaed15286>] ? do_futex+0x106/0x4d0 [<ffffffffaec2cc32>] do_notify_resume+0x72/0xc0 [<ffffffffaf3962ef>] int_signal+0x12/0x17
WARNING: CPU: 10 PID: 19109 at /tmp/selfgz8733/NVIDIA-Linux-x86_64-460.67/kernel/nvidia/nv.c:4694 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) vfat fat isofs ext4 mbcache jbd2 xt_TCPMSS xt_tcpmss drbg ansi_cprng authenc ip_vti ip_tunnel ah6 ah4 esp6 esp4 xfrm4_mode_beet xfrm4_tunnel tunnel4 xfrm4_mode_tunnel xfrm4_mode_transport xfrm6_mode_transport xfrm6_mode_ro xfrm6_mode_beet xfrm6_mode_tunnel ipcomp ipcomp6 xfrm6_tunnel xfrm_ipcomp tunnel6 cmac camellia_generic camellia_aesni_avx2 camellia_aesni_avx_x86_64 camellia_x86_64 xts deflate cts gcm ccm xcbc sha256_mb sha512_ssse3 sha512_generic sha512_mb mcryptd des_generic l2tp_ppp l2tp_netlink l2tp_core pppox ppp_generic slhc fuse nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables overlay(T) ipt_REJECT nf_reject_ipv4 xt_multiport xt_conntrack iptable_filter xt_policy ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) snd_hda_codec_hdmi iTCO_wdt iTCO_vendor_support snd_hda_codec_realtek snd_hda_codec_generic intel_powerclamp coretemp intel_rapl iosf_mbi snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd eeepc_wmi asus_wmi sparse_keymap rfkill drm_kms_helper video intel_wmi_thunderbolt pcspkr syscopyarea sysfillrect sysimgblt fb_sys_fops sg drm i2c_i801 lpc_ich snd_timer snd mei_me soundcore drm_panel_orientation_quirks mei nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic e1000e ahci igb libahci libata crct10dif_pclmul crct10dif_common crc32c_intel dca serio_raw ptp i2c_algo_bit pps_core mxm_wmi wmi dm_mirror dm_region_hash dm_log dm_mod CPU: 10 PID: 19109 Comm: cuda-EvtHandlr Kdump: loaded Tainted: P OE ------------ T 3.10.0-1127.19.1.el7.x86_64 #1 Hardware name: ASUS All Series/X99-E WS, BIOS 3302 08/18/2016 Call Trace: [<ffffffffa8f7ffa5>] dump_stack+0x19/0x1b [<ffffffffa889bd18>] __warn+0xd8/0x100 [<ffffffffa889be5d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc0d584ea>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc0d690ad>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc2e7482c>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc2e7a4b0>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc2e67fd0>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc2e680b4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffa8a4f4ec>] __fput+0xec/0x230 [<ffffffffa8a4f71e>] ____fput+0xe/0x10 [<ffffffffa88c31cb>] task_work_run+0xbb/0xe0 [<ffffffffa88a2404>] do_exit+0x2d4/0xa20 [<ffffffffa8a63430>] ? __pollwait+0xf0/0xf0 [<ffffffffa88a2bcf>] do_group_exit+0x3f/0xa0 [<ffffffffa88b3aee>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffa882c527>] do_signal+0x57/0x6f0 [<ffffffffa8906d32>] ? ktime_get_ts64+0x52/0xf0 [<ffffffffa882cc32>] do_notify_resume+0x72/0xc0 [<ffffffffa8f9322f>] int_signal+0x12/0x17
WARNING: CPU: 11 PID: 17136 at /tmp/selfgz21297/NVIDIA-Linux-x86_64-440.100/kernel/nvidia/nv.c:4391 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache dm_mirror dm_region_hash dm_log dm_mod nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi iTCO_wdt iTCO_vendor_support kvm_intel kvm snd_hda_codec_hdmi irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm joydev pcspkr snd_timer snd soundcore sg mei_me ipmi_ssif ioatdma mei lpc_ich shpchp i2c_i801 ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mxm_wmi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm igb libahci crct10dif_pclmul libata ptp crct10dif_common crc32c_intel pps_core dca i2c_algo_bit i2c_core wmi CPU: 11 PID: 17136 Comm: python Kdump: loaded Tainted: P OE ------------ 3.10.0-862.9.1.el7.x86_64 #1 Hardware name: Supermicro SYS-4028GR-TR/X10DRG-O+-CPU, BIOS 3.0b 04/12/2018 Call Trace: [<ffffffffae30e84e>] dump_stack+0x19/0x1b [<ffffffffadc91e18>] __warn+0xd8/0x100 [<ffffffffadc91f5d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc0b2ccda>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc0b3c6bd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc1ee595d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc1eeb1d8>] uvm_va_space_destroy+0x3c8/0x420 [nvidia_uvm] [<ffffffffc1ed9fc0>] uvm_release.isra.4+0x80/0xa0 [nvidia_uvm] [<ffffffffc1eda0a4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffade1d74c>] __fput+0xec/0x260 [<ffffffffade1d9ae>] ____fput+0xe/0x10 [<ffffffffadcb803b>] task_work_run+0xbb/0xe0 [<ffffffffadc97f21>] do_exit+0x2d1/0xa40 [<ffffffffadd04a55>] ? futex_wait+0x1a5/0x280 [<ffffffffadc9870f>] do_group_exit+0x3f/0xa0 [<ffffffffadca8fbe>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffadc2a527>] do_signal+0x57/0x6e0 [<ffffffffadd06786>] ? do_futex+0x106/0x5a0 [<ffffffffadc2ac22>] do_notify_resume+0x72/0xc0 [<ffffffffae320adb>] int_signal+0x12/0x17
WARNING: CPU: 18 PID: 35089 at /tmp/selfgz11274/NVIDIA-Linux-x86_64-440.82/kernel/nvidia/nv.c:4391 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfsv3 nfs_acl nfs lockd grace overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter cachefiles fscache sunrpc dm_mirror dm_region_hash dm_log dm_mod nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support nvidia(POE) snd_hda_codec_hdmi sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq joydev sg mei_me snd_seq_device i2c_i801 mei lpc_ich snd_pcm snd_timer snd ioatdma soundcore ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ixgbe ahci drm igb libahci libata crct10dif_pclmul mxm_wmi crct10dif_common crc32c_intel mdio ptp pps_core dca i2c_algo_bit drm_panel_orientation_quirks wmi CPU: 18 PID: 35089 Comm: python Kdump: loaded Tainted: P OE ------------ T 3.10.0-1127.8.2.el7.x86_64 #1 Hardware name: Supermicro SYS-4028GR-TR/X10DRG-O+-CPU, BIOS 2.0a 07/27/2016 Call Trace: [<ffffffffb3d7ffa5>] dump_stack+0x19/0x1b [<ffffffffb369bd18>] __warn+0xd8/0x100 [<ffffffffb369be5d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc6062d1a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc607273d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc0a36d1d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc0a3c598>] uvm_va_space_destroy+0x3c8/0x420 [nvidia_uvm] [<ffffffffc0a2afc0>] uvm_release.isra.4+0x80/0xa0 [nvidia_uvm] [<ffffffffc0a2b0a4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffb384f49c>] __fput+0xec/0x230 [<ffffffffb384f6ce>] ____fput+0xe/0x10 [<ffffffffb36c31cb>] task_work_run+0xbb/0xe0 [<ffffffffb36a2404>] do_exit+0x2d4/0xa20 [<ffffffffb37139a5>] ? futex_wait+0x1a5/0x280 [<ffffffffb36d7c79>] ? ttwu_do_wakeup+0x19/0xe0 [<ffffffffb36a2bcf>] do_group_exit+0x3f/0xa0 [<ffffffffb36b3aee>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffb362c527>] do_signal+0x57/0x6f0 [<ffffffffb37156c6>] ? do_futex+0x106/0x5a0 [<ffffffffb37576bb>] ? __seccomp_filter+0x5b/0x300 [<ffffffffb373ef86>] ? __audit_syscall_exit+0x1e6/0x280 [<ffffffffb362cc32>] do_notify_resume+0x72/0xc0 [<ffffffffb3d9322f>] int_signal+0x12/0x17
WARNING: CPU: 4 PID: 19159 at /tmp/selfgz8733/NVIDIA-Linux-x86_64-460.67/kernel/nvidia/nv.c:4694 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_TCPMSS xt_tcpmss fuse drbg ansi_cprng authenc l2tp_ppp l2tp_netlink l2tp_core pppox ppp_generic slhc ip_vti ip_tunnel ah6 ah4 esp6 esp4 xfrm4_mode_beet xfrm4_tunnel tunnel4 xfrm4_mode_tunnel xfrm4_mode_transport xfrm6_mode_transport xfrm6_mode_ro xfrm6_mode_beet xfrm6_mode_tunnel ipcomp ipcomp6 xfrm6_tunnel xfrm_ipcomp tunnel6 cmac camellia_generic camellia_aesni_avx2 camellia_aesni_avx_x86_64 camellia_x86_64 xts deflate cts gcm ccm xcbc sha256_mb sha512_ssse3 sha512_generic sha512_mb mcryptd des_generic tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 xt_multiport xt_conntrack iptable_filter xt_policy ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) snd_hda_codec_hdmi iTCO_wdt iTCO_vendor_support intel_powerclamp coretemp intel_rapl iosf_mbi snd_hda_codec_realtek snd_hda_codec_generic kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_intel lrw snd_hda_codec gf128mul glue_helper ablk_helper cryptd drm_kms_helper snd_hda_core eeepc_wmi snd_hwdep asus_wmi sparse_keymap snd_seq rfkill syscopyarea video sysfillrect snd_seq_device intel_wmi_thunderbolt sysimgblt fb_sys_fops pcspkr snd_pcm drm sg lpc_ich i2c_i801 snd_timer mei_me snd drm_panel_orientation_quirks mei soundcore nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ahci e1000e libahci igb libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw dca ptp pps_core i2c_algo_bit mxm_wmi wmi dm_mirror dm_region_hash dm_log dm_mod CPU: 4 PID: 19159 Comm: NiuTensor Kdump: loaded Tainted: P OE ------------ 3.10.0-1127.19.1.el7.x86_64 #1 Hardware name: ASUS All Series/X99-E WS, BIOS 3302 08/18/2016 Call Trace: [<ffffffffba97ffa5>] dump_stack+0x19/0x1b [<ffffffffba29bd18>] __warn+0xd8/0x100 [<ffffffffba29be5d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc0bcd4ea>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc0bde0ad>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc2d8582c>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc2d8b4b0>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc2d78fd0>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc2d790b4>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffba44f4ec>] __fput+0xec/0x230 [<ffffffffba44f71e>] ____fput+0xe/0x10 [<ffffffffba2c31cb>] task_work_run+0xbb/0xe0 [<ffffffffba2a2404>] do_exit+0x2d4/0xa20 [<ffffffffba2a2bcf>] do_group_exit+0x3f/0xa0 [<ffffffffba2b3aee>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffba22c527>] do_signal+0x57/0x6f0 [<ffffffffba2e69fb>] ? put_prev_entity+0x8b/0x400 [<ffffffffba22cc32>] do_notify_resume+0x72/0xc0 [<ffffffffba98957c>] retint_signal+0x48/0x8c
WARNING: CPU: 9 PID: 256879 at /tmp/selfgz21752/NVIDIA-Linux-x86_64-440.33.01/kernel/nvidia/nv.c:4378 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: unix_diag af_packet_diag netlink_diag nvidia_uvm(OE) xt_multiport rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack udp_diag tcp_diag inet_diag ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support nvidia(POE) skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm snd_hda_codec_hdmi irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec snd_seq pcspkr snd_hda_core snd_seq_device snd_hwdep snd_pcm joydev snd_timer snd soundcore sg mei_me lpc_ich i2c_i801 mei ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops crct10dif_common crc32c_intel ttm ahci ixgbe libahci drm libata mdio ptp pps_core wmi dca drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod CPU: 9 PID: 256879 Comm: python Kdump: loaded Tainted: P W OE ------------ 3.10.0-957.27.2.el7.x86_64 #1 Hardware name: GIGABYTE G291-001-W6/MG51-G21-00, BIOS R09 03/05/2020 Call Trace: [<ffffffff84564147>] dump_stack+0x19/0x1b [<ffffffff83e98848>] __warn+0xd8/0x100 [<ffffffff83e9898d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc1865d1a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc187544d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc0c25a1d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc0c2b778>] uvm_va_space_destroy+0x3b8/0x410 [nvidia_uvm] [<ffffffffc0c19d60>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc0c19e44>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff84044a3c>] __fput+0xec/0x260 [<ffffffff84044c9e>] ____fput+0xe/0x10 [<ffffffff83ebf9eb>] task_work_run+0xbb/0xe0 [<ffffffff83e9eeb1>] do_exit+0x2d1/0xa40 [<ffffffff83e9f69f>] do_group_exit+0x3f/0xa0 [<ffffffff83eb049e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff83e2b527>] do_signal+0x57/0x6f0 [<ffffffff83f10cb6>] ? do_futex+0x106/0x5a0 [<ffffffff83e2bc32>] do_notify_resume+0x72/0xc0 [<ffffffff84577134>] int_signal+0x12/0x17
WARNING: CPU: 1 PID: 61081 at /var/lib/dkms/nvidia/450.51.06/build/nvidia/nv.c:4699 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: squashfs loop overlay(T) 8021q garp mrp stp llc mmfs26(OE) mmfslinux(OE) tracedev(OE) nfsv3 nfs_acl nfs lockd grace fscache ip6table_filter ip6table_raw ip6_tables xt_comment xt_multiport xt_conntrack iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ucm dm_mirror dm_region_hash dm_log dm_mod nvidia_drm(POE) nvidia_modeset(POE) nvidia_uvm(OE) rpcrdma nvidia(POE) sunrpc rdma_ucm ib_uverbs ib_umad ib_iser ib_ipoib rdma_cm iw_cm ib_cm libiscsi scsi_transport_iscsi sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi ext4 kvm_intel mbcache jbd2 kvm iTCO_wdt iTCO_vendor_support irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device mlx5_ib snd_pcm ib_core joydev snd_timer intel_wmi_thunderbolt snd mei_me pcspkr lpc_ich sg mei ioatdma soundcore i2c_i801 ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mxm_wmi ast drm_kms_helper syscopyarea sysfillrect mlx5_core sysimgblt fb_sys_fops ahci ttm igb libahci mlxfw devlink crct10dif_pclmul drm crct10dif_common ptp crc32c_intel dca libata pps_core i2c_algo_bit drm_panel_orientation_quirks nvme nvme_core wmi nfit libnvdimm CPU: 1 PID: 61081 Comm: python3.8 Kdump: loaded Tainted: P OE ------------ T 3.10.0-957.12.2.el7.x86_64 #1 Hardware name: Supermicro SYS-7048GR-TR/X10DRG-Q, BIOS 2.0b 07/26/2017 Call Trace: [<ffffffffabf63041>] dump_stack+0x19/0x1b [<ffffffffab8976e8>] __warn+0xd8/0x100 [<ffffffffab89782d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc18fc46a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc190cfbd>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc127ad5c>] uvm_gpu_release_locked+0x4c/0x50 [nvidia_uvm] [<ffffffffc1280a00>] uvm_va_space_destroy+0x3e0/0x440 [nvidia_uvm] [<ffffffffc126e550>] uvm_release.isra.4+0x80/0xa0 [nvidia_uvm] [<ffffffffc126e634>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffaba43b4c>] __fput+0xec/0x260 [<ffffffffaba43dae>] ____fput+0xe/0x10 [<ffffffffab8be88b>] task_work_run+0xbb/0xe0 [<ffffffffab89dd51>] do_exit+0x2d1/0xa40 [<ffffffffabb803f4>] ? timerqueue_del+0x24/0x70 [<ffffffffab8c5b16>] ? __remove_hrtimer+0x46/0xe0 [<ffffffffab89e53f>] do_group_exit+0x3f/0xa0 [<ffffffffab8af33e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffab82b527>] do_signal+0x57/0x6f0 [<ffffffffaba8f2ee>] ? ep_poll+0x31e/0x360 [<ffffffffab8d6ae0>] ? wake_up_state+0x20/0x20 [<ffffffffab82bc32>] do_notify_resume+0x72/0xc0 [<ffffffffabf76134>] int_signal+0x12/0x17
WARNING: CPU: 0 PID: 343311 at /tmp/selfgz21752/NVIDIA-Linux-x86_64-440.33.01/kernel/nvidia/nv.c:4378 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_multiport rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support skx_edac nvidia(POE) intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel snd_hda_codec_hdmi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec snd_seq snd_hda_core snd_hwdep snd_seq_device pcspkr snd_pcm snd_timer snd soundcore joydev sg mei_me mei lpc_ich i2c_i801 ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast crct10dif_pclmul crct10dif_common i2c_algo_bit crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci ixgbe drm libata mdio ptp pps_core wmi drm_panel_orientation_quirks dca nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 343311 Comm: python Kdump: loaded Tainted: P OE ------------ 3.10.0-957.27.2.el7.x86_64 #1 Hardware name: GIGABYTE G291-001-W6/MG51-G21-00, BIOS R09 03/05/2020 Call Trace: [<ffffffffac964147>] dump_stack+0x19/0x1b [<ffffffffac298848>] __warn+0xd8/0x100 [<ffffffffac29898d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc1447d1a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc145744d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc0be6a1d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc0bec778>] uvm_va_space_destroy+0x3b8/0x410 [nvidia_uvm] [<ffffffffc0bdad60>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc0bdae44>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffffac444a3c>] __fput+0xec/0x260 [<ffffffffac444c9e>] ____fput+0xe/0x10 [<ffffffffac2bf9eb>] task_work_run+0xbb/0xe0 [<ffffffffac29eeb1>] do_exit+0x2d1/0xa40 [<ffffffffac3ea4ee>] ? do_numa_page+0x1be/0x250 [<ffffffffac29f69f>] do_group_exit+0x3f/0xa0 [<ffffffffac2b049e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffffac22b527>] do_signal+0x57/0x6f0 [<ffffffffac969dfd>] ? __schedule+0x76d/0x860 [<ffffffffac9697ca>] ? __schedule+0x13a/0x860 [<ffffffffac22bc32>] do_notify_resume+0x72/0xc0 [<ffffffffac977134>] int_signal+0x12/0x17
WARNING: CPU: 19 PID: 195086 at /tmp/selfgz21752/NVIDIA-Linux-x86_64-440.33.01/kernel/nvidia/nv.c:4378 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_multiport rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support nvidia(POE) skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel snd_hda_codec_hdmi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device pcspkr snd_pcm snd_timer snd soundcore joydev lpc_ich sg mei_me i2c_i801 mei ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ixgbe ttm ahci libahci drm libata mdio ptp pps_core dca drm_panel_orientation_quirks wmi nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod CPU: 19 PID: 195086 Comm: python Kdump: loaded Tainted: P W OE ------------ 3.10.0-957.27.2.el7.x86_64 #1 Hardware name: GIGABYTE G291-001-W6/MG51-G21-00, BIOS R09 03/05/2020 Call Trace: [<ffffffff99164147>] dump_stack+0x19/0x1b [<ffffffff98a98848>] __warn+0xd8/0x100 [<ffffffff98a9898d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc0b4ed1a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc0b5e44d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc1ee2a1d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc1ee8778>] uvm_va_space_destroy+0x3b8/0x410 [nvidia_uvm] [<ffffffffc1ed6d60>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc1ed6e44>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff98c44a3c>] __fput+0xec/0x260 [<ffffffff98c44c9e>] ____fput+0xe/0x10 [<ffffffff98abf9eb>] task_work_run+0xbb/0xe0 [<ffffffff98a9eeb1>] do_exit+0x2d1/0xa40 [<ffffffff98b0ef0f>] ? futex_wait+0x11f/0x280 [<ffffffff98bc6eae>] ? lru_cache_add+0xe/0x10 [<ffffffff98a9f69f>] do_group_exit+0x3f/0xa0 [<ffffffff98ab049e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff98a2b527>] do_signal+0x57/0x6f0 [<ffffffff98b10cb6>] ? do_futex+0x106/0x5a0 [<ffffffff98a2bc32>] do_notify_resume+0x72/0xc0 [<ffffffff99177134>] int_signal+0x12/0x17
WARNING: CPU: 2 PID: 376217 at /tmp/selfgz21752/NVIDIA-Linux-x86_64-440.33.01/kernel/nvidia/nv.c:4378 nvidia_dev_put_uuid+0x5a/0x60 [nvidia] Modules linked in: nvidia_uvm(OE) xt_multiport rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc nvidia_drm(POE) nvidia_modeset(POE) iTCO_wdt iTCO_vendor_support nvidia(POE) skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm snd_hda_codec_hdmi irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec snd_hda_core pcspkr snd_seq snd_hwdep snd_seq_device snd_pcm joydev snd_timer snd sg soundcore i2c_i801 mei_me mei lpc_ich ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel ixgbe drm ahci libahci libata mdio ptp pps_core drm_panel_orientation_quirks dca wmi nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod CPU: 2 PID: 376217 Comm: python Kdump: loaded Tainted: P OE ------------ 3.10.0-957.27.2.el7.x86_64 #1 Hardware name: GIGABYTE G291-001-W6/MG51-G21-00, BIOS R09 03/05/2020 Call Trace: [<ffffffff9bf64147>] dump_stack+0x19/0x1b [<ffffffff9b898848>] __warn+0xd8/0x100 [<ffffffff9b89898d>] warn_slowpath_null+0x1d/0x20 [<ffffffffc1861d1a>] nvidia_dev_put_uuid+0x5a/0x60 [nvidia] [<ffffffffc187144d>] nvUvmInterfaceUnregisterGpu+0x2d/0x40 [nvidia] [<ffffffffc0a9aa1d>] uvm_gpu_release_locked+0x2d/0x40 [nvidia_uvm] [<ffffffffc0aa0778>] uvm_va_space_destroy+0x3b8/0x410 [nvidia_uvm] [<ffffffffc0a8ed60>] uvm_release.isra.5+0x80/0xa0 [nvidia_uvm] [<ffffffffc0a8ee44>] uvm_release_entry+0x54/0xb0 [nvidia_uvm] [<ffffffff9ba44a3c>] __fput+0xec/0x260 [<ffffffff9ba44c9e>] ____fput+0xe/0x10 [<ffffffff9b8bf9eb>] task_work_run+0xbb/0xe0 [<ffffffff9b89eeb1>] do_exit+0x2d1/0xa40 [<ffffffff9b9e5eec>] ? do_read_fault.isra.61+0x4c/0x1b0 [<ffffffff9b89f69f>] do_group_exit+0x3f/0xa0 [<ffffffff9b8b049e>] get_signal_to_deliver+0x1ce/0x5e0 [<ffffffff9b9ed3ad>] ? handle_mm_fault+0x39d/0x9b0 [<ffffffff9b82b527>] do_signal+0x57/0x6f0 [<ffffffff9bf71603>] ? __do_page_fault+0x203/0x4f0 [<ffffffff9b82bc32>] do_notify_resume+0x72/0xc0 [<ffffffff9bf6d56c>] retint_signal+0x48/0x8c