Info

Permalink
Function
__unmap_single
First occurrence
2026-01-24
Last occurrence
2026-10-15
State
NEW
Components
kernel Tainted
Quality
-84

Statistics

Operating system Count
CentOS 7 180
Architecture Count
x86_64 180
Related packages Count
kernel 180
 0:3.10.0-1160.119.1.el7 111
 0:3.10.0-1160.49.1.el7 69

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1420638
Frame # Function Binary Source or offset Line
1
__unmap_single.isra.22
vmlinux 0xffffffffa8826523
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x63
2
unmap_sg
vmlinux 0xffffffffa8826e7f
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x5f
3
nv_unmap_dma_map_scatterlist
nvidia 0xffffffffc10dd3ce
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x8e
4
nv_dma_unmap_alloc
nvidia 0xffffffffc10de41b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x19b
5
_nv041699rm
nvidia 0xffffffffc1bd5fd5
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xc5
6
? _nv032724rm
nvidia 0xffffffffc113cddf
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x6f
7
? _nv036791rm
nvidia 0xffffffffc15d8924
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x174
8
? _nv036756rm
nvidia 0xffffffffc11408fb
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x6b
9
? _nv002835rm
nvidia 0xffffffffc1a1019d
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xd
10
? _nv004578rm
nvidia 0xffffffffc1a0af2e
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x1e
11
? _nv017141rm
nvidia 0xffffffffc1a06a5c
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x59c
12
? _nv045585rm
nvidia 0xffffffffc117a9eb
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xab
13
? _nv047302rm
nvidia 0xffffffffc1a044d7
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xb7
14
? _nv047301rm
nvidia 0xffffffffc1a0488f
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x2ef
15
? _nv047297rm
nvidia 0xffffffffc1a04dd7
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xa7
16
? rm_cleanup_file_private
nvidia 0xffffffffc1bd8b4b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x1db
17
? fsnotify_grab_connector
vmlinux 0xffffffffa84a7973
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x43
18
? nvidia_close
nvidia 0xffffffffc10d888b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x16b
19
? __fput
vmlinux 0xffffffffa845dfcc
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xec
20
? ____fput
vmlinux 0xffffffffa845e1fe
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xe
21
? task_work_run
vmlinux 0xffffffffa82c7f6b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xbb
22
? do_exit
vmlinux 0xffffffffa82a6174
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x2d4
23
? futex_wait
vmlinux 0xffffffffa831a61f
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x11f
24
? do_group_exit
vmlinux 0xffffffffa82a694f
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x3f
25
? get_signal_to_deliver
vmlinux 0xffffffffa82b825e
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x1ce
26
? do_signal
vmlinux 0xffffffffa822d5b7
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x57
27
? do_futex
vmlinux 0xffffffffa831c376
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x106
28
? do_notify_resume
vmlinux 0xffffffffa822dcca
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x7a
29
? int_signal
vmlinux 0xffffffffa89c56f7
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x12 
NMI watchdog: BUG: soft lockup - CPU#106 stuck for 22s! [llama-server:47885]
Modules linked in: tcp_diag inet_diag veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache nvidia_drm(POE) nvidia_modeset(POE) nvidia_uvm(OE) kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr nvidia(POE) vfat fat ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt rpcrdma sunrpc rdma_ucm ib_iser joydev cdc_ether usbnet mii sg ib_umad i2c_piix4
ipmi_si ipmi_devintf ipmi_msghandler rdma_cm ib_ipoib iw_cm pinctrl_amd i2c_designware_platform i2c_designware_core ib_cm libiscsi scsi_transport_iscsi acpi_cpufreq mlx5_ib ib_uverbs ib_core ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ast drm_kms_helper syscopyarea mlx5_core sysfillrect sysimgblt fb_sys_fops ttm igb ahci libahci drm mlxfw dca libata devlink i2c_algo_bit megaraid_sas drm_panel_orientation_quirks ptp pps_core nfit libnvdimm wmi dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 106 PID: 47885 Comm: llama-server Kdump: loaded Tainted: P           OEL ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: ASUSTeK COMPUTER INC. ESC8000A-E11/KMPG-D32 Series, BIOS 2002 08/30/2024
task: ffff90f384879080 ti: ffff90cdcf6c4000 task.ti: ffff90cdcf6c4000
RIP: 0010:[<ffffffffa8826523>]  [<ffffffffa8826523>] __unmap_single.isra.22+0x63/0x200
RSP: 0018:ffff90cdcf6c7880  EFLAGS: 00000286
RAX: 0000008000000000 RBX: 0000000000000010 RCX: 0000000000000027
RDX: ffffff8000000000 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffff90cdcf6c78b0 R08: 0000000000000003 R09: 0000000000000000
R10: 000000000000001b R11: 000ffffffffff000 R12: ffffffffffffff10
R13: 0000000000000000 R14: 0000000000000000 R15: 000088f267949000
FS:  00007fdc027d0700(0000) GS:ffff90f40e480000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f845263ed70 CR3: 0000003fc8e10000 CR4: 0000000000760ee0
PKRU: 55555554
Call Trace:
[<ffffffffa8826e7f>] unmap_sg+0x5f/0x80
[<ffffffffc10dd3ce>] nv_unmap_dma_map_scatterlist+0x8e/0xc0 [nvidia]
[<ffffffffc10de41b>] nv_dma_unmap_alloc+0x19b/0x1b0 [nvidia]
[<ffffffffc1bd5fd5>] _nv041699rm+0xc5/0x1d0 [nvidia]
[<ffffffffc113cddf>] ? _nv032724rm+0x6f/0x90 [nvidia]
[<ffffffffc15d8924>] ? _nv036791rm+0x174/0x430 [nvidia]
[<ffffffffc11408fb>] ? _nv036756rm+0x6b/0x130 [nvidia]
[<ffffffffc1a1019d>] ? _nv002835rm+0xd/0x20 [nvidia]
[<ffffffffc1a0af2e>] ? _nv004578rm+0x1e/0xb0 [nvidia]
[<ffffffffc1a06a5c>] ? _nv017141rm+0x59c/0x680 [nvidia]
[<ffffffffc117a9eb>] ? _nv045585rm+0xab/0xe0 [nvidia]
[<ffffffffc1a044d7>] ? _nv047302rm+0xb7/0x180 [nvidia]
[<ffffffffc1a0488f>] ? _nv047301rm+0x2ef/0x690 [nvidia]
[<ffffffffc1a04dd7>] ? _nv047297rm+0xa7/0x1a0 [nvidia]
[<ffffffffc1bd8b4b>] ? rm_cleanup_file_private+0x1db/0x200 [nvidia]
[<ffffffffa84a7973>] ? fsnotify_grab_connector+0x43/0x70
[<ffffffffc10d888b>] ? nvidia_close+0x16b/0x2b0 [nvidia]
[<ffffffffa845dfcc>] ? __fput+0xec/0x230
[<ffffffffa845e1fe>] ? ____fput+0xe/0x20
[<ffffffffa82c7f6b>] ? task_work_run+0xbb/0xe0
[<ffffffffa82a6174>] ? do_exit+0x2d4/0xa30
[<ffffffffa831a61f>] ? futex_wait+0x11f/0x290
[<ffffffffa82a694f>] ? do_group_exit+0x3f/0xa0
[<ffffffffa82b825e>] ? get_signal_to_deliver+0x1ce/0x5e0
[<ffffffffa822d5b7>] ? do_signal+0x57/0x6f0
[<ffffffffa831c376>] ? do_futex+0x106/0x4d0
[<ffffffffa822dcca>] ? do_notify_resume+0x7a/0xd0
[<ffffffffa89c56f7>] ? int_signal+0x12/0x17
Code: db 48 83 ec 08 4d 85 f6 74 26 66 0f 1f 44 00 00 4c 89 e6 ba 00 10 00 00 4c 89 ef 48 83 c3 01 49 81 c4 00 10 00 00 e8 0d dd ff ff <4c> 39 f3 75 e0 8b 05 f2 d3 c6 00 85 c0 0f 85 02 01 00 00 49 83
Complete report #1393845
Frame # Function Binary Source or offset Line
1
iommu_unmap_page
vmlinux 0xffffffff837fd4fd
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xed
2
__unmap_single.isra.22
vmlinux 0xffffffff837ff893
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x63
3
unmap_sg
vmlinux 0xffffffff83800d9f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x5f
4
nv_unmap_dma_map_scatterlist
nvidia 0xffffffffc49ad00e
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x8e
5
nv_dma_unmap_alloc
nvidia 0xffffffffc49ae035
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x195
6
_nv041699rm
nvidia 0xffffffffc54a4b65
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xc5
7
? _nv032724rm
nvidia 0xffffffffc4a0b96f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x6f
8
? _nv036791rm
nvidia 0xffffffffc4ea74b4
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x174
9
? _nv036756rm
nvidia 0xffffffffc4a0f48b
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x6b
10
? _nv002835rm
nvidia 0xffffffffc52ded2d
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xd
11
? _nv004578rm
nvidia 0xffffffffc52d9abe
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x1e
12
? _nv017141rm
nvidia 0xffffffffc52d55ec
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x59c
13
? _nv045585rm
nvidia 0xffffffffc4a4957b
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xab
14
? _nv047302rm
nvidia 0xffffffffc52d3067
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xb7
15
? _nv047301rm
nvidia 0xffffffffc52d341f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x2ef
16
? _nv047297rm
nvidia 0xffffffffc52d3967
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xa7
17
? rm_cleanup_file_private
nvidia 0xffffffffc54a76db
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x1db
18
? nvidia_close
nvidia 0xffffffffc49a869b
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x16b
19
? __fput
vmlinux 0xffffffff8345088c
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xec
20
? ____fput
vmlinux 0xffffffff83450abe
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xe
21
? task_work_run
vmlinux 0xffffffff832c299b
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xbb
22
? do_exit
vmlinux 0xffffffff832a1954
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x2d4
23
? futex_wait
vmlinux 0xffffffff8331358f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x11f
24
? do_group_exit
vmlinux 0xffffffff832a212f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x3f
25
? get_signal_to_deliver
vmlinux 0xffffffff832b328e
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x1ce
26
? do_signal
vmlinux 0xffffffff8322c527
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x57
27
? do_futex
vmlinux 0xffffffff833152a6
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x106
28
? pick_next_task_fair
vmlinux 0xffffffff832e9d2e
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x61e
29
? sched_clock_cpu
vmlinux 0xffffffff832de305
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x85
30
? do_notify_resume
vmlinux 0xffffffff8322cc32
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x72
31
? int_signal
vmlinux 0xffffffff839962ef
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x12 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 67s! [pt_main_thread:28728]
Modules linked in: overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter mgc(OE) lustre(OE) lmv(OE) mdc(OE) fid(OE) osc(OE) lov(OE) fld(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) rdma_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) dell_rbu sunrpc nvidia_drm(POE) nvidia_modeset(POE) nvidia_uvm(OE) nvidia(POE) vfat fat kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper dell_smbios cryptd dcdbas dell_wmi_descriptor pcspkr sg ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter i2c_piix4
knem(OE) binfmt_misc ip_tables ext4 mbcache jbd2 mlx5_ib(OE) ib_uverbs(OE) ib_core(OE) sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci mlx5_core(OE) drm crct10dif_pclmul crct10dif_common crc32c_intel libata mlxfw(OE) psample ptp pps_core auxiliary(OE) devlink drm_panel_orientation_quirks mlx_compat(OE) wmi dm_mirror dm_region_hash dm_log dm_mod xpmem(OE) fuse
CPU: 0 PID: 28728 Comm: pt_main_thread Kdump: loaded Tainted: P           OE  ------------ T 3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge XE8545/099K88, BIOS 2.14.1 12/18/2023
task: ffff8e69a25e8000 ti: ffff8f022b2dc000 task.ti: ffff8f022b2dc000
RIP: 0010:[<ffffffff837fd4fd>]  [<ffffffff837fd4fd>] iommu_unmap_page+0xed/0x110
RSP: 0018:ffff8f022b2df870  EFLAGS: 00000286
RAX: 0000008000000000 RBX: 0000000000000000 RCX: 0000000000000027
RDX: ffffff8000000000 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffff8f022b2df870 R08: 0000000000000001 R09: 0000000000000000
R10: 000000000000001b R11: 000ffffffffff000 R12: 0000000000000027
R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
FS:  00002ba93e00f700(0000) GS:ffff8e6b3fe00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002ba7e0000898 CR3: 0000004bb6c10000 CR4: 0000000000760ef0
PKRU: 55555554
Call Trace:
[<ffffffff837ff893>] __unmap_single.isra.22+0x63/0x200
[<ffffffff83800d9f>] unmap_sg+0x5f/0x70
[<ffffffffc49ad00e>] nv_unmap_dma_map_scatterlist+0x8e/0xb0 [nvidia]
[<ffffffffc49ae035>] nv_dma_unmap_alloc+0x195/0x1a0 [nvidia]
[<ffffffffc54a4b65>] _nv041699rm+0xc5/0x1d0 [nvidia]
[<ffffffffc4a0b96f>] ? _nv032724rm+0x6f/0x90 [nvidia]
[<ffffffffc4ea74b4>] ? _nv036791rm+0x174/0x430 [nvidia]
[<ffffffffc4a0f48b>] ? _nv036756rm+0x6b/0x130 [nvidia]
[<ffffffffc52ded2d>] ? _nv002835rm+0xd/0x20 [nvidia]
[<ffffffffc52d9abe>] ? _nv004578rm+0x1e/0xb0 [nvidia]
[<ffffffffc52d55ec>] ? _nv017141rm+0x59c/0x680 [nvidia]
[<ffffffffc4a4957b>] ? _nv045585rm+0xab/0xe0 [nvidia]
[<ffffffffc52d3067>] ? _nv047302rm+0xb7/0x180 [nvidia]
[<ffffffffc52d341f>] ? _nv047301rm+0x2ef/0x690 [nvidia]
[<ffffffffc52d3967>] ? _nv047297rm+0xa7/0x1a0 [nvidia]
[<ffffffffc54a76db>] ? rm_cleanup_file_private+0x1db/0x200 [nvidia]
[<ffffffffc49a869b>] ? nvidia_close+0x16b/0x2b0 [nvidia]
[<ffffffff8345088c>] ? __fput+0xec/0x230
[<ffffffff83450abe>] ? ____fput+0xe/0x10
[<ffffffff832c299b>] ? task_work_run+0xbb/0xe0
[<ffffffff832a1954>] ? do_exit+0x2d4/0xa30
[<ffffffff8331358f>] ? futex_wait+0x11f/0x280
[<ffffffff832a212f>] ? do_group_exit+0x3f/0xa0
[<ffffffff832b328e>] ? get_signal_to_deliver+0x1ce/0x5e0
[<ffffffff8322c527>] ? do_signal+0x57/0x6f0
[<ffffffff833152a6>] ? do_futex+0x106/0x4d0
[<ffffffff832e9d2e>] ? pick_next_task_fair+0x61e/0x870
[<ffffffff832de305>] ? sched_clock_cpu+0x85/0xc0
[<ffffffff8322cc32>] ? do_notify_resume+0x72/0xc0
[<ffffffff839962ef>] ? int_signal+0x12/0x17
Code: 01 c7 4c 39 f3 77 87 4d 85 f6 75 23 48 8b 75 d0 65 48 33 34 25 28 00 00 00 4c 89 f0 75 1c 48 83 c4 10 5b 41 5c 41 5d 41 5e 41 5f <5d> c3 0f 0b 49 8d 46 ff 4c 85 f0 74 d4 0f 0b e8 bf da a9 ff 0f