llama.cpp
[SYCL] perf: Remove per-allocation Level Zero runtime checks
#23399
Merged
Overview
Commits
25
Changes
View On GitHub

[SYCL] perf: Remove per-allocation Level Zero runtime checks #23399

ggerganov merged 25 commits into ggml-org:master from sanmai:fix/optimize-GGML_SYCL_ENABLE_LEVEL_ZERO
sanmai
sanmai [SYCL] Centralize Level Zero detection in ggml_sycl_init
5c1aa5f3
sanmai use the same wording
3c5b9390
sanmai get back the warning
84e1b568
sanmai Merge branch 'master' into fix/info-ext_oneapi_level_zero
3cd24eda
sanmai [SYCL] Remove per-allocation getenv() for GGML_SYCL_ENABLE_LEVEL_ZERO
30e84a96
sanmai bring back the comment
ee203418
sanmai
sanmai commented on 2026-05-20
github-actions github-actions added ggml
github-actions github-actions added SYCL
sanmai move it up to make sure devices call the shots
4ffe40e3
sanmai move the env detection early
20a7fbe3
sanmai sanmai marked this pull request as ready for review 39 days ago
sanmai sanmai requested a review 39 days ago
arthw
sanmai
arthw
arthw commented on 2026-05-21
sanmai sanmai marked this pull request as draft 39 days ago
sanmai sanmai marked this pull request as ready for review 39 days ago
sanmai replace g_ggml_sycl_enable_level_zero with a direct call to .ext_onea…
abe89153
sanmai update the comment
a3912cde
sanmai sanmai requested a review from arthw arthw 39 days ago
sanmai Merge branch 'master' into fix/optimize-GGML_SYCL_ENABLE_LEVEL_ZERO
9c5ca7cb
sanmai Merge branch 'master' into fix/optimize-GGML_SYCL_ENABLE_LEVEL_ZERO
b45c33ea
sanmai switch back to g_ggml_sycl_enable_level_zero with a sentinel
ee9fe3b1
sanmai remove the check
d103fc23
sanmai
sanmai commented on 2026-05-25
sanmai Reduce the diff
469342d2
sanmai reword, move lower
170f5cdc
sanmai
sanmai commented on 2026-05-25
sanmai move things aroudn
5dae6681
sanmai
sanmai
sanmai commented on 2026-05-25
sanmai remove forward declaration if favor of a full replace
b6a108d3
arthw
arthw commented on 2026-05-25
sanmai
sanmai commented on 2026-05-25
sanmai
sanmai commented on 2026-05-25
sanmai pre-cache results of zeDeviceGetProperties
137958df
sanmai sanmai requested a review from arthw arthw 35 days ago
sanmai
sanmai commented on 2026-05-25
NeoZhangJianyu
NeoZhangJianyu commented on 2026-05-26
sanmai put ggml_sycl_get_env back
0d12f723
sanmai Merge branch 'master' into fix/optimize-GGML_SYCL_ENABLE_LEVEL_ZERO
3b4224cd
sanmai
sanmai commented on 2026-05-26
sanmai replace get_sycl_env with ggml_sycl_get_env
e6fcd059
sanmai add whitespace back
5297a101
sanmai sanmai requested a review from NeoZhangJianyu NeoZhangJianyu 34 days ago
sanmai Merge branch 'master' into fix/optimize-GGML_SYCL_ENABLE_LEVEL_ZERO
78f6f3d0
sanmai
sanmai commented on 2026-05-26
sanmai Apply suggestion from @sanmai
3509f4d2
arthw
arthw approved these changes on 2026-05-27
sanmai sanmai changed the title [SYCL] Remove per-allocation getenv() for GGML_SYCL_ENABLE_LEVEL_ZERO [SYCL] perf: Remove per-allocation runtime checks in Level Zero path 33 days ago
sanmai sanmai changed the title [SYCL] perf: Remove per-allocation runtime checks in Level Zero path [SYCL] perf: Remove per-allocation Level Zero runtime checks 33 days ago
WizardlyBump17
arthw arthw added merge ready
arthw
ggerganov ggerganov merged c035ff49 into master 14 days ago
sanmai sanmai deleted the fix/optimize-GGML_SYCL_ENABLE_LEVEL_ZERO branch 14 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ggml merge ready SYCL
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum