PR #24732 [x86] matmul8bit memory loading perf tuning

[x86] matmul8bit memory loading perf tuning #24732

snnn merged 2 commits into main from fajin/matmul8bit_x64_perf

use aligned loading. 10% token generation speed up

7f361990

use preloading for 128 blksize

1d0bb06c

fajin-corp requested a review 363 days ago

liqunfu approved these changes on 2025-05-13

hanbitmyths approved these changes on 2025-05-15

yufenglee approved these changes on 2025-05-15

snnn merged fd3e0e84 into main 360 days ago

snnn deleted the fajin/matmul8bit_x64_perf branch 360 days ago

Reviewers

hanbitmyths

yufenglee

liqunfu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone