PR #7084 Vulkan Bugfixes and Improvements

Vulkan Bugfixes and Improvements #7084

0cc4m merged 9 commits into master from 0cc4m/vulkan-improvements

Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders …

2423c29c

Merge remote-tracking branch 'origin/master' into 0cc4m/vulkan-moe

a124dfad

Merge remote-tracking branch 'origin/master' into 0cc4m/vulkan-moe

1e46fa8d

Further work towards MoE, disabled for now

3098206b

Disable MoE code (not ready yet), fix a number of bugs in shaders and…

f3dc7040

Add softmax with f16 mask and pos buffer support

6697303c

Disable mul_mat_id shaders for now

947df475

Fix flake8

d4abd657

ggerganov commented on 2024-05-08

ggerganov approved these changes on 2024-05-08

mofosyne added bugfix

mofosyne added Review Complexity : High

Fix validation errors caused by empty buffers on larger batch sizes

d2088cd7

0cc4m merged befddd0f into master 1 year ago

0cc4m deleted the 0cc4m/vulkan-improvements branch 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

bugfix Review Complexity : High

Milestone

No milestone