llama.cpp
context : always use non-causal attention for encoder graphs
#12447
Merged

context : always use non-causal attention for encoder graphs #12447

ggerganov merged 2 commits into master from gg/context-fix-enc-attn-type
ggerganov
ggerganov context : always use non-causal attention for encoder graphs
a0554c3c
ggerganov ggerganov requested a review from fairydreaming fairydreaming 207 days ago
fairydreaming
ggerganov context : move the change to llama_context::encode()
29acf2cf
fairydreaming
fairydreaming approved these changes on 2025-03-18
ggerganov ggerganov merged 8551c44d into master 207 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone