PR #3881 llm : add llm_build_context

llm : add llm_build_context #3881

ggerganov merged 4 commits into master from llm-build-context

llm : add llm_build_context

9284aa6a

llm : deduce norm eps based on type + explict max_alibi_bias, clamp_kqv

995ee091

ggerganov added refactoring

ggerganov marked this pull request as ready for review 1 year ago

llm : restore the non-graph llm_build_ functional API

78186f40

ggerganov force pushed from d056d629 to 78186f40 1 year ago

llm : cleanup + comments

a8796f96

ggerganov merged 50337961 into master 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

refactoring

Milestone

No milestone