llama.cpp
llama : simplify Mamba with advanced batch splits
#8526
Merged
Overview
Commits
19
Changes
View On GitHub
Commits
  • llama : advanced batch splits
    compilade committed 1 year ago
  • Merge branch 'master' into compilade/batch-splits
    compilade committed 1 year ago
  • llama : fix integer signedness mixing
    compilade committed 1 year ago
  • llama : logits_all has priority over batch->logits
    compilade committed 1 year ago
  • llama : apply suggestions
    compilade committed 1 year ago
  • llama : fix t5 segfault
    compilade committed 1 year ago
  • Merge branch 'master' into compilade/batch-splits
    compilade committed 1 year ago
  • Merge branch 'master' into compilade/batch-splits
    compilade committed 1 year ago
  • llama : fix Mamba session save and restore
    compilade committed 1 year ago
  • llama : minor cosmetic changes
    compilade committed 1 year ago
  • Merge branch 'master' into compilade/batch-splits
    compilade committed 1 year ago
  • llama : rename llama_reorder_outputs to llama_output_reorder
    compilade committed 1 year ago
  • minor : add struct members for clarity
    ggerganov committed 1 year ago
  • Merge branch 'master' into compilade/batch-splits
    compilade committed 1 year ago
  • llama : fix T5 segfault again
    compilade committed 1 year ago
  • llama : fix Mamba pooled embeddings with multiple sequences
    compilade committed 1 year ago
  • llama : add llama_model_is_recurrent to simplify figuring that out
    compilade committed 1 year ago
  • Merge branch 'master' into compilade/batch-splits
    compilade committed 1 year ago
  • llama : fix simple splits when the batch contains embeddings
    compilade committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading