llama.cpp
83008b7c - llama : update llm_build_copy_mask_state comment [no ci] (#9385)

Commit
344 days ago
llama : update llm_build_copy_mask_state comment [no ci] (#9385) This commit updates the comment, which seems to contain a typo or be an outdated comment, in the copy_mask_state function changing the variable n_rs to n_kv. I believe this change is correct and what the comment wants to convey is to copy the states that are not going to be used in the upcoming processing, which are the tokens states from n_seqs up to the number of possible token states n_kv.
Author
Parents
  • src
    • File
      llama.cpp