llm-foundry
f132f055 - Fix fmapi_chat for instruct models and custom tokenizers (#914)

Commit
2 years ago
Fix fmapi_chat for instruct models and custom tokenizers (#914) * Fix fmapi_chat for instruct models and custom tokenizers * remove from tiktoken * fix * add tests * fix test, 0->1 * refactor
Author
Parents
Loading