Added optional llm summerization (#498)
* Added optional llm summerization
* set summery as first 5 words
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
* delete unused file
* Pass stop sequences properly to TGI (#499)
* Pass stop sequences properly to TGI
* fix types
* Add a job in release action that updates the .env in prod (#493)
* Add a workflow that updates the .env in prod
* move update env to release workflow
* version bumps on actons
* flipped config
* black
* Save user message on request (#337) (#492)
Closes #337
* bump inference version
* lint
---------
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>