cohere-toolkit

f428da90 - Assistants/main (#369)

Assistants/main (#369) * Change * coral-web: make agents the default page (#300) use agents as main pages * GDrive Connector with Compass (#277) * Initial * Change * linting * Test * Tests * save initial changes * docker compose db name * saves * saves * google drive scope * Add extra scope * save nits * merge branches * add FRONTEND_HOSTNAME in cli first run * retrieve and respond with google drive files text * latest state * revert change * revert poetry.lock * update pyproject.toml * formatting changes * more restrictive permission * Fix token refresh functionality * remove backend-logs target and revert .pre-commit.yaml * Formatting and address comments * udpate compass env variables * add compass sdk * google drive picker * end to end GDrive with file picker * make lint * pass CI --------- Co-authored-by: BeatrixCohere <128378696+BeatrixCohere@users.noreply.github.com> * update .env.example * revert .env.example, update .env.template * Single container deployment * Assistants/main - FE code cleanup (#306) FE cleanup * fix(frontend): tools display name * fix(frontend): use DEPLOYMENT_SINGLE_CONTAINER default * show tool description * Remove model * Change * Google Drive picker with no reuath * coral-web: preselect + hide read_document and search_file tools in agent form (#310) * set default tools in agent creation * hide file + document tools from agent form ui * add file picker to create agent * pass through redirect uri * more redirect_url * p=t * update redirect url * add google drive auth and picker * fix prefetch queries * cleanup GDrive UI implementation (#317) * cleanup GDrive UI implementation * cleanup GDrive UI implementation * fix format * delete agents * fix routing * send google drive file/folder ids to create agent * fix tools sent to /chat * fix useListAgentToolsMetadata * Chat: add agent_id (#319) * Chat: add agent_id * fix be * fix non streamed chat * logs * remove logs * frontend: agent_id in request body --------- Co-authored-by: Abigail Mackenzie-Armes <abigail@cohere.com> * Chat: fix infinite loop (#321) * google drive files as tools metadata * Reverting prod targets * fix key console error * improvements to google drive picker * code cleanup unused vars * Some fixes for agents + tools (#325) * + catching the validation error for now. + fix test_agent_tool_metadata * preparing for prod target - however the next.js app frontend app doesn't start * fix next build * lint --------- Co-authored-by: Rod <> Co-authored-by: Khalil Najjar <knajjars@gmail.com> Co-authored-by: lusmoura <luisa@cohere.com> * chore(toolkit): cleanup and improve code for google drive file picker (#329) * google picker custom styles * fix create assistant with stored values * UI nits * add edit to agents settings * improvements to UX * fix(toolkit): refactor agent components to improve data flow and type-safety (#338) * refactor agent components * Revert changes for loading pending UI * simplify * finish PR * client generate * code feedback * gdrive docs with compass context for updates and URL * compass update interval * fix comment * unique Compass index per agent per tool * Fixing prod target for next.js + CD for github (#334) * Fixing prod target for next.js + CD for github * fix build --------- Co-authored-by: Rod <> Co-authored-by: Tomeu Cabot <tomeu@cohere.com> * feat(toolkit): connect update agent to update tool metadata (#342) merge main and fix update agent to include tools metadata * fix AgentForm * restrict agent to artifacts + GDrive shortcut mimetype * add compass index refresh * fix mobile create agent * add title in google drive search results * chore(toolkit) merge main into assistants/main (#346) * merge main * format * bring upgrade from openapi to assistants/main (#347) * merge main * lint * Fix types for update agent tool metadata * add search results event in UI * fix(tookit): tags in chat history are getting removed after submitting (#351) fix(toolkit): tags in chat history are getting removed after submitting * feat(toolkit): Improve artifacts UI (#353) * feat(toolkit): artifacts UI improvements * remove outline * improvements to UX * Metrics: fix error when data is None and improve logger (#348) * Metrics: fix error when data is None * add logger * set level * remove set level * comment * lint * fix dupe edit icon * Logs: add more logs to chat (#355) * Metrics: return sync generator (#364) * fix(frontend): redirect on 401 (#359) * fix: layout for urls * fix: send onError when the finish reason isn't complete * fix: redirect on 401 * Metrics: make everything async (#365) * Metrics: make everything async * remove comments * lnit * fix rebase * fix generate title * fix search conversation * fix UI * feat(toolkit): Dedupe links when URL is cited multiple times in the references (#371) * feat(toolkit): Dedupe links when URL is cited multiple times in the response * code feedback * Make tool calls async (#373) make tool calls async due to new async paradigm * metrics: allow suppressing curl logs (#372) * allow suppressing curl logs * lint * Fix google drive merge (#370) * fix google drive merge * fix format * fix GDrive async + error handling for auth cases * revert id * formatting --------- Co-authored-by: giannis <giannis@cohere.com> * regenerate client * add stream_search_results in StreamToolCallsGeneration * add back stream search results UI event * fix(toolkit): multi tool status on latest message only (#378) * fix(toolkit): multi tool status on latest message only * format code * fix update panel UI * fix(toolkit): Requests will go into pending on window visibility hidden (#379) fix(toolkit): requests will pause on window pause * fix(toolkit): disable file picker component for non-owners (#380) * backend: fix all unit tests for assistants/main (#377) * fix agent and chat routers tests * fix all unit tests * remove debug statement * fix oidc reqs in pytest * lint fe * fix agentForm * support all drives plus gdrive error handling * fix on local variable not found * support gdrive without Compass * escaping single quotes * patch share drive query list * nits on gdrive * Update docker_push_frontend.yml * Python interpreter: make call async (#386) * fix CI * metrics: add event types (#376) * dia * move mapping code to client * remove status code * refactor * disable auth strategy, fix mapping code * lint * fix pydantic errors * lint * metrics: user and agent metrics tests (#382) * fix agent and chat routers tests * fix all unit tests * remove debug statement * fix oidc reqs in pytest * lint fe * baby steps * first useful test * revert unintended change * agents tests * user tests --------- Co-authored-by: Scott <scottchu@cohere.com> * fix helper script --------- Co-authored-by: Scott <scottchu@cohere.com> * feat(toolkit): protect pages before rendering (#388) feat(toolkit): protected pages * Files: add more file types to assistants/main (#375) * Files: support more file types and improve parsing * comments * comments * fix poetry lock * PDF parsing * add docx and fix non-agent chatbot * Remove logs * fix lint * infra(toolkit): fix deployment target for UI on prod and dev (#394) * infra(toolkit): fix deployment target for UI on prod and dev * infra(toolkit): fix deployment target for UI on prod and dev * fix docker * fix placeholder text * disable composer on empty message * backend: web scraping in tools + fix metrics data use in tools (#393) * all changes * lint * code review changes * error msg * update tool descriptions * fix * temp: /tool/auth * temp: fixing deployment * temp: fixing deployment * temp: fixing deployment * metrics/fix exceptions (#398) * Change * coral-web: make agents the default page (#300) use agents as main pages * GDrive Connector with Compass (#277) * Initial * Change * linting * Test * Tests * save initial changes * docker compose db name * saves * saves * google drive scope * Add extra scope * save nits * merge branches * add FRONTEND_HOSTNAME in cli first run * retrieve and respond with google drive files text * latest state * revert change * revert poetry.lock * update pyproject.toml * formatting changes * more restrictive permission * Fix token refresh functionality * remove backend-logs target and revert .pre-commit.yaml * Formatting and address comments * udpate compass env variables * add compass sdk * google drive picker * end to end GDrive with file picker * make lint * pass CI --------- Co-authored-by: BeatrixCohere <128378696+BeatrixCohere@users.noreply.github.com> * update .env.example * revert .env.example, update .env.template * Single container deployment * Assistants/main - FE code cleanup (#306) FE cleanup * fix(frontend): tools display name * fix(frontend): use DEPLOYMENT_SINGLE_CONTAINER default * show tool description * Remove model * Change * Google Drive picker with no reuath * coral-web: preselect + hide read_document and search_file tools in agent form (#310) * set default tools in agent creation * hide file + document tools from agent form ui * add file picker to create agent * pass through redirect uri * more redirect_url * p=t * update redirect url * add google drive auth and picker * fix prefetch queries * cleanup GDrive UI implementation (#317) * cleanup GDrive UI implementation * cleanup GDrive UI implementation * fix format * delete agents * fix routing * send google drive file/folder ids to create agent * fix tools sent to /chat * fix useListAgentToolsMetadata * Chat: add agent_id (#319) * Chat: add agent_id * fix be * fix non streamed chat * logs * remove logs * frontend: agent_id in request body --------- Co-authored-by: Abigail Mackenzie-Armes <abigail@cohere.com> * Chat: fix infinite loop (#321) * google drive files as tools metadata * Reverting prod targets * fix key console error * improvements to google drive picker * code cleanup unused vars * Some fixes for agents + tools (#325) * + catching the validation error for now. + fix test_agent_tool_metadata * preparing for prod target - however the next.js app frontend app doesn't start * fix next build * lint --------- Co-authored-by: Rod <> Co-authored-by: Khalil Najjar <knajjars@gmail.com> Co-authored-by: lusmoura <luisa@cohere.com> * chore(toolkit): cleanup and improve code for google drive file picker (#329) * google picker custom styles * fix create assistant with stored values * UI nits * add edit to agents settings * improvements to UX * fix(toolkit): refactor agent components to improve data flow and type-safety (#338) * refactor agent components * Revert changes for loading pending UI * simplify * finish PR * client generate * code feedback * gdrive docs with compass context for updates and URL * compass update interval * fix comment * unique Compass index per agent per tool * Fixing prod target for next.js + CD for github (#334) * Fixing prod target for next.js + CD for github * fix build --------- Co-authored-by: Rod <> Co-authored-by: Tomeu Cabot <tomeu@cohere.com> * feat(toolkit): connect update agent to update tool metadata (#342) merge main and fix update agent to include tools metadata * fix AgentForm * restrict agent to artifacts + GDrive shortcut mimetype * add compass index refresh * fix mobile create agent * add title in google drive search results * chore(toolkit) merge main into assistants/main (#346) * merge main * format * bring upgrade from openapi to assistants/main (#347) * merge main * lint * Fix types for update agent tool metadata * add search results event in UI * fix(tookit): tags in chat history are getting removed after submitting (#351) fix(toolkit): tags in chat history are getting removed after submitting * feat(toolkit): Improve artifacts UI (#353) * feat(toolkit): artifacts UI improvements * remove outline * improvements to UX * Metrics: fix error when data is None and improve logger (#348) * Metrics: fix error when data is None * add logger * set level * remove set level * comment * lint * fix dupe edit icon * Logs: add more logs to chat (#355) * Metrics: return sync generator (#364) * fix(frontend): redirect on 401 (#359) * fix: layout for urls * fix: send onError when the finish reason isn't complete * fix: redirect on 401 * Metrics: make everything async (#365) * Metrics: make everything async * remove comments * lnit * fix rebase * fix generate title * fix search conversation * fix UI * feat(toolkit): Dedupe links when URL is cited multiple times in the references (#371) * feat(toolkit): Dedupe links when URL is cited multiple times in the response * code feedback * Make tool calls async (#373) make tool calls async due to new async paradigm * metrics: allow suppressing curl logs (#372) * allow suppressing curl logs * lint * Fix google drive merge (#370) * fix google drive merge * fix format * fix GDrive async + error handling for auth cases * revert id * formatting --------- Co-authored-by: giannis <giannis@cohere.com> * regenerate client * add stream_search_results in StreamToolCallsGeneration * add back stream search results UI event * fix(toolkit): multi tool status on latest message only (#378) * fix(toolkit): multi tool status on latest message only * format code * fix update panel UI * fix(toolkit): Requests will go into pending on window visibility hidden (#379) fix(toolkit): requests will pause on window pause * fix(toolkit): disable file picker component for non-owners (#380) * backend: fix all unit tests for assistants/main (#377) * fix agent and chat routers tests * fix all unit tests * remove debug statement * fix oidc reqs in pytest * lint fe * fix agentForm * support all drives plus gdrive error handling * fix on local variable not found * support gdrive without Compass * escaping single quotes * patch share drive query list * nits on gdrive * Update docker_push_frontend.yml * Python interpreter: make call async (#386) * fix CI * metrics: add event types (#376) * dia * move mapping code to client * remove status code * refactor * disable auth strategy, fix mapping code * lint * fix pydantic errors * lint * metrics: user and agent metrics tests (#382) * fix agent and chat routers tests * fix all unit tests * remove debug statement * fix oidc reqs in pytest * lint fe * baby steps * first useful test * revert unintended change * agents tests * user tests --------- Co-authored-by: Scott <scottchu@cohere.com> * fix helper script --------- Co-authored-by: Scott <scottchu@cohere.com> * feat(toolkit): protect pages before rendering (#388) feat(toolkit): protected pages * Files: add more file types to assistants/main (#375) * Files: support more file types and improve parsing * comments * comments * fix poetry lock * PDF parsing * add docx and fix non-agent chatbot * Remove logs * fix lint * infra(toolkit): fix deployment target for UI on prod and dev (#394) * infra(toolkit): fix deployment target for UI on prod and dev * infra(toolkit): fix deployment target for UI on prod and dev * fix docker * fix placeholder text * disable composer on empty message * backend: web scraping in tools + fix metrics data use in tools (#393) * all changes * lint * code review changes * error msg * update tool descriptions * fix * temp: /tool/auth * temp: fixing deployment * temp: fixing deployment * temp: fixing deployment * try logging exceptions in metrics instead of throwing --------- Co-authored-by: BeatrixCohere <128378696+BeatrixCohere@users.noreply.github.com> Co-authored-by: misspia-cohere <140425731+misspia-cohere@users.noreply.github.com> Co-authored-by: Giannis <145396613+giannis2two@users.noreply.github.com> Co-authored-by: giannis <giannis@cohere.com> Co-authored-by: Khalil Najjar <knajjars@gmail.com> Co-authored-by: Abigail Mackenzie-Armes <abigail@cohere.com> Co-authored-by: Luísa Moura <luisa@cohere.com> Co-authored-by: Rod <> Co-authored-by: rodrigue-h <4142030+rodrigue-h@users.noreply.github.com> Co-authored-by: Tomeu Cabot <tomeu@cohere.com> Co-authored-by: Scott <146760070+scott-cohere@users.noreply.github.com> Co-authored-by: Scott <scottchu@cohere.com> * Metrics: test deployment without metrics (#400) * Revert "Metrics: test deployment without metrics" (#401) Revert "Metrics: test deployment without metrics (#400)" This reverts commit a1e9e7dc73f14fb71ae783fe7abfe8d8711dc623. * removing logs and adding custome network in docker compose * temp: log * i think: fix on gdrive hang * temp: add log * temp: add log * reducing search results * shortcut files fix * remove prints * Change * Add logs * Remove async * Use async generator context manager * fix(toolkit): do not allow to remove tools on composer for assistants (#409) * Disable rerank * Test sync code (#410) * Fix sync code * Fix sync code again * Remove metrics * Revert "Remove metrics" This reverts commit 2d3429e39228e4dd9f662a4e86d0fdf46989a135. * Revert "Fix sync code again" This reverts commit bb0cc8c6d781b90e632ed66e69f7032d5e5d11c4. * Revert "Fix sync code" This reverts commit 6b74709a45347169de6f2d1c50266c924d2a78b0. * Remove async * Fix google drive * fix * Disable rerank * Change * Revert "Change" This reverts commit af08fae4942d7d151cd6482b98d44ffd8c5255bc. * Revert "Revert "Change"" This reverts commit f85fb318792397809c21c6717556b639b1af07fb. * fix(toolkit): Limit GDrive file/folders upload (#413) * fix: increase toolEvents when pushing search results event (#412) * Rollback GDrive to be sync * Remove async_download timeout * nit * fix(toolkit): keep-alive connection with Be * Add timeout * add text/markdown and text/plain * Make everything async again (#414) * Make everything async again * fix test * fix(toolkit): Improves file upload component and user experience (#411) fix(toolkit): fix file upload UI bugs * GDrive: make it async again (#418) * coral-web: hide agents views components behind env variable (#405) * hide agents list and layout behind env var * use settings tab + regular tools tab when agents mode is off * clean up, add agents layouts to discover/new pages * use protect page component, dont disable composer when agent mode is off * fix conversationlistpanel --------- Co-authored-by: Khalil Najjar <knajjars@gmail.com> * Update config (#421) COnfig --------- Co-authored-by: BeatrixCohere <128378696+BeatrixCohere@users.noreply.github.com> Co-authored-by: misspia-cohere <140425731+misspia-cohere@users.noreply.github.com> Co-authored-by: Giannis <145396613+giannis2two@users.noreply.github.com> Co-authored-by: giannis <giannis@cohere.com> Co-authored-by: Abigail Mackenzie-Armes <abigail@cohere.com> Co-authored-by: Luísa Moura <luisa@cohere.com> Co-authored-by: Rod <> Co-authored-by: rodrigue-h <4142030+rodrigue-h@users.noreply.github.com> Co-authored-by: Tomeu Cabot <tomeu@cohere.com> Co-authored-by: Tanzim Mokammel <20617008+mtanzim@users.noreply.github.com> Co-authored-by: Scott <146760070+scott-cohere@users.noreply.github.com> Co-authored-by: Scott <scottchu@cohere.com>