langchain
6370808d - Adding support for async (_acall) for VertexAICommon LLM (#5588)

Commit
2 years ago
Adding support for async (_acall) for VertexAICommon LLM (#5588) # Adding support for async (_acall) for VertexAICommon LLM This PR implements the `_acall` method under `_VertexAICommon`. Because VertexAI itself does not provide an async interface, I implemented it via a ThreadPoolExecutor that can delegate execution of VertexAI calls to other threads. Twitter handle: @polecitoem : ) ## Who can review? Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: fyi - @agola11 for async functionality fyi - @Ark-kun from VertexAI
Author
Parents
Loading