Adding support for async (_acall) for VertexAICommon LLM (#5588)
# Adding support for async (_acall) for VertexAICommon LLM
This PR implements the `_acall` method under `_VertexAICommon`. Because
VertexAI itself does not provide an async interface, I implemented it
via a ThreadPoolExecutor that can delegate execution of VertexAI calls
to other threads.
Twitter handle: @polecitoem : )
## Who can review?
Community members can review the PR once tests pass. Tag
maintainers/contributors who might be interested:
fyi - @agola11 for async functionality
fyi - @Ark-kun from VertexAI