0.5.3 • Published 9 months ago

llm-load-balancer v0.5.3

Weekly downloads
-
License
MIT
Repository
github
Last release
9 months ago

llm-load-balancer

A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.

Usage

npm install llm-load-balancer
LLMload balancingbedrockvertexAIAWSGCP
@aws-sdk/client-bedrock@aws-sdk/client-bedrock-runtime@google-cloud/vertexai@langchain/aws@langchain/google-vertexailangchain
0.5.3

9 months ago

0.5.2

9 months ago

0.5.1

9 months ago

0.5.0

9 months ago

0.4.7

9 months ago

0.4.6

9 months ago

0.4.5

9 months ago

0.4.4

9 months ago

0.4.3

9 months ago

0.4.2

9 months ago

0.4.1

9 months ago

0.4.0

9 months ago

0.3.1

10 months ago

0.3.0

10 months ago

0.2.2

10 months ago

0.2.1

10 months ago

0.2.0

10 months ago

0.1.8

10 months ago

0.1.7

10 months ago

0.1.6

10 months ago

0.1.5

10 months ago

0.1.4

10 months ago

0.1.3

10 months ago

0.1.2

10 months ago

0.1.1

10 months ago

0.1.0

10 months ago