0.5.3 • Published 6 months ago

llm-load-balancer v0.5.3

Weekly downloads
-
License
MIT
Repository
github
Last release
6 months ago

llm-load-balancer

A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.

Usage

npm install llm-load-balancer
LLMload balancingbedrockvertexAIAWSGCP
@aws-sdk/client-bedrock@aws-sdk/client-bedrock-runtime@google-cloud/vertexai@langchain/aws@langchain/google-vertexailangchain
0.5.3

6 months ago

0.5.2

6 months ago

0.5.1

6 months ago

0.5.0

6 months ago

0.4.7

6 months ago

0.4.6

6 months ago

0.4.5

6 months ago

0.4.4

6 months ago

0.4.3

6 months ago

0.4.2

6 months ago

0.4.1

6 months ago

0.4.0

6 months ago

0.3.1

7 months ago

0.3.0

7 months ago

0.2.2

7 months ago

0.2.1

7 months ago

0.2.0

7 months ago

0.1.8

7 months ago

0.1.7

7 months ago

0.1.6

7 months ago

0.1.5

7 months ago

0.1.4

7 months ago

0.1.3

7 months ago

0.1.2

7 months ago

0.1.1

7 months ago

0.1.0

7 months ago