0.5.3 • Published 7 months ago

llm-load-balancer v0.5.3

Weekly downloads
-
License
MIT
Repository
github
Last release
7 months ago

llm-load-balancer

A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.

Usage

npm install llm-load-balancer
LLMload balancingbedrockvertexAIAWSGCP
@aws-sdk/client-bedrock@aws-sdk/client-bedrock-runtime@google-cloud/vertexai@langchain/aws@langchain/google-vertexailangchain
0.5.3

7 months ago

0.5.2

7 months ago

0.5.1

7 months ago

0.5.0

7 months ago

0.4.7

7 months ago

0.4.6

7 months ago

0.4.5

7 months ago

0.4.4

7 months ago

0.4.3

7 months ago

0.4.2

7 months ago

0.4.1

7 months ago

0.4.0

7 months ago

0.3.1

8 months ago

0.3.0

8 months ago

0.2.2

8 months ago

0.2.1

8 months ago

0.2.0

8 months ago

0.1.8

8 months ago

0.1.7

8 months ago

0.1.6

8 months ago

0.1.5

8 months ago

0.1.4

8 months ago

0.1.3

8 months ago

0.1.2

8 months ago

0.1.1

8 months ago

0.1.0

8 months ago