0.5.3 • Published 11 months ago

llm-load-balancer v0.5.3

Weekly downloads
-
License
MIT
Repository
github
Last release
11 months ago

llm-load-balancer

A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.

Usage

npm install llm-load-balancer
LLMload balancingbedrockvertexAIAWSGCP
@aws-sdk/client-bedrock@aws-sdk/client-bedrock-runtime@google-cloud/vertexai@langchain/aws@langchain/google-vertexailangchain
0.5.3

11 months ago

0.5.2

11 months ago

0.5.1

11 months ago

0.5.0

11 months ago

0.4.7

11 months ago

0.4.6

11 months ago

0.4.5

11 months ago

0.4.4

11 months ago

0.4.3

11 months ago

0.4.2

11 months ago

0.4.1

11 months ago

0.4.0

11 months ago

0.3.1

12 months ago

0.3.0

12 months ago

0.2.2

12 months ago

0.2.1

12 months ago

0.2.0

12 months ago

0.1.8

12 months ago

0.1.7

12 months ago

0.1.6

12 months ago

0.1.5

12 months ago

0.1.4

12 months ago

0.1.3

12 months ago

0.1.2

12 months ago

0.1.1

12 months ago

0.1.0

12 months ago