0.5.3 • Published 8 months ago

llm-load-balancer v0.5.3

Weekly downloads
-
License
MIT
Repository
github
Last release
8 months ago

llm-load-balancer

A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.

Usage

npm install llm-load-balancer
LLMload balancingbedrockvertexAIAWSGCP
@aws-sdk/client-bedrock@aws-sdk/client-bedrock-runtime@google-cloud/vertexai@langchain/aws@langchain/google-vertexailangchain
0.5.3

8 months ago

0.5.2

8 months ago

0.5.1

8 months ago

0.5.0

8 months ago

0.4.7

8 months ago

0.4.6

8 months ago

0.4.5

8 months ago

0.4.4

8 months ago

0.4.3

8 months ago

0.4.2

8 months ago

0.4.1

8 months ago

0.4.0

8 months ago

0.3.1

9 months ago

0.3.0

9 months ago

0.2.2

9 months ago

0.2.1

9 months ago

0.2.0

9 months ago

0.1.8

9 months ago

0.1.7

9 months ago

0.1.6

9 months ago

0.1.5

9 months ago

0.1.4

9 months ago

0.1.3

9 months ago

0.1.2

9 months ago

0.1.1

9 months ago

0.1.0

9 months ago