0.1.14 • Published 7 months ago
@ai-toolkit/deepinfra v0.1.14
AI TOOLKIT - DeepInfra Provider
The DeepInfra provider for the AI TOOLKIT contains language model support for the DeepInfra API, giving you access to models like Llama 3, Mixtral, and other state-of-the-art LLMs.
Setup
The DeepInfra provider is available in the @ai-toolkit/deepinfra
module. You can install it with
npm i @ai-toolkit/deepinfra
Provider Instance
You can import the default provider instance deepinfra
from @ai-toolkit/deepinfra
:
import { deepinfra } from '@ai-toolkit/deepinfra';
Example
import { deepinfra } from '@ai-toolkit/deepinfra';
import { generateText } from 'ai-toolkit';
const { text } = await generateText({
model: deepinfra('meta-llama/Llama-3.3-70B-Instruct'),
prompt: 'Write a vegetarian lasagna recipe for 4 people.',
});
Documentation
Please check out the DeepInfra provider documentation for more information.
0.1.14
7 months ago