Genkitx-ollama NPM

Ollama plugin for Genkit

Installing the plugin

npm i --save genkitx-ollama

Using the plugin

import { genkit } from 'genkit';
import { ollama } from 'genkitx-ollama';

const ai = genkit({
  plugins: [
    ollama({
      models: [{ name: 'gemma' }],
      serverAddress: 'http://127.0.0.1:11434', // default local address
    }),
  ],
});

async function main() {
  const { text } = await ai.generate({
    prompt: 'hi Gemini!',
    model: 'ollama/gemma',
  });
  console.log(text);
}

main();

The sources for this package are in the main Genkit repo. Please file issues and pull requests against that repo.

Usage information and reference details can be found in Genkit documentation.

License: Apache 2.0

genkit genkit-plugin genkit-model ollama ai genai generative-ai

1 year ago

1 year ago

1 year ago