Simple-deepinfra NPM

npm npm

simple-deepinfra

Simple DeepInfra API Wrapper - simple interface to use DeepInfra's Inference API.

Installation

npm install simple-deepinfra

Usage

Use dolphin-2.6-mixtral-8x7b

The Dolphin 2.6 Mixtral 8x7b model, uncensored and trained on diverse datasets including coding, excels at programming tasks and general conversation.

import {Dolphin} from "simple-deepinfra";
const apiKey = "YOUR_DEEP_INFRA_API_KEY";
const dolphin = new Dolphin(apiKey);
const input = "[INST] Say hi [/INST]";
const output = await dolphin.generate(input);
const text = output.results[0].generated_text; 
console.log(text);

Use Mixtral-8x7B-Instruct-v0.1

The Mixtral mixture of expert model, developed by Mistral AI, is an innovative experimental machine learning model that leverages a mixture of 8 experts (MoE) within 7b models. Its release was facilitated via a torrent, and the model's implementation remains in the experimental phase.

import {Mixtral} from "simple-deepinfra";
const apiKey = "YOUR_DEEP_INFRA_API_KEY";
const mixtral = new Mixtral(apiKey);
const input = "[INST] Say hi [/INST]";
const output = await mixtral.generate(input);
const text = output.results[0].generated_text;
console.log(text);

Use gte-base

import {GteBase} from "simple-deepinfra";
const apiKey = "YOUR_DEEP_INFRA_API_KEY";
const gteBase = new GteBase(apiKey);
const inputs = [
    "What is the capital of France?",
    "What is the capital of Germany?",
    "What is the capital of Italy?"
];
const output = await gteBase.generate(inputs);
const embeddings = output.embeddings[0];
console.log(embeddings);

Use SDXL to generate images

import {Sdxl} from "simple-deepinfra";
import axios from "axios";
const apiKey = "YOUR_DEEP_INFRA_API_KEY";
const misc = async () => {
  const model = new Sdxl(apiKey);

  const input = 'The quick brown fox jumps over the lazy dog with';
  const response = await model.generate(input);
  const {output} = response;
  const image = output[0];

  await axios.get(image, {responseType: 'arraybuffer'}).then((response) => {
    fs.writeFileSync('image.png', response.data);
  });

};