horni-client v1.0.8

Horni-Client

Instantiate client connections to Noli's Horni API to generate the AI results.

You have to connect to a running instance of the server for it to work.

Install

npm install horni-client

Example

import HorniClient from "horni-client" // const HorniClient = require("horni-client")
const client = new HorniClient()
async function main() {
	var input       = `This is a`
	var generation  = await client.sendPrompt(input)
	var tokens      = generation.prompt.tokens.length+generation.results[0].tokens.length
	var output      = `${generation.total_elapsed_time}ms | ${tokens} Tokens w/prompt | ${input}${generation.results[0].content}`
	console.log(output);
}
main().then()

Metrics

If you want to have access to the metrics, you need it to have sent at least 25 prompts. This is to give the averages a good dataset to work from. I recommend running the initializeMetrics() method if you want to make sure you have them.