@llmstudios/cuse NPM

🚀 Cuse

AI Computer Use Abstraction Layer — toolkit for implementing computer usage capabilities for AI agents 🤖

✨ Features

💻 Computer Interaction: screenshots, typing, mouse actions
📝 Text Editor Operations: view, create, edit files
🔧 Command Execution: terminal commands, restart
🔌 Extensible Framework: customizable functionalities
Currently supports Linux Ubuntu via local Docker image 🚀

🚀 Quickstart

Setup and start the Linux Ubuntu instance:

npx @llmstudios/cuse start

Install the Cuse package:

npm install @llmstudios/cuse

Create a Computer instance

import { Computer } from "@llmstudios/cuse";

const computer = new Computer();

Use the computer.tools in your AI SDK tool parameter

const tools = computer.tools;

const stream = streamText({
	model: anthropic("claude-3-5-sonnet-latest"),
	messages,
	tools: {
		...computer.tools,
	},
	maxSteps: 30,
});

⚡ Usage

Linux Implementation Available: Use the Computer class to interact with the Linux Ubuntu instance.
Methods for:
- Computer Interaction: screenshot(), key(), type(), mouseMove(), click(), etc.
- Terminal Commands: command(), restart()
- Text Editor: view(), create(), strReplace(), insert(), undoEdit()