@sugar-ai/copilot-one-js v0.0.23

Copilot One Web SDK

Supercharge your existing Web/React App with a Siri-like AI Assistant.

Key Features

• Voice To Action: Perform actions based on voice input.
• Text To Action: Perform actions based on text input.
• Current Screen Context: Auto generate embedding of current screen seend by user and create embeddings which is avaiable for RAG during LLM inferences. This make AI aware of current screen of the user and helps generate better responses.
• Text API Interface: Transform existing APIs without any coding to support a natural language interface for both requests and responses. This simplies API invoication using voice and also integration in other copilot one powered Assistants.

Supported Voice-enabled UX Agents

1. UI Agent: Enables hands-free capability to perform existing UI tasks and workflows.
2. Navigation Agent: Assists users in navigating to the right page, section, or settings.
3. Form Agent: Assist in filling form by autofilling based on voice or file input, advance validations, multilingual support. Simpler forms can be completely replaced by Voice to API Action.

These agents focuses on reducing learning curve for user and enalbes handsfree expereince for content discovery, feature discovery, user onboarding and form filling.

Check out Travel Product built using this sdk: https://youtu.be/t2e0CThWZUE

Prerequisites

Before using this package, ensure you have the following:

• An existing React application

• Create copilot credentials from Sugar AI or Self Hosted Account

Install

You can install the @sugar-ai/copilot-one-js package via npm in your react project

Installation

npm install @sugar-ai/copilot-one-js@latest