inference-activity v0.0.1

inference-activity

Inference Activity CLI plugin

• Usage
• Commands

Usage

$ heroku plugins:install inference-activity
$ heroku inference-activity:COMMAND
running command...
$ heroku inference-activity --help [COMMAND]
USAGE
  $ heroku inference-activity:COMMAND
...

Commands

• heroku inference-activity:docs
• heroku inference-activity:models:call MODEL_RESOURCE

heroku inference-activity:docs

opens docs for Inference Activity in your web browser

USAGE
  $ heroku inference-activity:docs [--browser <value>]

FLAGS
  --browser=<value>  browser to open docs with (example: "firefox", "safari")

DESCRIPTION
  opens docs for Inference Activity in your web browser

See code: src/commands/inference-activity/docs.ts

heroku inference-activity:models:call MODEL_RESOURCE

make an inference request to a specific AI model resource

USAGE
  $ heroku inference-activity:models:call MODEL_RESOURCE -p <value> [-a <value>] [-j] [--optfile <value>] [--opts <value>] [-o
    <value>] [-r <value>]

ARGUMENTS
  MODEL_RESOURCE  resource ID or alias of the model (the --app flag must be included if an alias is used)

FLAGS
  -a, --app=<value>      name or ID of the app (this flag is required if an alias is used for the MODEL_RESOURCE
                         argument)
  -j, --json             output response as JSON
  -o, --output=<value>   the file path where the command writes the model response
  -p, --prompt=<value>   (required) the input prompt for the model
  -r, --remote=<value>   git remote of app to use
      --optfile=<value>  additional options for model inference, provided as a JSON config file
      --opts=<value>     additional options for model inference, provided as a JSON string

DESCRIPTION
  make an inference request to a specific AI model resource

EXAMPLES
  $ heroku inference-activity:models:call my_llm --app my-app --prompt "What is the meaning of life?"

  $ heroku inference-activity:models:call diffusion --app my-app --prompt "Generate an image of a sunset" --opts '{"quality":"hd"}' -o sunset.png

See code: src/commands/inference-activity/models/call.ts