Agate's models

With Apple Intelligence on the device, with your key or with your own model: what each one does and where your questions go.

← All documentation

Agate has no model of its own and does not go through a Basalt server. It runs on the one you choose in Settings → Agate → Provider, and two things depend on that choice: how much it can do and where your questions go.

The three ways

  • Apple Intelligence, on this device. No key, no account and no network: nothing leaves it. Only on devices that have it, with it turned on in the system's Settings.
  • With your API key: Anthropic, OpenAI, OpenRouter or any service compatible with the OpenAI API. Requests go straight from your device to your provider, with your account and under its terms.
  • With your own model, on a computer on your network: Ollama or LM Studio. What you ask stays on your network.

In no case does it pass through Basalt, which neither receives nor stores it.

What each one can do

Apple's model is small. It understands your question and what is on the screen, and with that it can:

  • explain an error or what is on the screen,
  • propose the command for what you describe,
  • open a file in the editor.

With a provider or your own model, Agate also uses Basalt's actions:

  • connect to a server, add one, wake it or find out why it does not connect,
  • open and close tunnels, and create new ones,
  • create and run snippets,
  • copy and move files between the device and your servers,
  • edit the open file and save it,
  • split the window and open things beside the terminal,
  • game servers: install, start and stop, backups, add-ons and scheduled tasks,
  • keys: put one on a server, rename or remove it,
  • change the settings, the theme and the language,
  • and chain several steps: it checks first and continues with what it finds.

The list is also in Settings → Agate → What Agate can do.

The list of what Agate can do depending on the model
The list of what Agate can do depending on the model

Permission

The first time you turn Agate on, and each time you choose a provider or an address you had not allowed yet, Basalt shows what is sent, what is never sent and who receives it. Nothing is sent until you tap Allow.

Going back to a destination you already allowed does not ask again. Turning Agate off withdraws every permission.

What is sent

Each request carries your question, the text you select, the visible screen of the active pane, and the server's name and operating system. With a provider or your own model, the names of what you keep in Basalt go too — servers, keys, snippets, tunnels, categories and game servers — so it can use them.

Keys, passwords, anything typed with echo disabled and the addresses of your saved servers are never sent.

The API key

It is stored in this device's Keychain, one per provider, and is not synced. Check and load models only requests the list of models, and shows whether the address and the key are right. Agate needs a model that supports tool use.

A model on your network

Choose Ollama or LM Studio and enter the address of the computer running it, for example http://192.168.1.20:11434/v1. The device has to be on the same network.