Get AI writing suggestions, fully offline

Arqenne's Local AI Assistant rewrites and improves the text you select — tightening prose, fixing grammar, and sharpening clarity — right inside the editor. It runs entirely on your computer, on macOS and Linux. Your text is never sent to a server, and once the model is downloaded, suggestions work with no internet connection at all.

This guide covers what you need, how to use it, and how to shape suggestions to fit your project.


Before you start

You need:

  1. A supported computer. An Apple Silicon Mac (the model runs on the Mac's GPU), or a 64-bit Linux PC with Ubuntu 24.04 or newer or Debian 13 (the Standard edition runs it on the processor, the NVIDIA edition on an NVIDIA graphics card).
  2. The Local AI Assistant downloaded. Download it once from Settings › Models (or from the prompt on the home screen). Plan for about 10 GB. On computers with 12 GB of memory or more, Arqenne uses a larger, higher-context variant that can take more of your manuscript into account when rewriting.
  3. An internet connection for that first download only. After the model is on disk, everything runs offline.

You can keep writing while the download runs; its progress shows in Settings › Models.


How it works

When you select a passage in the editor, a selection (bubble) toolbar appears above your text. If the Local AI Assistant is ready, that toolbar includes a ✦ Suggest button. Pressing it sends your selected text to the on-device model, which proposes an improved version.

The suggestion is shown as a word-level diff: words to be removed appear in red, and new words appear in green. Nothing changes in your manuscript until you decide — you review the diff and choose:

ActionWhat it does
AcceptReplaces your selected text with the suggested version.
RejectLeaves your text exactly as it was.

Because the change is always opt-in, you can ask for suggestions freely and keep only the ones you like.


Step by step

  1. Select the text you want to improve. A sentence, a paragraph, or a short passage works best.
  2. Find the ✦ Suggest button in the selection toolbar that appears over your highlighted text.
  3. Press ✦ Suggest. The model reads your selection and generates a rewrite on your computer.
  4. Review the diff. Red marks what would be removed; green marks what would be added.
  5. Accept to replace your text, or Reject to keep your original wording.

Suggestions are scoped to what you select. To revise just one sentence, select only that sentence — you'll get a focused rewrite rather than a wholesale rework of the surrounding paragraph.


Shaping suggestions to your project

The Local AI Assistant doesn't work in a vacuum. It follows your project's writing style and genre, so a rewrite for a hard-boiled mystery reads differently from one for a formal research piece. This keeps suggestions consistent with the voice of your work instead of flattening everything into generic prose.

You set this context in your project settings, alongside your style and genre choices. Adjust those settings and future suggestions will follow the new direction.


Button states

The selection toolbar shows what the model is doing, so you always know whether suggestions are available:

What you seeWhat it means
AI and a percentageThe Local AI Assistant is downloading. Suggestions aren't ready yet.
Loading AI…The model is being loaded into memory, which happens the first time you use it. Almost ready.
✦ SuggestThe model is ready. Select text and press it to get a suggestion.
No buttonThe Local AI Assistant isn't downloaded yet (see Troubleshooting).

A suggestion never blocks your writing. If the model isn't ready, the editor behaves exactly as it normally would.


Troubleshooting

The ✦ Suggest button isn't showing

A few things to check, in order:

  1. Have you selected text? The button only appears in the selection toolbar when you have a selection. Click and drag to highlight a passage first.
  2. Is the Local AI Assistant downloaded? Open Settings › Models and check its card. If it says it isn't downloaded, press Download.
  3. Is it still downloading or loading? Give it a moment. The toolbar shows the download percentage, then Loading AI…, before ✦ Suggest appears.

A suggestion isn't helpful

  • Try a smaller selection. A single sentence or a short passage gives the model a clearer target than several paragraphs at once.
  • Rephrase your original slightly and try again — a small change to the input often produces a noticeably better rewrite.
  • Check your project's style and genre in project settings. If suggestions feel off-tone, the context may be steering them in the wrong direction.
  • Reject and move on. Nothing changes unless you Accept, so an unhelpful suggestion costs you nothing.

Where the model lives

The Local AI Assistant is stored in Arqenne's app data folder:

SystemFolder
macOS~/Library/Application Support/com.arqenne.studio/ckpt/logit/
Linux~/.local/share/com.arqenne.studio/ckpt/logit/

You don't need to touch this folder for normal use. To free up the space, delete the model from its card in Settings › Models.


Privacy

  • Everything runs on your computer. Your selected text is processed by the on-device model — it is never sent to a server.
  • No cloud round-trip. After the one-time download, suggestions work fully offline.
  • Nothing is collected. Your manuscript, your selections, and the suggestions you receive stay on your machine.

See also