Skip to content

Run Local AI With Gemma

Gemma runs analysis on your Mac. It is available in supported direct-download builds and is absent from the Mac App Store build.

Gemma provider details with local model setup and management controls

  1. Open Settings → AI Providers and open Gemma.
  2. Review the local models offered for your Mac and their download sizes.
  3. Choose Set up Gemma or the model’s download action.
  4. Wait for download verification and model startup to finish.
  5. Use Use Gemma or the provider role control to select it for analysis.
  6. Run a short typed question and screenshot analysis.

The current model manager offers smaller and recommended Gemma 4 variants. Use the compatibility and status shown on your Mac rather than assuming every model fits. Downloads require network access and disk space; local inference uses memory and compute while running.

StatusNext step
Downloading / VerifyingWait for setup to finish.
Installed / StoppedStart the installed model or select it for use.
ReadyThe local runtime is available.
LimitedRead the displayed limitation and test the workflow you need.
ErrorUse the displayed retry setup, download, or start action.
UnsupportedUse another compatible provider or Mac.

The model manager can download, select, cancel downloads, and delete installed variants when the runtime permits. Your chat history and settings are retained when switching models.

Pair Gemma with local transcription. Review primary/backup roles and automatic failover, and disable analytics content uploads if you want analysis content to remain on the Mac. Local model selection does not itself disable telemetry or other cloud features.

For context-capacity errors, reduce the request or session context, start a fresh session, or choose a provider with sufficient capacity. Retrying the same oversized request may fail again.