Product & software

Ollama

Ollama provides tools for obtaining and running supported language models on a computer.

At a glance

Primary focus
Running language models locally
Category
artificial intelligence

Overview

Ollama provides tools for obtaining and running supported language models on a computer. It exposes model interactions through a command-line workflow and API, making it possible to connect locally running models to applications.

How it is used

A user selects a supported model, obtains its files, and sends prompts through the available interface. Applications can communicate with the running service rather than implementing model loading themselves.

A useful distinction

Local execution still requires enough memory and compute for the selected model. Model licenses and capabilities belong to the specific model, while Ollama provides the execution and management layer.

Sources and review

MOOR's explanatory text is supported by the following source links.

  1. Ollama: official overview — Ollama
  2. Ollama: documentation and further reading — Ollama

Browse MOOR Knowledge