Chapter 2

Installation

LocalAI can be installed in multiple ways depending on your platform and preferences.

Tip

Recommended: Docker Installation

Docker is the recommended installation method for most users as it works across all platforms (Linux, macOS, Windows) and provides the easiest setup experience. It’s the fastest way to get started with LocalAI.

Installation Methods

Choose the installation method that best suits your needs:

Docker ⭐ Recommended - Works on all platforms, easiest setup
macOS - Download and install the DMG application
Linux - Install on Linux using binaries (install.sh script currently has issues - see issue #8032)
Kubernetes - Deploy LocalAI on Kubernetes clusters
Build from Source - Build LocalAI from source code

Quick Start

Recommended: Docker (works on all platforms)

docker run -p 8080:8080 --name local-ai -ti localai/localai:latest

This will start LocalAI. The API will be available at http://localhost:8080. For images with pre-configured models, see All-in-One images.

For other platforms:

macOS: Download the DMG
Linux: See the Linux installation guide for installation options. Note: The install.sh script is currently experiencing issues - see issue #8032 for details.

For detailed instructions, see the Docker installation guide.