Skip to main content

teale models

Manage models on the node.

Synopsis

teale models <subcommand> [options]

Subcommands

teale models list

List all available models, including their download and load status.

teale models list [--json]
OptionTypeDescription
--jsonflagOutput machine-readable JSON
teale models list
MODEL STATUS SIZE
llama-3.1-8b-q4 loaded 4.7 GB
qwen3-4b-q4 downloaded 2.3 GB
gemma-3-12b-q4 available 7.1 GB

teale models load

Load a downloaded model into GPU memory.

teale models load <model> [--download]
Argument/OptionTypeDescription
<model>stringModel ID to load (required)
--downloadflagDownload the model first if not already downloaded
teale models load llama-3.1-8b-q4
teale models load gemma-3-12b-q4 --download

teale models download

Download a model to local storage.

teale models download <model>
ArgumentTypeDescription
<model>stringModel ID to download (required)
teale models download qwen3-4b-q4

teale models unload

Unload the currently loaded model from GPU memory.

teale models unload

No arguments or options.

teale models unload