llm

Interact with Large Language Models (LLMs) via remote APIs and models that can be installed and run on your machine. More information: https://llm.datasette.io/en/stable/help.html.

• Set up an OpenAI API Key:

llm keys set openai

• Run a prompt:

llm "{{Ten fun names for a pet pelican}}"

• Run a [s]ystem prompt against a file:

cat {{path/to/file.py}} | llm --system "{{Explain this code}}"

• Install packages from PyPI into the same environment as LLM:

llm install {{package1 package2 ...}}

• Download and run a prompt against a [m]odel:

llm --model {{orca-mini-3b-gguf2-q4_0}} "{{What is the capital of France?}}"

• Create a [s]ystem prompt and [s]ave it with a template name:

llm --system '{{You are a sentient cheesecake}}' --save {{sentient_cheesecake}}

• Have an interactive chat with a specific [m]odel using a specific [t]emplate:

llm chat --model {{chatgpt}} --template {{sentient_cheesecake}}