2.6 KiB
Local AI
SelfPhoneNG can use AI that runs on your own server: voicemail transcripts now, more later (call summaries, typed prompts, an AI receptionist). Nothing is sent to an AI company. The addresses in Settings → AI must be this server or your local network, and SelfPhoneNG refuses anything else.
What you need
- Speech to text and text to speech: the AI stack in
deploy/ai. It runs Speaches (Whisper and Kokoro). - The language model (for later features): Ollama. Install it on the server, or uncomment it in
deploy/ai/compose.yml. - A GPU makes it fast: an NVIDIA card with 8 GB holds Whisper and a small language model. Without one, voicemail transcripts still work on the CPU, only slower. The GPU needs the NVIDIA Container Toolkit.
1. Start the AI stack
On the PBX server:
docker compose -f deploy/ai/compose.yml up -d
(In Portainer: a second stack from deploy/ai/compose.yml.) No NVIDIA GPU: change the image to
ghcr.io/speaches-ai/speaches:0.8.3-cpu and remove the deploy: block.
Download the models once (they're kept in a volume):
curl -X POST http://127.0.0.1:8000/v1/models/Systran/faster-whisper-small
curl -X POST http://127.0.0.1:8000/v1/models/speaches-ai/Kokoro-82M-v1.0-ONNX
faster-whisper-small is quick everywhere. With a GPU, Systran/faster-whisper-large-v3 is
more accurate on phone audio.
For Ollama: ollama pull qwen3:4b, and set OLLAMA_KEEP_ALIVE=-1 so the model stays loaded.
2. Settings → AI
| Part | Address | Model | Voice |
|---|---|---|---|
| Language model | http://127.0.0.1:11434/v1 |
qwen3:4b |
|
| Speech to text | http://127.0.0.1:8000/v1 |
Systran/faster-whisper-small |
|
| Text to speech | http://127.0.0.1:8000/v1 |
speaches-ai/Kokoro-82M-v1.0-ONNX |
af_heart |
Click Test beside each. The first test can take a while: it loads the model. The text to speech test plays the voice. Then turn on Voicemail transcripts and Save.
Instead of the page, a new install can start with AI_LLM_URL, AI_LLM_MODEL, AI_STT_URL,
AI_STT_MODEL, AI_TTS_URL, AI_TTS_MODEL and AI_TTS_VOICE in .env (see .env.example).
Once you save the page, the page wins.
Voicemail transcripts
Each new message is written out before its email goes, and the words are in the email and on the voicemail page. A transcript is a machine's guess: names and numbers are the usual mistakes. If the AI stack is down, the email goes without one.
Transcripts are kept with the voicemail in the database, and are in your backups.