Faster-whisper

Name: Faster-whisper
Author: SYSTRAN

Container

Faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. This container provides a Wyoming protocol server for faster-whisper.

Image details

Pulls: 483k

Architecture: amd64, arm64

Image size: 1.6 GB

Latest: 3.6.0-gpu

User: linuxserver

Created: Nov 29, 2023

Updated: 1 day ago

Status: active

Source details

Repo: SYSTRAN/faster-whisper

Stars: 24.9k

Forks: 2k

Language: Python

License: MIT

Latest: v1.2.1 · 9 months ago

Updated: 8 months ago

Configuration

Type

Container

Platform

linux

Image

linuxserver/faster-whisper:latest

Ports

10300:10300/tcp

Volumes

/config : /srv/lsio/faster-whisper/config

Env vars

PUID=1000PGID=1000TZ=Etc/UTCDEBUG=LOCAL_ONLY=WHISPER_BEAM=1WHISPER_LANG=autoWHISPER_MODEL=auto

Restart

unless-stopped

Template by technorabilia

Notes

Portainer App Templates by Technorabilia, based on data provided by LinuxServer.io.

Ensure to create the following volume directories on the host file system, or modify the paths in the volume mapping section under the advanced options below, as needed.

mkdir -p /srv/lsio/faster-whisper/config

Standalone Install

Select an install method, to see config/commands for deploying Faster-whisper

Install on Portainer

Import all app templates into your Portainer instance, for easy 1-click deploys

Ensure both Docker and Portainer are installed, and up-to-date
Log into your Portainer web UI
Under Settings → App Templates, paste the below URL
Head to Home → App Templates, and the list of apps will show up
Select Faster-whisper, fill in any config options, and hit Deploy

Template Import URL

https://raw.githubusercontent.com/Lissy93/portainer-templates/main/templates.json

Show Me

More install options in our documentation, or see SYSTRAN/faster-whisper for app-specific guidance.

The LinuxServer.io team brings you another container release featuring:

regular and timely application updates
easy user mappings (PGID, PUID)
custom base image with s6 overlay
weekly base OS updates with common layers across the entire LinuxServer.io ecosystem to minimise space usage, down time and bandwidth
regular security updates

Find us at:

Blog - all the things you can do with our containers including How-To guides, opinions and much more!
Discord - realtime support / chat with the community and the team.
Discourse - post on our community forum.
GitHub - view the source for all of our repositories.
Open Collective - please consider helping us by either donating or contributing to our budget

linuxserver/faster-whisper

Supported Architectures

We utilise the docker manifest for multi-platform awareness. More information is available from docker here and our announcement here.
Simply pulling lscr.io/linuxserver/faster-whisper:latest should retrieve the correct image for your arch, but you can also pull specific arch images via tags.
The architectures supported by this image are:

Architecture	Available	Tag
x86-64	✅	amd64-\
arm64	✅	arm64v8-\

Version Tags

This image provides various versions that are available via tags. Please read the descriptions carefully and exercise caution when using unstable or development tags.

Tag	Available	Description
latest	✅	Stable releases
gpu	✅	Releases with Nvidia GPU support (amd64 only)
gpu-legacy	✅	Legacy releases with Nvidia GPU support for pre-Turing cards (amd64 only)

Application Setup

For use with Home Assistant Assist, add the Wyoming integration and supply the hostname/IP and port that Whisper is running add-on."
When using the gpu tag with Nvidia GPUs, make sure you set the container to use the nvidia runtime and that you have the Nvidia Container Toolkit installed on the host and that you run the container with the correct GPU(s) exposed. See the Nvidia Container Toolkit docs for more details.
For more information see the faster-whisper docs,

Read-Only Operation

This image can be run with a read-only container filesystem. For details please read the docs.

Usage

To help you get started creating a container from this image you can either use docker-compose or the docker cli.
>!NOTE >Unless a parameter is flagged as 'optional', it is mandatory and a value must be provided.

docker-compose (recommended, click here for more info)

---
services:
  faster-whisper:
    image: lscr.io/linuxserver/faster-whisper:latest
    container_name: faster-whisper
    environment:
      - PUID=1000
      - PGID=1000
      - TZ=Etc/UTC
      - DEBUG= #optional
      - LOCAL_ONLY= #optional
      - WHISPER_BEAM=1 #optional
      - WHISPER_LANG=auto #optional
      - WHISPER_MODEL=auto #optional
    volumes:
      - /path/to/faster-whisper/data:/config
    ports:
      - 10300:10300
    restart: unless-stopped

docker cli (click here for more info)

docker run -d \
  --name=faster-whisper \
  -e PUID=1000 \
  -e PGID=1000 \
  -e TZ=Etc/UTC \
  -e DEBUG= `#optional` \
  -e LOCAL_ONLY= `#optional` \
  -e WHISPER_BEAM=1 `#optional` \
  -e WHISPER_LANG=auto `#optional` \
  -e WHISPER_MODEL=auto `#optional` \
  -p 10300:10300 \
  -v /path/to/faster-whisper/data:/config \
  --restart unless-stopped \
  lscr.io/linuxserver/faster-whisper:latest

Parameters

Containers are configured using parameters passed at runtime (such as those above). These parameters are separated by a colon and indicate <external>:<internal> respectively. For example, -p 8080:80 would expose port 80 from inside the container to be accessible from the host's IP on port 8080 outside the container.

Parameter	Function
`-p 10300:10300`	Wyoming connection port.
`-e PUID=1000`	for UserID - see below for explanation
`-e PGID=1000`	for GroupID - see below for explanation
`-e TZ=Etc/UTC`	specify a timezone to use, see this list.
`-e DEBUG=`	If set to `true`, or any other value, the container will output debug logs.
`-e LOCALONLY=`	If set to `true`, or any other value, the container will not attempt to download models from HuggingFace and will only use locally-provided models.
`-e WHISPERBEAM=1`	Number of candidates to consider simultaneously during transcription.
`-e WHISPERLANG=auto`	Two character code for the language that you will speak to the add-on.
`-e WHISPERMODEL=auto`	Whisper model that will be used for transcription. From here.
`-v /config`	Local path for Whisper config files.
`--read-only=true`	Run container with a read-only filesystem. Please read the docs.

Environment variables from files (Docker secrets)

You can set any environment variable from a file by using a special prepend FILE__.
As an example:

-e FILE__MYVAR=/run/secrets/mysecretvariable

Will set the environment variable MYVAR based on the contents of the /run/secrets/mysecretvariable file.

Umask for running applications

For all of our images we provide the ability to override the default umask settings for services started within the containers using the optional -e UMASK=022 setting. Keep in mind umask is not chmod it subtracts from permissions based on it's value it does not add. Please read up here before asking for support.

User / Group Identifiers

When using volumes (-v flags), permissions issues can arise between the host OS and the container, we avoid this issue by allowing you to specify the user PUID and group PGID.
Ensure any volume directories on the host are owned by the same user you specify and any permissions issues will vanish like magic.
In this instance PUID=1000 and PGID=1000, to find yours use id your_user as below:

id your_user

Example output:

uid=1000(your_user) gid=1000(your_user) groups=1000(your_user)

Docker Mods

We publish various Docker Mods to enable additional functionality within the containers. The list of Mods available for this image (if any) as well as universal mods that can be applied to any one of our images can be accessed via the dynamic badges above.

Support Info

Shell access whilst the container is running:

```bash
docker exec -it faster-whisper /bin/bash
```

To monitor the logs of the container in realtime:

```bash
docker logs -f faster-whisper
```

Container version number:

```bash
docker inspect -f '{{ index .Config.Labels "build_version" }}' faster-whisper
```

Image version number:

```bash
docker inspect -f '{{ index .Config.Labels "build_version" }}' lscr.io/linuxserver/faster-whisper:latest
```

Updating Info

Most of our images are static, versioned, and require an image update and container recreation to update the app inside. With some exceptions (noted in the relevant readme.md), we do not recommend or support updating apps inside the container. Please consult the Application Setup section above to see if it is recommended for the image.
Below are the instructions for updating containers:

Via Docker Compose

Update images:

* All images:

    ```bash
    docker-compose pull
    ```

* Single image:

    ```bash
    docker-compose pull faster-whisper
    ```

Update containers:

* All containers:

    ```bash
    docker-compose up -d
    ```

* Single container:

    ```bash
    docker-compose up -d faster-whisper
    ```

You can also remove the old dangling images:

```bash
docker image prune
```

Via Docker Run

Update the image:

```bash
docker pull lscr.io/linuxserver/faster-whisper:latest
```

Stop the running container:

```bash
docker stop faster-whisper
```

Delete the container:

```bash
docker rm faster-whisper
```

Recreate a new container with the same docker run parameters as instructed above (if mapped correctly to a host folder, your /config folder and settings will be preserved)
You can also remove the old dangling images:

```bash
docker image prune
```

Image Update Notifications - Diun (Docker Image Update Notifier)

>!TIP >We recommend Diun for update notifications. Other tools that automatically update containers unattended are not recommended or supported.

Building locally

If you want to make local modifications to these images for development purposes or just to customize the logic:

git clone https://github.com/linuxserver/docker-faster-whisper.git
cd docker-faster-whisper
docker build \
  --no-cache \
  --pull \
  -t lscr.io/linuxserver/faster-whisper:latest .

The ARM variants can be built on x8664 hardware and vice versa using lscr.io/linuxserver/qemu-static
docker run --rm --privileged lscr.io/linuxserver/qemu-static --reset

Once registered you can define the dockerfile to use with -f Dockerfile.aarch64.
Versions
26.01.26: - Default to auto for model and language if not set.
20.08.25: - Add gpu-legacy branch for pre-Turing cards.
10.08.25: - Add support for local-only mode.
30.12.24: - Add arm64 support for non-GPU builds.
05.12.24: - Build from Github releases rather than Pypi.
18.07.24: - Rebase to Ubuntu Noble.
19.05.24: - Bump CUDA to 12 on GPU branch.
08.01.24: - Add GPU branch.
25.11.23: - Initial Release.

Serve Faster-whisper on your own domain behind Caddy, Nginx or Traefik. Fill in your domain and copy the result. It's a starting point, some apps need their own base URL or extra headers set too.

Proxy Domain App port Upstream

Proxying faster-whisper.example.com to http://Faster-whisper:10300

Add this to your Caddyfile

faster-whisper.example.com {
	reverse_proxy http://Faster-whisper:10300
}

Check the logs first

Nine times out of ten the logs tell you exactly what went wrong.

In Portainer, go to Containers, click the container, then Logs. Or run docker logs Faster-whisper
Exit codes help too: 137 means killed, usually out of memory. 126 or 127 means the command inside the image is broken.

Port already in use

If deployment fails with "Bind for 0.0.0.0:10300 failed: port is already allocated", something else on your server is using that port.

Find what's using it: sudo ss -tlnp | grep :10300
Stop the other service, or pick a different host port. In 10300:10300 only the left number is yours to change, the right one belongs to the app.

Running but the page won't load

The container is up but nothing appears in your browser.

Use your server's real IP: http://your-server-ip:10300. The 0.0.0.0 link Portainer shows isn't a real address.
Give it a minute after first deploy, Faster-whisper can take a while to initialise.
Make sure your firewall allows the port, e.g. sudo ufw allow 10300

Permission denied on volumes

If the logs show "permission denied", the app can't write to its data folder on the host.

Fix the ownership: sudo chown -R 1000:1000 /srv/lsio/faster-whisper/config
Or set the PUID and PGID variables (defaults 1000:1000) to match your own user, found with id $USER

Image won't pull

Test the pull directly on the host: docker pull linuxserver/faster-whisper:latest

"manifest unknown" means the tag no longer exists. This template uses latest, so try pinning a specific version instead.
"toomanyrequests" is the Docker Hub rate limit. Log in with docker login to raise it.
"no space left on device" means a full disk. Reclaim space with docker system prune

"exec format error"

This means the image was built for a different CPU architecture than your server.

This image supports: amd64, arm64
Check yours with uname -m: x86_64 is amd64, aarch64 is arm64. Raspberry Pi and other ARM boards are the usual culprits.

Container keeps restarting

The unless-stopped restart policy relaunches the app after every crash, so the real error can scroll past.

Check the logs right after a restart, the last few lines before it died are the useful ones.
Get the exit code with docker inspect Faster-whisper --format '{{.State.ExitCode}}'
Still stuck? Redeploy once with the restart policy set to no so the failure stays visible.

Required settings are blank

DEBUG, LOCAL_ONLY have no default value, and Faster-whisper may crash or misbehave if left empty.

Fill them in on the deploy screen before hitting deploy.

Raise an issue

Found something which isn't working as it should? Here's how to report it.

Bug within the app: Open an issue on SYSTRAN/faster-whisper
Template not working: Open an issue on technorabilia/portainer-templates
This website not working: Open an issue on lissy93/portainer-templates

A single container

Faster-whisper runs as one container, the simplest kind of app here. Just the one image to pull and nothing else wired up alongside it.

The app image

An image is the app packed up ready to go, everything Faster-whisper needs bundled into one download. This template pulls linuxserver/faster-whisper:latest, which Docker fetches once (about 1.6 GB) and then starts your own copy from.

Where the image comes from

Docker pulls its images from registries, public libraries of ready-built apps. Faster-whisper's comes from Docker Hub, published by linuxserver.

Version tags

The bit after the colon in the image name is the version tag. Here it's latest, which always points at the newest build, so a redeploy can bump you to a newer release without you asking. Newest right now is 3.6.0-gpu. Pin a specific tag if you would rather stay on one version.

Which machines it runs on

Every image is built for particular CPU types. This one ships for amd64, arm64, so it runs on both regular x86 servers and ARM boards like a Raspberry Pi.

Ports

A port is the door the app answers on. A mapping like 10300:10300 means it's reachable on port 10300 of your server, where the left number is yours to change and the right one belongs to the app. It opens:

10300:10300

Volumes

A volume is where Faster-whisper keeps its files so they survive an update or a restart. Without one, anything it saves would sit inside the container and vanish the moment it's recreated. This template mounts:

/config from /srv/lsio/faster-whisper/config on the host

Environment variables

Environment variables are the settings you hand over when you deploy, things like a password or a timezone. Faster-whisper takes 8 of them, and 2 need a value before it'll start properly:

PUID, defaults to 1000. Run 'id [USER]' for the owner of the host volume directories to get the UID to use here.
PGID, defaults to 1000. Run 'id [USER]' for the owner of the host volume directories to get the GID to use here.
TZ, defaults to Etc/UTC. Specify a timezone to use, see this list.
DEBUG, needs a value. If set to true, or any other value, the container will output debug logs. [OPTIONAL]
LOCAL_ONLY, needs a value. If set to true, or any other value, the container will not attempt to download models from HuggingFace and will only use locally-provided models. [OPTIONAL]
WHISPER_BEAM, defaults to 1. Number of candidates to consider simultaneously during transcription. [OPTIONAL]
WHISPER_LANG, defaults to auto. Two character code for the language that you will speak to the add-on. [OPTIONAL]
WHISPER_MODEL, defaults to auto. Whisper model that will be used for transcription. From here. [OPTIONAL]

Restart policy

The restart policy here is unless-stopped, so Docker restarts Faster-whisper after a crash or reboot, but leaves it off when you stop it on purpose. You can change this on the deploy screen. The choices are no (never restart), on-failure (only after a crash), unless-stopped (restart unless you stop it), and always (bring it back no matter what).

Users and permissions

The PUID and PGID settings tell it which user and group to act as on your host. Point them at your own account (find yours with id $USER) so the files it writes into your mounted folders come out owned by you rather than root.

Networking

Nothing custom is set, so Faster-whisper sits on Docker's default bridge network: its own private space that reaches the outside world only through the ports it publishes.

Container name

Once it's deployed, Portainer names the container Faster-whisper. That's what you'll spot in the containers list and use in commands like docker logs Faster-whisper.

Platform

The platform is linux, the kind of system the container is built to run on. Docker and Portainer handle this on a normal Linux server.

Open source license

Faster-whisper is open source, released under the MIT license. In plain terms the code is out in the open, so you're free to run it and change it to fit what you need.

Portainer app templates

Zooming out, this whole page comes from a Portainer app template: a short recipe telling Portainer how to set Faster-whisper up. Add the template list to Portainer once, then deploying Faster-whisper is a click rather than a wall of config.

Piper Machine Learning

Faster-whisper

Image details

Source details

Configuration

Notes

Standalone Install

Install on Portainer

Template Import URL

Container Documentation

linuxserver/faster-whisper

Supported Architectures

Version Tags

Application Setup

Read-Only Operation

Usage

docker-compose (recommended, click here for more info)

docker cli (click here for more info)

Parameters

Environment variables from files (Docker secrets)

Umask for running applications

User / Group Identifiers

Docker Mods

Support Info

Updating Info

Via Docker Compose

Via Docker Run

Image Update Notifications - Diun (Docker Image Update Notifier)

Building locally

Versions

Recent versions

Proxy configurator

Troubleshooting

Check the logs first

Port already in use

Running but the page won't load

Permission denied on volumes

Image won't pull

"exec format error"

Container keeps restarting

Required settings are blank

Raise an issue

Config glossary

A single container

The app image

Where the image comes from

Version tags

Which machines it runs on

Ports

Volumes

Environment variables

Restart policy

Users and permissions

Networking

Container name

Platform

Open source license

Portainer app templates

Similar apps