whisperkit coreml

Providerargmaxinc
Categoryautomatic-speech-recognition
LicenseApache-2.0
Downloads274
Stars0

Overview

WhisperKit CoreML brings OpenAI's Whisper speech-to-text capabilities directly to Apple silicon, optimizing inference for macOS, iOS, and iPadOS. Unlike generic wrappers, this implementation leverages CoreML to utilize the Neural Engine, significantly reducing CPU overhead and battery drain during transcription. For developers, this means the ability to implement high-accuracy, offline ASR (Automatic Speech Recognition) without relying on cloud APIs, ensuring user privacy and low latency. It is particularly effective for building real-time transcription tools, accessibility features, or voice-controlled interfaces where local execution is critical. Integration is streamlined for Swift environments, offering a performant alternative to PyTorch-based deployments on Apple hardware.

Highlights

  • Hardware-accelerated inference via Apple Neural Engine
  • Fully offline ASR for enhanced user privacy
  • Optimized for low power consumption on iOS/macOS
  • Apache-2.0 license for flexible commercial integration
  • High-accuracy transcription across multiple languages

Usage

Install
# Install Hugging Face transformers
pip install transformers torch
SDK Usage
# Load model with transformers
from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("argmaxinc/whisperkit-coreml")
tokenizer = AutoTokenizer.from_pretrained("argmaxinc/whisperkit-coreml")

Hugging Face Download

We recommend downloading the model via the Hugging Face CLI or Hub SDK.

Guidance:Before downloading, install huggingface_hub with:

Guidance
pip install -U huggingface_hub

CLI Download

Download the full repository

Download the full repository
huggingface-cli download argmaxinc/whisperkit-coreml

Download a single file to a local folder (e.g. config.json into ./dir)

Download a single file to a local folder (e.g. config.json into ./dir)
huggingface-cli download argmaxinc/whisperkit-coreml config.json --local-dir ./dir

See the official docs for more CLI options

SDK Download

SDK Download
# 模型下载
from huggingface_hub import snapshot_download
model_dir = snapshot_download('argmaxinc/whisperkit-coreml')

Git Download

Make sure git-lfs is installed first

Git Download
git lfs install
git clone https://huggingface.co/argmaxinc/whisperkit-coreml

To skip LFS large-file downloads, use:

Skip LFS
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/argmaxinc/whisperkit-coreml

Model files are hosted on the Hugging Face Hub — download directly via HF CLI / SDK / Git, not through this site.

PyTorch / Transformers Usage

Install Transformers

Install Transformers
pip install -U transformers torch

Load the model and run inference

Load the model and run inference
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained('argmaxinc/whisperkit-coreml')
tokenizer = AutoTokenizer.from_pretrained('argmaxinc/whisperkit-coreml')

Model Download

We recommend downloading the model via the ModelScope CLI or SDK.

Guidance:Before downloading, install ModelScope with:

Guidance
pip install modelscope

CLI Download

Download the full repository

Download the full repository
modelscope download --model argmaxinc/whisperkit-coreml

Download a single file to a local folder (e.g. README.md into ./dir)

Download a single file to a local folder (e.g. README.md into ./dir)
modelscope download --model argmaxinc/whisperkit-coreml README.md --local_dir ./dir

See the docs for more CLI options

SDK Download

SDK Download
# 模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('argmaxinc/whisperkit-coreml')

Git Download

Make sure git-lfs is installed first

Git Download
git lfs install
git clone https://www.modelscope.cn/argmaxinc/whisperkit-coreml.git

To skip LFS large-file downloads, use:

Skip LFS
GIT_LFS_SKIP_SMUDGE=1 git clone https://www.modelscope.cn/argmaxinc/whisperkit-coreml.git

ModelScope 模型页直接下载模型文件;无需将模型文件放在本站服务器。

Notebook Quickstart

Install the ModelScope library

Install the ModelScope library
pip install "modelscope[audio,cv,nlp,multi-modal,science]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html

Load the model and run inference

Load the model and run inference
from modelscope.pipelines import pipeline
from modelscope.utils.constant import Tasks

p = pipeline('text-generation', 'argmaxinc/whisperkit-coreml')

Full Documentation

来源: HuggingFace

---
pretty_name: WhisperKit
viewer: false
library_name: whisperkit
tags:

  • whisper

  • whisperkit

  • coreml

  • asr

  • quantized

  • automatic-speech-recognition

license: mit
---

WhisperKit

Repo

WhisperKit is part of Argmax OSS, an On-device Speech AI SDK for Apple Silicon: https://github.com/argmaxinc/argmax-oss-swift

Paper

Check out the WhisperKit paper and presentation from ICML 2025: https://icml.cc/virtual/2025/47854

Pro

For real-time transcription with speakers and custom vocabulary, check out Argmax Pro SDK: https://www.argmaxinc.com/blog/argmax-sdk-2
Join our Telegram