FMTools & FMRuntime
Python tools, a Swift runtime, and a local chat interface for working with Apple’s on-device language models.
I built FMTools to use Apple’s on-device language models from Python. FMRuntime supplies the Swift runtime and foreign-function interface; FMTools provides the Python API and command-line tools.
The repository also includes FMChat, a separate chat application under standalone/fmchat. It is one way to use the runtime, alongside scripts and structured-generation workflows.
The example below comes from the project’s public support-ticket evaluation fixture. It shows the expected structured output for a short ticket. This website is displaying that reference data; it is not running a model in your browser.
Evaluation dataset example
From a support ticket to structured fields
FMTools connects Python workflows to Apple’s on-device models. This shows three public evaluation examples and their reference answers; it does not run a model in your browser.
Cannot login
I've been trying to reset my password but the link never arrives. Please help me access my account!
Reference answer
{
"department": "IT",
"urgency": 4,
"summary": "Password reset email is not arriving and the customer cannot access their account."
}The test checks department, urgency, and summary against a reviewed reference. A model’s generated answer may differ.