Local-first MLX serving
Run MLX models entirely on device with project-owned endpoints and artifacts.
Melix turns fragmented local AI work into a single, repeatable studio on Apple Silicon.
Serve locally. Tune with LoRA. Benchmark with rigor. Evaluate and export. No cloud. No subscriptions. No data leaves your Mac.
Run MLX models entirely on device with project-owned endpoints and artifacts.
Parameter-efficient tuning with repeatable local runs and adapter records.
Track performance across MLX models, configs, datasets, and hardware.
Generate reports and exports that make local model changes auditable.
| Model | Type | Size | Updated |
|---|---|---|---|
| mlx-community/Mistral-7B-Instruct-v0.3 | MLX | 4.2 GB | Jun 8 |
| mlx-community/Llama-3.2-3B-Instruct | MLX | 2.4 GB | Jun 7 |
| mlx-community/Qwen2.5-Coder-7B-Instruct | MLX | 4.7 GB | Jun 6 |
| support-tone-lora-r16 | LoRA | 184 MB | Jun 5 |
| mlx-community/Phi-3.5-mini-instruct | MLX | 2.2 GB | Jun 4 |
| Model | Score | 95% CI |
|---|---|---|
| Mistral-7B-Instruct-v0.3 | 8.48 | +/- 0.12 |
| Qwen2.5-Coder-7B-Instruct | 8.17 | +/- 0.15 |
| Llama-3.2-3B-Instruct | 7.83 | +/- 0.13 |
| Phi-3.5-mini-instruct | 6.91 | +/- 0.14 |
$ melix models add --source mlx Mistral-7B-Instruct-v0.3
Model registry
$ melix serve --runtime mlx --model Mistral-7B-Instruct-v0.3
Local server
$ melix lora train --config tone.yml
LoRA training
$ melix benchmark run --suite mt-bench
Benchmark
$ melix eval export --format report.md,json
Evaluation export
why local
Run model serving, adapter tuning, benchmarks, and evaluations on your Mac. Keep prompts, adapters, benchmark outputs, and eval artifacts in a local workflow.
Serve a model, test an adapter, run an evaluation, and compare results without waiting on hosted inference queues or remote experiment infrastructure.
Track the model, target hardware, adapter, benchmark settings, eval set, and output metrics behind each run.
workflow ledger
Serve the model, attach the adapter, benchmark the run, evaluate the output, and inspect the evidence locally.
technical surface
Independent benchmarks and real results from local Apple Silicon hardware.
View BenchmarksChoose the local loop you run most often.
Wire local MLX serving into app loops.
local endpoint, request log, reproducible run state
Train LoRA and compare adapters.
score deltas, latency, adapter artifacts
Test prompts and models without remote services.
markdown/json exports, local dataset path, no data leaves Mac
Docs
Roadmap
Melix is moving toward richer runtime operations, stronger evaluation workflows, better packaging, and more native operator polish.
status
Melix is early, explicit, and local-first. The product is built around a concrete developer workflow: serve the model on your Mac, tune or attach an adapter, benchmark the run, evaluate the output, and inspect the evidence locally.
Inspect the repository