# Performance and Usage of the Open-Type Decision AI Model Laya-MLX Running Locally on Apple Silicon

- Link: https://github.com/mizorewww/laya-mlx
- Discussion: https://startupxo.com/en/742/
- Posted by startupxo at 2026-10-02T04:35:07.241Z
- 0 points, 0 comments, kind story, origin curated
- Written in ko, machine translated to en

## Summary

- Laya-MLX is a local AI model running on Apple Silicon that instantly produces decision results by choosing answers or scoring among options for input sentences.
- This model operates on a proprietary MLX runtime without PyTorch or cloud support and can be easily installed and used in Python via code 공개 on GitHub.
- Based on the M3 Max chip, it records median latencies of 13.4 ms for single question processing and 7.4 ms for multilingual models, with a max throughput of 146.8~395 per second when processing batches of 64 (Presented by mizorewww, Test environment: M3 Max, macOS 27.2, Python 3.12.13).
- The original checkpoints and FP16 converted weights are 공개 on GitHub and Hugging Face, offering three main models suitable for English and multilingual input.

## Sources

- GitHub: https://github.com/mizorewww/laya-mlx (6699 points, checked 2026-10-02T08:37:02Z)

## Comments (0)

No comments yet.

JSON: https://startupxo.com/api/v1/item.json?id=742&lang=en
