MLX

A new post on Apple’s Machine Learning Research blog shows how much the M5 Apple silicon improved over the M4 when it comes to running a local LLM. Here are the details.

Apple’s MLX machine learning framework, originally designed for Apple Silicon, is getting a CUDA backend, which is a pretty big deal. Here’s why.