Sageling makes local AI agents actually usable on Mac
For those of us handling internal spreadsheets or private project notes, the "cloud" is a liability. That's where a local setup using MLX (Apple's machine learning framework) actually makes sense. Sageling is interesting because it bundles Qwen 3.5 9B directly in-process. While a 9B model isn't going to out-reason a massive frontier model, it's surprisingly punchy for local tasks.
Setting up a local agent workflow
If you're trying to move your team away from browser-based chatbots and toward a real AI workflow, the deployment usually follows this path:
1. Hardware Check: You need a Mac with Apple Silicon. Since it uses MLX, the unified memory handles the model weights much better than traditional virtualization.
2. Installation: Once you launch the app, it pulls the Qwen 3.5 9B weights.
3. Execution: Instead of just chatting, you're using it as a coworking agent. Because it's local, you can feed it a directory of files without worrying about a data breach or hitting a token limit on a paid plan.
Performance and real-world trade-offs
I've been comparing the local experience against the cloud giants. Here is the breakdown of what I'm seeing:
- Privacy: Absolute. Zero data leaves the machine, which is the only way some of my legal-minded coworkers will even touch the tool.
- Cost: Zero monthly fees. No "usage limits" or "message caps" that kick in right when you're in the middle of a deep dive.
- Reasoning Power: This is the bottleneck. Qwen 3.5 9B is great for summarization and basic logic, but if you're doing complex architectural planning, you'll feel the gap compared to a 70B+ model.
- Latency: Since it's running on the local GPU via MLX, the response speed is snappy, provided you aren't running 50 other Chrome tabs in the background.
The adoption curve at my workplace has been a bit steep. People are used to the "magic" of the cloud, and when a local model makes a mistake, they tend to blame the tool rather than the model size. However, once they realize they can process 50 private PDFs without a subscription or a privacy policy agreement, the "local-first" argument wins.
If you want to try it, you can find the project details here:
https://sageling.aiIt's a solid example of how the "small model" trend is actually more practical for a business environment than just chasing the biggest parameter count possible. Using a 9B model locally is often a better user experience than waiting for a slow cloud API to respond while worrying about where your data is being stored.