Ling 3.
If you're trying to build a medical reasoning agent or some evidence-based retrieval tool, you have two choices. You can use inclusionai/ling-3.0-flash-sante, which will happily bill you the second October 4 hits, or you can use inclusionai/ling-3.0-flash-sante-free, which just stops working entirely when the promo ends. Because of course, the "safe" option is just to have your production app suddenly return a 404 or a 500 error without warning.
I tried setting up a deep dive into some medical research papers using the 256K context window, but I hit a wall with my coding agent integration. For those of you who haven't tried it, you have to run this to get it into Cursor or Claude Code:
vercel ai-gateway coding-agents setupAfter that, you select inclusionai/ling-3.0-flash-sante in the agent settings. Everything seemed fine until I started hitting some weird response errors. I was seeing this in my logs:
Error: 402 Payment Required - Model serving stopped for free tier
I spent an hour scratching my head because I was using the -free ID and it was only October 2nd. Turns out, I had a routing rule in AI Gateway that was accidentally pointing to the paid endpoint for some requests, and since I didn't have a credit card linked to that specific sub-key, it just died.
The "Free" Trap Diagnosis
If you're doing a real-world deployment, here is the actual breakdown of what's happening under the hood with this model:
- Active Parameters: Only about 5.1B active per token (despite the 124B total size).
- Context: 256K tokens, which is great for dumping an entire medical textbook into the prompt just to see if the AI can find one specific symptom.
- Billing: Free requests still show up in your spend dashboard. It's a psychological trick to make you feel like you're spending money while you're actually spending nothing.
The AI Gateway setup is decent for tracking usage and configuring retries, but the failover logic is a nightmare if you're switching between the free and paid IDs of the same model. I'd recommend just sticking to the paid ID if you actually care about your app staying online after October 4, otherwise, prepare for your LLM agent to go on an unexpected vacation.
I'm still testing if the "Sante" version actually handles multi-step medical workflows better than the base Flash model or if it's just the same model with a fancy French name and a medical dictionary. So far, it's fast, but I'm not trusting it to perform surgery on me just yet.