Love what you guys have done with Unsloth. Any plans to have this running as a hosted product where Unsloth provide the GPUs?

Thank you! Great idea - that is actually one of the follow up goals! We know some folks want to do large scale training runs or inference with large models so the next most natural thing is to provide an API for folks and also provide infrastructure ourselves!

> These days I hit the quick answer button inside Kagi more often

Just incase you didn’t know you can append ? to any query and get a quick answer straight away

Actually, I didn't know. Thanks!

This may help you work out the best quant to use for your use case.

https://www.siquick.com/blog/model-quantization-fine-tuning-...

Sure sounds like automatic weapons targeting using Anthropic models to me.

However much they try to make us think otherwise, at this point in time there’s not really any “good guys” in the AI race.

Rent a H100 on Modal which scales down to zero when not in use - you can set the time out period.

Cold boot times are around 5m but if your usage periods are predictable it can work out ok. Works out at $2 an hour.

Still far more expensive than a ChatGPT sub.

Do you have some reference on what setup you're talking about? I'd like to integrate it into my IDE (cursor/vscode) - are there docs on such a setup?

Start here

https://modal.com/docs/examples/vllm_inference

or give this a go

https://modal.com/docs/examples/opencode_server

You get $30 free credits each month on Modal which is enough to play around (i have no affiliation, just think they run a great service)

> Skills in CC have been a bit frustrating for me. They don't trigger reliably

Referencing them in AGENTS/CLAUDE.md has increased their usage for me.

This is truly great - just joined the universal fund.

I tried to signup from the nav bar but kept getting a 500 error from the sign_up.json endpoint. I had to go through the Donate flow to be able to create an account.

We just deployed a fix for this, thanks for reporting! (We recently enabled Cloudflare caching which exposed a pre-existing CSRF issue, now fixed)

2 weeks notice to migrate to a different style of model (“normal” 4.1-mini to reasoning 5.1) is bad form.

Misread the post - it doesn’t include the API

It’s also not four weeks, they’ve been deprecated api models for some time now.

In football we’d call the US “tap-in merchants”.

Running one of the world’s leading UI libraries is far more impactful than anything 99% of FAANG engineers have or will ever work on.