HN2new | past | comments | ask | show | jobs | submitlogin

> I experimented with the Q2 and Q4 quants.

Of course you get degraded performance with this.

 help



Obviously. That's why I led with that statement.

Those are the quant thresholds where people with mid-high end hardware can run this locally at reasonable speed, though.

In my experience Q2 is flakey, but Q4 isn't dramatically worse.


> Obviously. That's why I led with that statement.

Then why did you write this?

> It's always possible that there are some bugs in early implementations that need to be fixed later, but so far I don't see any reason to believe this is actually a Sonnet 4.5 level model.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: