Hacker News .hn
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
SoKamil
28 days ago
|
parent
|
context
|
favorite
| on:
Changes in the system prompt between Claude Opus 4...
New knowledge cutoff date means this is a new foundation model?
lkbm
27 days ago
|
next
[–]
Yes, but doesn't the token change mean that?
clickety_clack
27 days ago
|
parent
|
next
[–]
You can train a tokenizer on old data just like you can train a model on old data.
wongarsu
27 days ago
|
root
|
parent
|
next
[–]
But you can't use an old model with a new tokenizer. Changing the tokenizer implies you trained the model from scratch
dannyw
27 days ago
|
root
|
parent
|
next
[–]
A little bit of post-training will fix that. Folks on /r/LocalLLaMa have been making effective finetunes with diff. tokenizers for years.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: