Here’s what that Claude Code source leak reveals about Anthropic’s plans

Status
You're currently viewing only wildsman's posts. Click here to go back to viewing the entire thread.

wildsman

Ars Tribunus Militum
1,692
And then for longer tasks, it's got to process and re-map all the weights again (although for every round the weighting would be different as the vector is being built up)...
The model doesn't 're-map all the weights again'. During inference, the weights are already loaded, the only growing per-convo cost is context and cache - there is no fresh reconstitution of model's weights/params every turn.
 
Last edited:
Upvote
2 (3 / -1)

wildsman

Ars Tribunus Militum
1,692
Why so much scaffolding code is required? 512,000 lines! Something is wrong. Is the AI model by itself then simply too raw to be of any use?
Claude Code is a product - not just a naked model endpoint.

The product has a terminal UX, file handling, git integration, permisssions, tool plumbing, telemetry, safety checks, state management, packaging, tests, etc.

And to be clear, this is exactly how these models should be used: today's models need scaffolding because the hard part is not only ‘generate code’ but to ‘operate reliably inside a messy human workflow’.

What would be fair to say instead is: ‘These models are still raw enough that turning them into dependable tools requires a great deal of scaffolding’.

That is perfectly defensible.

However, saying: ‘therefore the model by itself is useless’ does not follow - this really depends on your usecase and budget.
 
Upvote
19 (19 / 0)
Status
You're currently viewing only wildsman's posts. Click here to go back to viewing the entire thread.