Do we? Or are we born with pre-training (all the crucial functions the brain does without us having to learn them) and a context window orders of magnitude larger than an LLM?
It is incredible how willing and eager AI boosters are to denigrate the incredible miracle of human consciousness to make their chatbots seem so special.
No, we are not born with all the pre-training we need. That is rather the point of education, teaching people's brains how to process information in new, maybe unintuitive ways.
> They do see those use cases. It's not surprising that they focus on the enormous number of other, negative use cases. It's misleading to describe the medical use cases as "more important" - yes, they are, in the same way that healing a person is "more important" than ruining their lives. That's not what you're implying by your usage of the term, though.
This comment could just as easily apply to a conversation about computers in general, it's just that people whose lives have been "ruined" by now-established technologies have been largely forgotten by society.
It used to be THE mecca that all engineers wanted to go to, and they almost never laid anybody off for a long stretch of time. Things changed around COVID. It's very obvious that a lot of their services have gotten much worse- my Google home can barely even set timers anymore and it used to be nearly magical at knowing what song I wanted to listen to even if I didn't know the artist or song name.
They have made great strides recently in a lot of areas, but the massive seemingly random layoffs of senior engineers is very apparent.
> "We're sorry, what we were able to give you for $100/mo before now needs to be $200/mo (or more). We miscalculated/we were too generous/gave too much away for too little. It's a new technology, we are seeing a ton of demand, we are trying to run a business, hope you understand. If you don't want it, don't pay for it."
Anthropic's thing has always been that they are perceived as slightly ahead of the competition, if they 2X their pricing then the competition that used to be "slightly worse" suddenly becomes an absolute bargain and guts their user base.
Essential services (banks, government services, public transport) generally still support SMS as an alternative to their mobile apps when there's no completely offline process.
Wild guess, touching this with a 10-foot pole risks validating his claims. If they sue for breach of NDA, it means his claims are factually correct, and if they sue for libel and it goes to court, they may be forced to submit documents they don't want to.
If you hold the belief that the Trump administration (and Trump himself personally) have not commited a rather long list of crimes openly, you are either willfully ignorant or complicit. I do not care if this statement irritates you in any way. After a certain point, we are firmly in the realm of personal responsibility.
Yes, though likely something with a higher pin count since memory access is more likely to be random and can be parallel versus block storage.
> Like the data lines going all the way to an on-motherboard storage device?
Yes. Why would a GPU manufacturer/packager take on that cost, if it’s presently served well enough for most people by offloading it onto other parts of the system?
The current DIMM and SODIMM modules cannot be used for much higher speeds than are available now.
This is why there are several proposals of improved forms for memory modules, which use different sockets, like LPCAMM2, which should be able to work with faster memories.
However even LPCAMM2 is unlikely to work at the speeds of soldered GDDR7.
It is not very difficult to solder/desolder, but you need suitable tools, which are not cheap.
Moreover, when you do this manually, unless it is something that you do every day it may be quite difficult to be certain that soldering has been done well enough to remain reliable during long term use. In the industry, very expensive equipment is used to check the quality of soldering, e.g. X-ray machines.
So unlike inserting a memory module in a socket, which is reasonably foolproof, soldering devices is not something that could be used in a product sold to the general population.
When I was young, there still existed computer kits, where you soldered yourself all the ICs on the motherboard, so you could get a computer at a much lower price than for a fully assembled computer. My first PC was of this kind.
However, at that time PCs were still something that was bought by a small fraction of the population, which were people that you could expect to be willing to learn things like how to solder and who would be willing to accept the risk of damaging the product that they have bought. Today PCs are addressed to the general public, so nobody would offer GPU cards that you must solder.
reply