Not really sure who this is for. With soldered RAM is less upgradeable than a regular PC.
AI nerds maybe? Sure got a lot of RAM in there potentially attached to a GPU.
But how capable is that really when compared to a 5090 or similar?
To anyone complaining about non-replaceable RAM: This machine is for AI, that is why.
Think of it like a GPU wirh a CPU on the side, vs the other way around.
Inference requires very fast ram transfer speed, and that is only possible (currently) on soldered buses. Even this is pretty slow at 256Gb/s, but it’s RAM size of 96GB to GPU makes it interesting for larger models.
Calling it a gaming PC feels misleading. It’s definitely geared more towards enterprise/AI workloads. If you want upgradeable just buy a regular framework. This desktop is interesting but niche and doesn’t seem like it’s for gamers.
I think it’s like Apple-Niche
and more at people who want the smallest, most powerful desktop they can build
Well, there’s this:
Yeah, the screw holes didn’t fit, that’s why. And the cooler didn’t fit the case, obviously. And the original cooler not the CPU’s turbo. It’s fine, it still runs most games in 3k on the iGPU.
Lmao the news about this desktop is strangling their website to the point of needing a 45 minute waiting list
The Lemmy Lick strikes again!
This is not really that interesting and kinda weird given the non-upgradability, but I guess it’s good for AI workloads. It’s just not that unique compared to their laptops.
I’d love a mid-tower case with swappable front panel I/O and modular bays for optical drives; would’ve been the perfect product for Framework to make IMO.
They’d be competing with a bajillion other case makers. And I’m pretty sure there are already cases with what you ask (such as 5.25 bay mounted IO running off USB headers, at least).
Like… I don’t really see what framework can bring making a case. Maybe it could be a super SFF mobo with a GPU bay, but that’s close to what they did here.
Question about how shared VRAM works
So I need to specify in the BIOS the split, and then it’s dedicated at runtime, or can I allocate VRAM dynamically as needed by workload?
On macos you don’t really have to think about this, so wondering how this compares.
It will most likely be dynamic, with the option to statically set it.
Soldered on ram and GPU. Strange for Framework.
Apparently AMD couldn’t make the signal integrity work out with socketed RAM. (source: LTT video with Framework CEO)
IMHO: Up until now, using soldered RAM was lazy and cheap bullshit. But I do think we are at the limit of what’s reasonable to do over socketed RAM. In high performance datacenter applications, socketed RAM is on it’s way out (see: MI300A, Grace-{Hopper,Blackwell},Xeon Max), with onboard memory gaining ground. I think we’ll see the same trend on consumer stuff as well. Requirements on memory bandwidth and latency are going up with recent trends like powerful integrated graphics and AI-slop, and socketed RAM simply won’t work.
It’s sad, but in a few generations I think only the lower end consumer CPUs will be possible to use with socketed RAM. I’m betting the high performance consumer CPUs will require not only soldered, but on-board RAM.
Finally, some Grace Hopper to make everyone happy: https://youtube.com/watch?v=gYqF6-h9Cvg
Sound like a downgrade to me I rather have capability of adding more ram than having a soldered limited one doesn’t matter if it’s high performance. Especially for consumer stuff.
Looking at my actual PCs built in the last 25 years or so, I tend to buy a lot of good spec ram up front and never touch it again. My desktop from 2011 has 16GB and the one from 2018 has 32GB. With both now running Linux, it still feels like plenty.
When I go to build my next system, if I could get a motherboard with 64 or 128GB soldered to it, AND it was like double the speed, I might go for that choice.
We just need to keep competition alive in that space to avoid the dumb price gouging you get with phones and Macs and stuff.
I definitely wouldn’t mind soldered RAM if there’s still an expansion socket. Solder in at least a reasonable minimum (16G?) and not the cheap stuff but memory that can actually use the signal integrity advantage, I may want more RAM but it’s fine if it’s a bit slower. You can leave out the DIMM slot but then have at least one PCIe x16 expansion slot. A free one, one in addition to the GPU slot. PCIe latency isn’t stellar but on the upside, expansion boards would come with their own memory controllers, and push come to shove you can configure the faster RAM as cache / the expansion RAM as swap.
Heck, throw the memory into the CPU package. It’s not like there’s ever a situation where you don’t need RAM.
All your RAM needs to be the same speed unless you want to open up a rabbit hole. All attempts at that thus far have kinda flopped. You can make very good use of such systems, but I’ve only seen it succeed with software specifically tailored for that use case (say databases or simulations).
The way I see it, RAM in the future will be on package and non-expandable. CXL might get some traction, but naah.
The cache hierarchy has flopped? People aren’t using swap?
NUMA also hasn’t flopped, it’s just that most systems aren’t multi socket, or clusters. Different memory speeds connected to the same CPU is not ideal and you don’t build a system like that but among upgraded systems that’s not rare at all and software-wise worst thing that’ll happen is you get the lower memory speed. Which you’d get anyway if you only had socketed RAM.
In systems where memory speed are mismatched, the system runs at the slowest module’s speed. So literally making the soldered, faster memory slower. Why even have soldered memory at that point?
Ye the soldered ram is for sure making me doubt framework now.
Apparently AMD wasn’t able to make socketed RAM work, timings aren’t viable. So Framework has the choice of doing it this way or not doing it at all.
In that case, not at all is the right choice until AMD can figure out that frankly brain dead easy thing.
“brain dead easy thing”… All you need is to just manage signal integrity of super fast speed ram to a super hungry state of the art soc that benefits from as fast of memory as it can get. Sounds easy af. /s
They said that it was possible, but they lost over half of the speed doing it, so it was not worth it. It would severely cripple performance of the SOC.
The only real complaint here is calling this a desktop, it’s somewhere in between a NUC and a real desktop. But I guess it technically sits on a desk top, while also being an itx motherboard.
I don’t get the point. Framework laptops are interesting because they are modular but for desktop PCs that’s the default. And Framework’s PCs are less modular than a standard PC because the RAM is soldered
That makes no sense - that’s more like Apple then…
I don’t know if it’s the case, but modular IO on PC maybe nice.
Looks like a pile of shit for easily-impressionable morons, but that’s to be expected from framework.
What exactly do you want instead?
Great products for great prices!
Like what, specifically, instead of this?
Lol. Are you nuts? Am I really supposed to sit here and list off what makes a great product for a great price?
Let’s be real. You don’t like how I criticized how people like you are getting taken for a ride so you’re desperate to make it seem like it’s not true.
The sooner you realize how you’re being taken advantage of, the sooner you can start to do something about it.
Am I really supposed to sit here and list off what makes a great product for a great price?
I don’t understand what you are asking for.
You don’t have to be extensive, but… what would you want instead? A more traditional Mini PC? A dGPU instead? A different size laptop? Like, if you could actually tell Framework what you want, in brief, what would you say?
Fair enough.
I skimmed it for a few seconds, got a little bit ill at the $1100 starting price, and then it occurred to me: what is this for?
Wasn’t framework’s whole thing about making modular laptops? What value are they bringing to the mini-ITX market? They’re already modular. In fact, it looks like they’re taking away customizability with soldered RAM.
You asked me what I want, and this is definitely what I don’t want. If they wanted to make this product appealing to me, they’d have to lower the price and live more modest lifestyles with the more modest profit margins.
Edit: After closer inspection (albeit, not that close so I may have missed something) it looks like this… thing doesn’t even have a dedicated GPU. Yeah, framework can suck my fucking balls lol.
You can literally get a 4070 gaming laptop these days for ~$1000 and framework is trying to push this shit? They can fuck off so hard it’s not even funny. This is why the free world never has enough to go around, because we waste our excess on dumb shit like this.
Here’s a gaming laptop with a 4070 and a 144hz screen for $900 at Walmart:
Fuck framework.
This is ostensibly more of a workstation/dev thing. The integrated GPU is more or less like a very power efficient laptop 4070/4080 with unlimited VRAM, depending on which APU you pick, and the CPU is very fast, with desktop Ryzen CCDs but double the memory bandwidth of what even an 9800 X3D has. In that sense, it’s a steal compared to Nvidia DIGITs or an Apple M4 Max, and Mini PC makers alternatives haven’t really solidified yet.
I think Framework knows they can’t compete with a $900 Walmart laptop and the crazy bulk pricing/corner cutting they do, nor can they price/engineer things (with the same bulk discounts) at the higher end like a ROG Z13/G14.
So… this kinda makes sense to me. They filled a gap where OEMs are enshittifying things, which feels very framework to me.
This is a standard a370 mini PC at a high price.
There’s Beelink, Minisforum, Aoostar and many others.
The AI max chips are a completely different platform, more than double the physical silicon size of most minipc chips.
Really framework ? Soldered ram ? How dissapointing
The CEO of Framework said that this was because the CPU doesn’t support unsoldered RAM. He added that they asked AMD if there was any way they could help them support removable memory. Supposedly an AMD engineer was tasked with looking into it, but AMD came back and said that it wasn’t possible.
Now, can we have a cool European company doing similar stuff? At the rate it’s going I can’t decide whether I shouldn’t buy American because I don’t want to support a fascist country or because I’m afraid the country might crumble so badly that I can’t count on getting service for my device.
I could envision MNT Research trying this in the future, but not for now.
“To enable the massive 256GB/s memory bandwidth that Ryzen AI Max delivers, the LPDDR5x is soldered,” writes Framework CEO Nirav Patel in a post about today’s announcements. “We spent months working with AMD to explore ways around this but ultimately determined that it wasn’t technically feasible to land modular memory at high throughput with the 256-bit memory bus. Because the memory is non-upgradeable, we’re being deliberate in making memory pricing more reasonable than you might find with other brands.”
😒🍎
Edit: to be clear, I was only trying to point out that “we’re being deliberate in making memory pricing more reasonable than you might find with other brands” is clearly targeting the Mac Mini, because Apple likes to price-gouge on RAM upgrades. (“Unamused face looking at Apple,” get it? Maybe I emoji’d wrong.) My comment is not meant to be an opinion about the soldered RAM.
To be fair it starts with 32GB of RAM, which should be enough for most people. I know it’s a bit ironic that Framework have a non-upgradeable part, but I can’t see myself buying a 128GB machine and hoping to raise it any time in the future.
If you really need an upgradeable machine you wouldn’t be buying a mini-PC anyways, seems like they’re trying to capture a different market entirely.
seems like they’re trying to capture a different market entirely.
Yes that’s the problem.
That they want to sell cheap ai research machines to use for workstation?
That’s a poor attempt to knowingly misrepresent my statement.
No, it is a question
The answer is that they’re abandoning their principles to pursue some other market segment.
Although I guess it could be said to be like Porsche and Lamborghini selling SUVs to support the development of their sports cars…
I don’t understand how that answers my question
According to the CEO in the LTT video about this thing it was a design choice made by AMD because otherwise they cannot get the ram speed they advertise.
Which is fine, but there was no obligation for Framework to use that chip either.
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
This is one stupid product. It really goes against everything the framework brand has identified with.
Desktops are already that, though. In order for them to distinguish themselves in the industry, they can’t just offer another modular desktop PC. They can’t offer prebuilts, or gaming towers, or small form factor units, or pre-specced you-build kits. They can’t even offer low-cost micro-desktops. All of those markets are saturated.
But they can offer a cheap Mac Studio alternative. Nobody’s cracked that nut yet. And it remains to be seen if this will be it, but it certainly seems like it’s lined up to.
I’m not super well informed, but a socketable AMD nuc form factor machine would’ve been nice, single pcie, m.2 and 2 sodimm ram slots would’ve been good. Could’ve even given the option to route the pcie slot externally and offered an add on egpu case that’s actually worth a damn a la mega drive/sega cd.
