The GMK X2 doesn't have the Framework motherboard, but it's the same AMD APU, so the characteristics should be similar.
This really ought to be a consumer-grade LLM powerhouse, but the results were underwhelming. Due to the APU design, bandwidth between the APU and the discrete GPU is limited. From the Reddit poster "In this case adding the 7900xtx is effectively like just having another 24GB added to the 128GB."
Running an AMD GPU with the AMD APU should save the headache of dealing with both Nvidia and AMD drivers on the same host. It's possible that an Nvidia GPU might give better performance here, or there might be other optimizations to be made.
A GPU like that wouldn’t fit in the case and kinda defeats the purpose of getting the included mobo/CPU/iGPU combo... so why are you trying to make a discrete GPU work with that PC at all rather than just getting mini-ITX system with a standard desktop CPU?
Sometimes you want the option of having an external graphics card for that extra boost, especially because I foresee buying a computer and being able to use it for more than like 1 or 2 years. And most video games that I have been playing start lagging really hard 1 or 2 years after my computer was built
Yeah, it just doesn’t seem like the Framework Desktop is really the right starting point for something where you’d want a discrete GPU; you’re basically throwing away the cost, advantages, and specialization required to build a Strix Halo desktop in the first place.