This thread is something like this:
https://techenclave.com/t/conflicted-between-upgrading-to-am5-or-max-out-my-am4/388104
Thanks for this. I will go for 12 gen or more
During my testing , I am able to run LLM models upto 43GBs (with 16Gigs GPU+32 gigs RAM) with timeout extension to 30 mins eg llama3.3 . This is the extreme end that I could run but with lag
Lower models runs fine without any issue at least I have not noticed delays in responses. I am not sure if there are benchmarks tools out there to test my system (Pls) suggest, if any).
Unfortunately, I have made the 9070XT purchase before I started looking at LLM’s.
AMD ROCm driver support for 9070XT is good at linux side but requires additional setup in windows.
When I was looking for upgrades with in AM4 platform couple of months ago, I have two paths to choose from one is oriented towards game performance (5700x3d) and another is productivity (5950x). Considering I play only single player games with 1440P, I chose productivity with few less frames for additional cores for LLM’s. I used to run LLM’s with 2700x+9070XT with noticeable lag.
I went with 5900XT as it is new model but downclocked version of 5950x with better memory controller. currently I am in the process to upgrade my ram to 128GBs