I've seen some budget cases (Corsair 4000d off the top of my head, there could be more) that come with vertical slots. But these are usually close to the side panel and might marginally increase GPU temps? Also if you can find a looong riser cable you might still be able to use the top PCIe slot and not block the others.