I'm declaring my problem solved. I just made some aluminium spacers. If anyone wants to make their own, the hole diameter is 4.8mm, the outer diameter is 9.65mm and the thickness is 0.4mm
They fill up a lot of the hex but are still loose enough not to get stuck in the wheel. They are rigid enough not to bend easily.
