Hmm, i too am apparently a poor writer of technical detail. So i present to you, similairly poor graphical skill!
You were mentioning that the ball was pushing the tyre outwards? So my idea is that the outer idler balls with fixed axes would help alleviate this and maintain contact and friction bwteen the moving axis ball and the inner wheels?