Your intuition is correct. Moment of inertia (effectively, mass in a rotating frame of reference) scales with radius^2. How much that actually affects the performance of a vehicle is going to be dependent on the vehicle and the exact geometry of the wheel/tire, but relative to each other the 20...