Yep, that's correct. Larger wheel diameter = larger circumference = fewer revolutions required to go the same distance = decreased RPMs of all components in the drivetrain at the same speed.
That decrease in engine RPM is what makes OD unusable for me on anything but flat ground, there's not enough power there to maintain speed. Which is why people regear their axles.