Smaller gears, smaller rotating mass, better acceleration of drivetrain (negligable!). Smaller diameter gears, greater frictional losses as geometry moves away from theoretical ideal (negligable unless silly small gears).
Soooo....I don't think it'll make much difference.
