You want every layer in your ensemble to seamlessly blend ... make sure the sweater fits nicely under the blazer and can also work when you take the blazer off,” she explains.
However, this decrease was less than 0.5 mph for both of us ... it seems that there is a sort of bell curve when analyzing how layers of clothing affect swing speed and distance.