I suspect this is basically it, however I’ve often thought similar could be said of one’s appearance; as it’s distorted by different lighting, whether your clothing’s gotten wrinkled up a certain way, the wind’s messed up your hair, or you accidentally smudged makeup or some dirt on you somewhere. Although that all is also typically easier to adjust (give or take the lighting and wind) than your voice, so that undoubtedly plays into it.