If the scent of vinegar is still on your towel afterwards, add some tea tree oil to your next wash load to eliminate this.

And, instead of using vinegar, you can simply apply tea tree oil all on its own ... Make sure your bath fan is big enough: If the fans aren't clearing out most of the moisture in your bathrooms ...