Proper storage is a game changer ... Picture it like this: Red wine vinegar has a defense line of acetic acid that protects it from bacteria. Yet every time you open the bottle, that weakens.