So, how to remove it? Let's get started! Related: How To Clean ... basin of white vinegar. The acidic nature of vinegar should take care of loosening even the biggest, baddest rust stains.