Taylor Swift declined an SNL invite to avoid Blake Lively and Kim Kardashian as she distances herself from past drama.