It took more than just one issue to bring Red Lobster down from its pedestal as the largest seafood chain restaurant in the world. The first signs of trouble came in the form of customer decline.