In Indy it all starts with Irsay and continues right down to Ryan Grigson who has made some horrible personnel decisions as their general manager. The guy is an incompetent buffoon, take a look at this quote.
"When you pay Andrew what we did, it's going to take some time to build on the other side of the ball." -- Ryan Grigson
This is their GM, who basically told their franchise QB "we suck on defense because I had to pay you so much money" -- I dont know how Luck took that, but he couldn't have been too happy. Hey dickhead, welcome to the NFL where YOUR JOB is to manage the salary cap like other teams who are good year in and year out figure it out somehow. Other teams find ways to pay their superstar QBs and still somehow be competitive and have defenses who can function. Ryan, Rodgers, Big Ben, and Brady who are all still in the playoffs all are making 20+million a year.
Add in some other genius decisions by Grigson like the Trent Richardson stupidity and the Colts are just a giant train wreck.So now you have Pagano, who seems like a lame duck coach after reports were Irsay was flirting with Gruden (along with everyone else). Reggie Wayne one of their greats, has said recently the front office is a mess there and he's not wrong.
That team needs so much on defense, including an OL to protect luck (28th in sacks allowed), a Rb who isnt ancient, a wr who isnt hurt constantly (Moncrief) etc. They have a long way to go in Indy, especially now that Mathis has retired -- he and Erik Walden who is 31 had half their sacks this year between the two of them. Its still impressive what Luck and Hilton did with this team without a whole lot of other talent.