Patriots are just playing at a little higher level right now than pretty much everyone else.
Not unbeatable by any means, but you have to bring your A+ game to beat them. With Scobee not sucking, things might have turned out differently week 1 vs them, same could be said for some gaffes the Colts made. But they didn't, and the Pats didn't make those same mistakes.
On a neutral field with our team healthy, I think we could definitely beat them. The blueprint for years beating Brady is being able to drop guys into coverage and get pressure up front with a base pass rush. The early years we tried blitzing him constantly which never worked, Brady is just too good finding holes vacated from blitzers and it wasnt until we started pressing their wrs and making him hold the ball did we start having success. The Jets in the Ryan years when their defense was lights out showed how to get Brady off his game. Most defenses though dont have corners like Revis and Cromartie to play press man and lock guys down 1 on 1 where you can then double Gronk and make him hold the ball till the front guys get home. Taking the Pats hating glasses off, what has most impressed me over the years is how good they were at protecting him, even against teams that had very good success blitzing.
That said, a team that can get into a shootout with them like the Packers I think could definitely beat them as well. I'd also say the Bengals but that game would end up in prime time, so no dice. Im also interested to see how the Jets with a much better offense than years past does vs them next week.