There are quite a few things I feel that lead to this. In the end Woodbury is seemingly a utopia. There aren't zombie attacks and there is not a lack of food. In the source that wasn't true. Rick actually had a better setup in the prison and that was a driving force for the Gov to try and kill them. On the show the Gov isn't seen as being hated by the people. Seemingly everyone is under his spell and just follows him without question (until lately Milton.) However in the source that was extremely different. His decisions were questioned and a few outright spoke up to him to his face.The fact that this conversation is even occurring at all makes me realize just how badly they fucked up with the Governor on the show. They also fucked up on Rick to some extent as well, but not nearly as badly as the Gov. There should be similarities between them for sure, but the Governor should unquestionably be the worse of the two and the fact that it is even debatable sucks. They sure did bungle the whole prison/woodbury story arc pretty badly.
Which leads me to wonder (CB spoiler / possible future storyline spoiler)
When the "Community" arc is supposed to occur I'm not sure how that will work or if they'll go that direction. I feel Woodbury has cannibalized that storyline. If they do that arc next it will seem like Rick and Co. just packed up and moved to Woodbury v2.0 but this time Rick is (eventually) the leader of the new town. It really makes me wonder if they'll go that route or completely abandon the whole D.C. story arc. But if they did that then they also wouldn't be able to have the "Something to Fear" story arc as well since that requires a bunch of communities getting together to operate.