Rupert wasn't voted off his tribe, Candice was. She was voted out because she's 100% untrustworthy. The "Oh I don't know you at all so I wrote your name down" lines were pure bullshit. They all know her, and they all know she's ruthless + makes terrible decisions at the worst times (for her and anyone aligned with her).
I'd guess that Rupert's wife was voted out for a couple of reasons. 1 is that she was the oldest woman on the tribe, and therefore a liability. The other being, as Noodleface said, to weaken Rupert who has made it deep into the jury in all 3 of his seasons.
Now, as far as challenges go, I highly doubt that any of the challenges at RI will be a brute strength challenge (they never have been at RI), and that's all I can picture Rupert winning in vs Candice. She is good in most challenges (balance, relative body strength, puzzles), so Rupert is in big trouble. I'd love it if they could both go home, but whatever.
Edit: Oh, you asked about Colton, too. I think they voted Candice out before Colton because she is much more of a threat than Colton is. Colton's self-destruct timer began the moment he was born, so it's only a matter of time for him. Candice is a much larger threat in every aspect (socially, physically, strategically), and she can't help but to play all angles of the social game. I hate her, but she is good at preserving herself deep into the game (although she'd never be able to win it). Colton is just a piece of shit that you can either use as a pawn or a scapegoat at any time.