I think the idea is that even though Thor or Loki was not really moving to be aggressive or down right battle Strange, he seemed to have a dominant fight intellect of them. Thor and Loki did somewhat threaten Strange and he essentially rolled his eyes and put them where he wanted them to be. By all appearances he seemed to have an intellectual advantage over them as Thor, at times, seem to take a braun of brains approach and Strange wanted to get the problem solved.... so he did. I believe the assumption is, by what what we saw in the movie, is that no matter what you're not only going to have to be powerful but as smart or smarter than Strange. The way he leverages his power to carry out whatever plan he has in his mind at the moment is pretty impressive. I believe that's why you're seeing this said so much. It was just played out as if Strange considered their bully-ish / brute technique to get answers annoying and a waste of his time. You have to give him some credit, no matter their intent, facing Thor and Loki at any level and showing no lack of concern what so ever was pretty cool.