We don't normally view people upside down and so our brains aren't accustomed to it. However, when a portrait of a person is upside down, but some of the features on the upside down face are right-side up, our brain doesn't register the problem...until you flip the picture over.