There is only one point in front of a Perspective drawing where its three mutually Perpendicular Vanishing Points appear in mutually Perpendicular directions, but such a drawing nonetheless appears realistic from a variety of distances and angles.
See also Leonardo's Paradox, Perspective, Vanishing Point
References
Dixon, R. Mathographics. New York: Dover, p. 82, 1991.