It is shown that, in images of man-made environments, the horizon line can usually be hypothesized based on a-contrario detections of second-order grouping events, which allows constraining the extraction of the horizontal vanishing points on that line, thus reducing false detections.