Abstract: Disclosed is method of visual search for objects that include straight lines. A two-step process is used, which includes detecting straight line segments in an image. The lines are generally characterized by their length, midpoint location, and orientation. Hypotheses that a particular straight line segment belongs to a known object are generated and tested. The set of hypotheses is constrained by spatial relationships in the known objects. The speed and robustness of the method and apparatus disclosed makes it immediately applicable to many computer vision applications.