Resolving vision and language ambiguities together: Joint segmentation & prepositional attachment resolution in captioned scenes

•We perform semantic segmentation and prepositional phrase attachment resolution.•Multiple hypotheses are shown to be crucial to improved multiple-module reasoning.•Joint reasoning produces more accurate results than any module operating in isolation.