Points-of-Interest from Mapillary Street-level Imagery: A Dataset For Neighborhood Analytics

The Sustainable Development Goals of the United Nations promote sustainable urban development to make cities more economically and socially liveable. Points of Interest (POIs) such as commercial properties and healthcare facilities are significant markers for these goals. Street-view images are becoming increasingly important for capturing cities’ streetscapes. Existing studies provide city-level images, while there are few studies that provide images in the vicinity of certain POIs. Therefore, this paper develops a framework for filtering images so that a portion of a given POI is visible in their field of view (FOV). We contribute with Mapillary POI-Neighborhood Street-Level Images (MPOINSLI) dataset, a large street-view image of POIs and their neighborhood in New York City. First, all the images within a 35-meter radius of certain POIs are filtered. Then, the intersection technique is utilized to determine if the cameras’ FOV triangular polygons intersect the POIs’ polygons. Using 11,126 POIs from SafeGraph’s Geometry and Place datasets in conjunction with 875,592 Mapillary images, we demonstrate the effectiveness of our approach. MPOINSLI contains 167,743 Mapillary street-view images of 6,732 unique POIs, defined by the standard identifiers (Placekeys) which are further classified into 23 general functionalities categories (top-categories) and 67 more specific categories (sub-categories) of the POIs. MPOINSLI provides an open-source repository that contains metadata such as raw and post-processed camera-related parameters, the Harvesian distance between the camera and the POI’s coordinates, and the intersection area. MPOINSLI could provide promising future applications for both smart cities and computer vision, including scene recognition across POI neighborhoods and fine-grained land-use classification.