A computer-implemented method of processing a visual query comprising: at a server system having one or more processors and memory storing one or more programs for execution by the one or more processors: receiving a visual query from a client system, the visual query including an image: receiving location information from the client system, the location information specifying a location of the client system meeting a first level of accuracy and specifying the location of the client system within a first predefined distance of an actual location of the client system; sending the visual query and the location information to a visual query search system; receiving from the visual query search system enhanced location information of the client system based on the visual query and the location information, the enhanced location information specifying a location of the client system meeting a second level of accuracy that more accurately specifies the location of the client system than the first level of accuracy and specifying the location of the client system within a second predefined distance of an actual location of the client system that is less than the first predefined distance, wherein the enhanced location information is determined by: comparing the visual query with a plurality of street view images located within a predetermined range of the location of the client system; identifying, from the plurality of street view images and based on the comparison, a matching image; obtaining, from stored location information for the matching image, a location associated with the matching image; and determining the enhanced location of the client system using the location associated with the matching image; sending a search query to a location-based search system, the search query including the enhanced location information; receiving the one or more search results in accordance with the enhanced location information; and sending at least one of the search results to the client system. receiving a visual query from a client system, the visual query including an image: receiving location information from the client system, the location information specifying a location of the client system meeting a first level of accuracy and specifying the location of the client system within a first predefined distance of an actual location of the client system; sending the visual query and the location information to a visual query search system; receiving from the visual query search system enhanced location information of the client system based on the visual query and the location information, the enhanced location information specifying a location of the client system meeting a second level of accuracy that more accurately specifies the location of the client system than the first level of accuracy and specifying the location of the client system within a second predefined distance of an actual location of the client system that is less than the first predefined distance, wherein the enhanced location information is determined by: comparing the visual query with a plurality of street view images located within a predetermined range of the location of the client system; identifying, from the plurality of street view images and based on the comparison, a matching image; obtaining, from stored location information for the matching image, a location associated with the matching image; and determining the enhanced location of the client system using the location associated with the matching image; comparing the visual query with a plurality of street view images located within a predetermined range of the location of the client system; identifying, from the plurality of street view images and based on the comparison, a matching image; obtaining, from stored location information for the matching image, a location associated with the matching image; and determining the enhanced location of the client system using the location associated with the matching image; sending a search query to a location-based search system, the search query including the enhanced location information; receiving the one or more search results in accordance with the enhanced location information; and sending at least one of the search results to the client system.