Along with a rapid growth in the volume of user‐generated video clips, efficient video retrieval methods have become one of the most critical challenges in multimedia management. In this article, we propose a service framework using geographic information for retrieval of the videos on the web. The main idea is to describe and query videos by video‐related geographic data such as video location, field of view and trajectory. Based on the point, line and polygon description for videos, we define the commonly used video retrieval methods. A video retrieval service framework and the service interfaces are designed based on the REST architecture. A prototype system is also implemented to test the services. The experiment shows that the proposed video description, retrieval methods and web services are feasible and useful. We believe that the integration of geographical video retrieval methods into existing methods will promote the geo‐tagged video sharing, discovery and consumption in various web applications.