As large amount of visual Information is available on web in form of images, graphics, animations and videos, so it is important in internet era to have an effective video search system. As there are number of video search engine (blinkx, Videosurf, Google, YouTube, etc.) which search for relevant videos based on user keyword or term, But very less commercial video search engine are available which search videos based on visual image/clip/video. In this paper we are recommending a system that will search for relevant video using color feature of video in response of user Query.