Overview

Contextual Search is a highly customizable tool to search image libraries with text and image queries, built on a powerful multimodal model that maps between natural language and visual features. The Contextual Search API allows you to build and update a large private image database that is unique to your project, and then search this custom set via text or image inputs. In response, the API returns a list of any reference images that are well-described by the text or share visual characteristics with the query image.

Rather than training on specific phrases and image classes, our image-text similarity model applies a generalized understanding of semantic concepts to relate those concepts to visual subject matter in an image. Combined with the flexibility of a custom search index, the API enables straightforward searches for specific images or content types across unstructured public or private image sets, image classification and tagging, and more.