Listen, Watch, Read: Computers Search for Meaning

European Researchers have created the first integrated semantic search platform that integrates text, video and audio. The system can ‘watch’ films, ‘listen’ to audio and ‘read’ text to find relevant responses to semantic search terms. At last, computers are able to look for meaning in our multimedia searches.

There is a phenomenal amount of content out there on the internet, but therein lies a problem. Sure, text content can be skimmed or glanced, but audiovisual content has to be viewed in linear time. It is very complex to search inside a film or audio recording for relevant information.

But European researchers in the MESH project have developed an integrated platform which they say, for the first time, can combine semantic search — or search by the meaning of the words — and a host of associated tools to deliver more relevant information, from a wide variety of sources that can be accessed from an individual user.
Continue reading at ScienceDaily.