Edge Video AI

Edge Video AI

We teach machines to watch live video.

Edge Video AI is a vision language model (VLM) that watches live video, reads what's on screen and what's said, and turns it into signals ads and shopping can act on in the moment.

Who we are

A research and product company in The Hague.

Edge Video AI, founded in 2019.

What we build

A vision language model for live video.

It watches, reads what's on screen and what's said, and says what is happening in the moment.

Where we're going

The market is all video.

Connected TV is where we start.

Design and content partners

  • LG
  • VIDAA
  • Trusted Media Brands
  • Little Dot Studios
  • The Pet Collective
  • V-Shop
  • WeDoTV
  • WeDoTV Big Stories
  • 24x7 Movies
  • C15 Studio
  • MuxIP
  • NBCUniversal
  • MasterChef Méxicoon VIDAA

Our model

A model that watches first, then reasons.

Most AI reads text. Live video moves faster than text and carries more. Our vision language model sits on top: it watches the stream, follows every moment and knows when the ad break comes. A language model sits underneath to help it reason and to build apps when you ask.

About our model

Diagram: the VLM on top watches the stream, follows every moment and knows the ad break; a language model underneath helps it reason
The layered design. Frame from Edge's own explainer film.

Built for television

Edge ACR: our own content recognition on the TV, talking to the VLM.

Works on apps, HDMI and free-to-air. The picture never leaves the set.

Edge ACROur own content recognition on the TV, talking to the VLM.One read is 72 bytes. The picture never leaves the set.
~5 sAbout how often a TV sends a read, while a listed programme is on.Current deployment setting.
OnceThe model reads each channel once at the source. TVs never run it.So model cost follows channels, not screens.
3 inputsHDMI, free-to-air and the TV's own apps.Recognition works from whatever is on the screen.

How we design for privacy

Our view

The missing layer.

Language models changed how software reads text. Video is still mostly a black box to the systems that sell ads against it and the shops that could sell from it. We think a model that can watch live video and say what is happening, in the moment it happens, is the missing layer.

Connected TV is where we start, because it is where live video, advertising and shopping already meet on one screen. The same model reads any live stream.

About Edge Video AI →

What is Edge Video AI?

What is Edge Video AI?
Edge Video AI is a vision language model (VLM) that watches live video, reads what's on screen and what's said, and turns it into signals ads and shopping can act on in the moment.
What is live enrichment?
Live enrichment turns that into IAB categories, scene keywords and brands seen on screen.
What is Edge ACR?
Edge ACR is our own content recognition on the TV, talking to the vision language model (VLM). It works on apps, HDMI and free-to-air. The picture never leaves the set.
What are the first two uses?
The first two uses are ads and shopping. Autonomous Commerce for ads adds that context to the publisher's existing ad request, working alongside their playout and ad server. Shopping turns the moment into something you can buy.
Where is Edge Video AI based?
Edge Video AI is a research and product company in The Hague, founded in 2019.