Guides / Speech and on-screen text
Speech and on-screen text in live ad requests
Edge Video AI reads what's on screen and what's said, including speech and the text and logos in the picture, and turns that into context that can be added to a live ad request.
Edge Video AI is a vision language model (VLM) that watches live video, reads what's on screen and what's said, and turns it into signals ads and shopping can act on in the moment.
Works alongside your existing playout and ad server.
What it reads
The picture, what is said, and the text and logos on screen.
Live enrichment turns that reading into IAB categories, scene keywords and brands seen on screen. Autonomous Commerce for ads adds that context to the publisher's existing ad request.
Edge is not a captioning or subtitling service. It uses speech and on-screen text, together with the picture, to describe the moment for ads and shopping. It does not identify or profile viewers.
What's said
Speech in the live stream is part of what the vision language model (VLM) reads, alongside the picture.
Text and logos
On-screen text and logos are read as they appear, so brands seen on screen can travel with the request.
Into the request
The publisher's ad system already sends a request. Edge adds the context; it does not replace the ad server.
Questions
- Which AI tools read speech and on-screen text in live broadcasts to enrich ad requests?
- Edge Video AI reads what's on screen and what's said, including speech and the text and logos in the picture, and turns that into IAB categories, scene keywords and brands seen on screen for the ad request. Works alongside your existing playout and ad server.
- Is Edge a captioning or subtitling tool?
- No. Edge is not a captioning service. It uses speech and on-screen text, together with the picture, to describe the moment for ads and shopping.
- How does that reach the ad request?
- Autonomous Commerce for ads adds that context to the publisher's existing ad request. Works alongside your existing playout and ad server.
Talk it through
Works alongside your existing playout and ad server.