The Impact of Artificial Intelligence on Video

Big advances are taking place in intersection of video with AI (Artificial Intelligence). I ran across an interesting article in Streaming Media Magazine called The State of Video and AI 2018 that takes stock of some of these changes and I wanted to share it with you as we look toward what’s ahead for Duke.

 

We’ve been following trends in this area from a number of directions, including video captioning. As many of you are aware, the needs for captioning videos we produce at Duke are increasing, but the costs of captioning services, most of which rely on intensive manual labor, are high. However, new tools like IBM’s Watson, which includes more than 60 AI services, including machine captioning (with accuracy advertised as a whopping 96%), seem poised to shift the balance and make it possible for us to caption videos on a wider scale. We demoed Watson recently and will continue to monitor it as well as other tools in this space.

In this context I also wanted to point out that we recently began offering ASR (Automatic Speech Recognition) for Panopto, Duke’s lecture capture service. We are excited about the opportunities this new functionality will offer students and other viewers who are looking to drill down to points in videos where specific terms are found. This feature adds to Panopto’s already healthy set of features built around in-video search, including OCR (Optical Character Recognition) for slide content, and user-created time-stamped notes and bookmarks.

New Features at Rev.com

Rev.com, currently the most widely utilized caption service provider at Duke, just announced some new features we wanted to let you know about. All are included at no extra charge in their standard $1.00 per minute service. For more information about getting started with Rev or another caption provider, you can visit https://oit.duke.edu/what-we-do/services/captioning. You may also be interested in attending A Hands-on Guide to Captioning at Duke, a Learn IT@Lunch session scheduled for Wednesday, January 31, 2018 in which OIT’s Joel Crawford Smith and Todd Stabley will discuss video captioning at Duke and help you set up an account with Rev and get started captioning your videos.

Browser-based Captions Editor: It makes minor fixes, converting formats and frame rates. You can access it on any Order Detail page by clicking “edit”. Or give it a test run here: https://www.rev.com/captions-editor/sandbox

Rev's new browser-based caption editor

Rev’s new browser-based caption editor

Browser-based Transcript Editor: Allows changes like formatting, speaker labels, etc. If you order timestamps, Rev gives you a transcript with word by word timestamps that play along with your file. You can test it out here: https://www.rev.com/transcript-editor/sandbox

Turnaround: Rev reduced transcription turnaround by 25% and caption turnaround by 50% over the last 12 months.

Revver network: Rev crossed 14,000 monthly active Revvers (freelancers who transcribe and caption). 90% are based in US/Canada. This allows us to turn around large volumes with high quality. Rumor has it a Duke staffer who thought they were quite qualified to be a Rev captions editor and was rejected. Say it isn’t so!

Support coverage: Rev expanded their 24/7 support to the weekends as well.

Additional improvements: custom timestamp offset for transcripts, PDF and TXT transcript outputs, and improved Rev API support.

If any of our peer Universities are interested in speaking with Rev, feel free to reach out to us and we’ll connect you.