Thursday

Google Chrome could be getting its own Live Caption feature


Back at Google I/O last year, the company announced a new tool in Android 10 called Live Caption. As the name suggests, the tool is designed to automatically provide captions for audio that’s playing on your device. It works with videos, podcasts, audio messages, and other supported media, making it a great accessibility tool for the hearing impaired. On top of that, the tool can also be used to help improve the video watching experience in loud environments. Now, according to a commit spotted on the Chromium Gerrit, it seems like the Google Chrome team is working to bring the feature to the browser.


The commit in question is for the SODA (Speed On-Device API) service which is crucial to get live captions to work on the browser.  The description of the commit reads, “This CL creates a sandboxed service that hosts the Speech On-Device API (SODA). It contains the components required to launch the service from the renderer process, but the implementation of the service itself is stubbed out. The design document for the feature is located at: go/chrome-live-captions.” SODA is a first-party product made by Google’s Speech team that transcribes audio into text. The name of the design doc references “Live Caption,” and several methods and constants in one of the Chromium commits also hint at this.


In one of the comments, a Googler explicitly compares this feature to the one on Android and says, “I think we should use “Live Captions” when using a name for the feature to match what’s done on Android.” However, Google wants SODA to be used for more than just Live Captions, based on a comment from another Googler who states, “Based on our discussion with the ChromeOS team, it sounds like they have other speech recognition scenarios they may want to build in the future. The benefit of naming this SODA is that other features can use this component, though it could be seen as a leaky abstraction.”


Google has currently released no information about the upcoming feature but based on the aforementioned information we can safely assume that it will work much like Android 10’s Live Caption feature once released. As of now though, the feature is still in its early stages of development and it will be quite a while before it makes it to a stable release of Google Chrome.



Source: Chromium Gerrit, Chromium Bugs


Via: Chrome Unboxed



Want more posts like this delivered to your inbox? Enter your email to be subscribed to our newsletter.