How much latency is acceptable? If you're off in the woods somewhere far from the cloud, sure, but it's less than 10ms to ping Google.com for me, and if the speech-to-text engine runs faster than realtime, I don't see why processing remotely is a problem. 10 ms is nothing.
Still, the transcription part is already here today. The Google Translate app has a transcribe app that does this (runs locally; does not do magic AI "pick voice out from crowd"). My father-in-law has been using it for years. When I'm in a loud environment, the app I use on iOS is called Big, which just displays large text on the screen.
10ms on a wifi connection is exceptional; on a cellular connection it's unheard of. I normally get 70-80ms on 5G, which is well past the threshold for realtime—and that's with a solid connection.
> If you're off in the woods somewhere far from the cloud, sure, but it's less than 10ms to ping Google.com for me
I'm in one of the biggest cities of my current country, and the RTT to google from me is 87-91ms. Well over 4 million people live within 100km of me, so I suspect they see similar latencies. On my cell, I see 191-207ms.
Also in a big city in the Netherlands, but I just blame ziggo. We're getting fiber in my neighborhood ... "soon" ... so we'll see how it is once that happens.
Looks like a good 60ms is nothing but buffer-bloat in the router, as when pinging directly from the router, the RTT is much less.
Still, the transcription part is already here today. The Google Translate app has a transcribe app that does this (runs locally; does not do magic AI "pick voice out from crowd"). My father-in-law has been using it for years. When I'm in a loud environment, the app I use on iOS is called Big, which just displays large text on the screen.
https://apps.apple.com/us/app/make-it-big/id479282584