Strange. I switched from input jack (always use it) to a USB mic and now speech input works.
Now every time pressing my mic button, I have to allow mic use. Is there a way to set so user only has to allow once? Even once per session would be ok.
Digging deeper into issue, seems like this was (is) a known bug. But best I can tell has been fixed or has experimental API: