Hello everyone, today we are going to introduce a highly acclaimed free AI speech-to-text tool.
memo#
It is the latest product from Feishu, called memo.
It is currently in beta testing, but you can apply for the beta qualification and receive the beta code in one or two days.
The software supports both Windows and Mac clients, and its main function is to convert audio and video into text or subtitles, but it is not limited to just that. Let's learn more about it together.
Online Conversion#
Firstly, it supports the conversion of online videos and podcasts, but currently only supports YouTube and a foreign blog platform. After pasting the address and clicking download, it contains multiple built-in models that indicate the characteristics of different models through star ratings. You can choose according to your needs. The language is the language you want to convert to, whether it's text or subtitles. You can also set some AI prompt words for assistance.
After generating the page, you can choose to export it as a subtitle, text, lyrics, markdown, or other formats. If you use Notion as your core working platform, you can also import it automatically. You need to set up your Notion account's API key and page ID in advance.
On this page, you can also edit, translate, and perform simple editing on the generated text. Since it is still in beta testing, only video editing is available, and the editing function for audio or podcast content is not yet open.
Now, the first thing that comes to mind is being a content creator. With this tool, you can directly convert foreign videos into Chinese subtitles and publish them on various platforms.
Local Conversion#
The local audio and video conversion function is even more versatile. The operation method is the same. But there are more use cases. For example, if you have recorded Chinese dubbing, you can directly generate English subtitles and text. You don't have to wait for the subtitle group to watch the downloaded raw video. It's like combining the online Trancy plugin and the local V2Sub software.
However, for all of this, you need to have your own ChatGPT API key. The advantage is that this software is free to use, and if you have a low-cost account source, the cost will be even lower.
Fig Player#
Tools like Fig Player are AI players themselves, with built-in AI subtitle and translation features.
Subtitle Jun: It uses the Whisper model from OpenAI for speech recognition, which is equivalent to having a free AI subtitle group. This part uses the Whisper model locally, just like Memo, so the AI subtitle Jun is completely free.
Translation Jun: It generates translated subtitles based on AI, and you can choose bilingual subtitles. This part runs on the server side and incurs costs, so currently you can experience it for free twice.
You can choose the two software according to your needs. The former is suitable for work, while the latter is for watching movies and entertainment. The former provides a one-stop service, while the latter only provides video subtitle translation and AI translation.