Captio: Video Subtitles in Different Languages

Asaolu Elijah 🧙‍♂️ - Apr 11 '22 - - Dev Community

Overview of My Submission

Language has always been a barrier, but now, with recent technologies, we can translate live text in real time.

However, this does not apply to video; it is still quite difficult to do so. And I'm sure we've all been in a position where we've seen a video clip on the internet (usually with a lot of interaction) and couldn't get the gist of it because it wasn't in our native language. Captio solves this barrier.

Captio is a powerful bot that will generate subtitle for video files in any preferred language. Available via the following medium:

  • Twitter Bot - Twitter is inarguably one of the most used social media platform in the world, and it does make sense that a technology like this one is available on there.
    Check out caption on Twitter.

  • CLI Application - Captio is also available as a CLI application, so that you are able to generate translated subtitles offline.

Submission Category:

Accessibility

Link to Code on GitHub

Captio: Video Subtitles in Different Languages



Twitter bot x Cli program to generate subtitles in different languages.

Read article on Dev.to

Installation

git clone https://github.com/AsaoluElijah/generate-sub captio
cd captio
npm install
Enter fullscreen mode Exit fullscreen mode

API Keys

Once the installation is completed, make sure to rename .env.example to .env and replace all the Twitter API keys and the Deepgram API key with yours.

Learn how to retrieve your Twitter API keys here, and Deepgram's here too.

Usage

Cli

npm run start:cli video="path/to/video" language='spanish'
# Replace spanish with preferred language.
Enter fullscreen mode Exit fullscreen mode

Twitter Bot

npm start:bot
Enter fullscreen mode Exit fullscreen mode

License

MIT




How it works

Behind the seen, Captio uses a lot of open source API to perform it's operation, the diagram below sums it up pretty much.

How it works

Nevertheless, you can checkout the full information on how it works here

Usage

On twitter, to let captio generate translated subtitle for a video tweet, you'll only need to reply the tweet mentioning captio (@generate_sub) like below:

Captio usage on twitter

. . . . . . . . . . .
Terabox Video Player