Hi everyone !
I admit i’m kinda sad because most of peertube’s videos aren’t accessible for deaf people.
I remember the first day of youtube, we created FB group to request subtitles on various videos with a team of interpreters. Today, youtube does it automatically, it’s magical ! It’s not flawless but it allowed me watch lot more video. However there 2 issues :
- Youtube removed the possibility to edit the subtitle
- video creator can remove the CC buttons.
So, it deactivate the possibility to benefit from automated subtitles.
So i cocked up some ideas, which i hope it will catches the attention of developers. BTW, I read there were only 1 Dev which is crazy and amazing O.O
I want to improves accessibility for everyone, there is deaf people but also old people too, hard hearing… There is also bad mic or bad speakers. I’m not aware of the feasibility but if it is impossible, just tell me
Here is my dream video player
CC button alway displayed with several option
Always display close captions button, don’t allow the host or uploader to decide the fate of this precious button. Anyway, it won’t activate subtitles by default but people can activate or add subtitles. The close caption button could purpose 4 options :
- Activate/Deactivate subtitles
- Activate/Deactivate Sign languages
- Request subtitles/Sign langages (link to a subtitle company)
- Add subtitles/Sign language (locked by default so only registered user can add subtitle/ sign video)
Transcript
Use subtitles to create an transcript below the video or an document with the full text to download. (See ted talk for reference). The transcription should be below the video in a collapsible element, so we can see comments. Or alternative design, we display transcription side to side with the video. The text follow the video.
Transcript text boost web search
And transcript is an amazing way the improve video search because of keyword. When we search a video, we are limited by its title, description or keyword. If the whole video’s audio is turned into a transcript, Sepia could use it. Imagines, i don’t remember the title but i know some guy said that and this or that the video what about this topic. Dunno if it would improve search result but why not ?
Editing/adding subtitles
Since subtitle are collaborative, I think it should work as mediawiki. A page with revisions and various element to create a group of trusted users to avoid vandalism issues.(And an IP blacklist across all peertube instance ?)
Adding Sign video
I’m not really fan of this solution, however it could improve deaf accessibility by leap and bound as their comprehension skill are limited due to a lack of good pedagogy and interpreters. Here, the main problem is the server memory. We will have 2 videos : The video and the sign language video so it will increase bandwidth and server’s memory a lot. Anyway, the sign language video would appear in a resizable.
Requesting video/subtitle
It would be a cool feature. I’m watching a video and want to paid subtitle so my deaf/ hard hearing friend can watch it. Peertube/Framasoft can create a page with a list of studios willing to add subtitle/sign langage on peertube per country. So when we request the subtitle, we will be directed to this page, we filter by country, choose a company and then fill a contact form with : Peertube Instance, Video name, subject, video ID, and email and send it to them. Then they will send us the cost. Maybe we can imagine a price based on video duration so we can paid them directly
Automated close captions
Integrate a speech to text based on language (AVA ? Mozilla deepspeech ? ). We can have the option to register the subtitle so we can edit them later and improve the result.
Thank for reading my long text. What do you think ? If this project is impossible, just be blunt so i don’t get my hope up. but i also want to understand why it won’t work