So proud of FFmpeg and VLC project ; I want news like this everyday !
Scavenging the good stuff from AI and putting itt to good use, we need more of this !
Next time automatic translation integration from AI models and we don’t need to worry about the dredge of syncing subtitles with videos, one button compilation process and woosh !
-> in fact “on the fly” means no need for compilation, it is even better than I thought 🤩
I need something like this but for image viewers and for manga/manhwa. It always amazes me how there’s options for this on mobile, even on IOS, but desktop linux doesn’t have anything comparable that has integrated text recognition and translation overlay.
Which is pretty yank, but I know that there’s also Google Lens on android, which does a lot better job, so I assume there’s actual better, more manga reading suited software out there for both mobile OSes.
I saw some implementation on Linux that worked a bit, but…
AnarchistArtificer@slrpnk.net
on 29 Aug 23:09
collapse
I remember way back when I was still intimidated by the command line, I was having issues with a video, and the only info I could find was on using ffmpeg to do some conversions directly. I laugh at the memory of me being nonplussed at trying to launch ffmpeg and expecting a GUI to pop up.
I am glad that I spent some time getting to know ffmpeg directly. There’s been a few times where knowing that it was ffmpeg under the hood helped me.
The changelog lists 30 significant changes, of which the top new feature is integrating Whisper. This means whisper.cpp, which is Georgi Gerganov’s entirely local and offline version of OpenAI’s Whisper automatic speech recognition model. The bottom line is that FFmpeg can now automatically subtitle videos for you.
Yeah hey, can anyone chime in if this is at all based off LLMs? Because my problems with the incorrect plagiarism machine don’t end just because it’s now the offline incorrect plagiarism machine. Making OpenAI’s garbage hockey open source doesn’t make it okay. Or should I just start calling this shit FOSSwashing?
I dug around for a bit and couldn’t find much of anything, but judging by a look at the Github pages for both versions of Whisper, it’s looking very related. If that’s the case, fuck right off. I don’t want AI in FFmpeg, either.
It’s not AI, it’s neural network models in the same way voice recognition in devices has been working for over a decade. Even Dragon has been utilizing language models vectors for a very long time, just requiring voice training instead of utilizing a premade research or open-source data set.
I hate generative AI and it’s slop too, but getting angry about neural network models in general is not only absurd, but playing exactly into what corporations want – conflation of the underlying basic technology concepts with the capitalistic vampirism of art.
EDIT: to add, “research” here can be closed source – voice models utilized with these tend to be internally-sourced for much of them, at least earlier ones do.
drosophila@lemmy.blahaj.zone
on 29 Aug 18:59
collapse
It’s not AI, it’s neural network models
These used to be called AI before people decided that only LLMs and Diffusion models were AI. Both of which are types of neural networks.
But much more loosely-so, not nearly as heavily. It was more like a seldom-used term to say that it might be like what machine learning actually was.
Now they’re all being called it heavily, forcefully, by corporations which started using it for capitalistic hype reasons. Hence, the push for strong distinctions between a field that’s been around for quite a while as algorithms in mathematics being a variety of types, and lazy slop that “just one more prompt bro” and “we can replace workers”. Even DLSS wasn’t called “AI” until the hype train started, and now Jensen Huang can’t call it that often enough lest he be unable to afford yet another leather jacket as if they’re disposable glasses wipes.
herseycokguzelolacak@lemmy.ml
on 29 Aug 15:57
nextcollapse
threaded - newest
So proud of FFmpeg and VLC project ; I want news like this everyday ! Scavenging the good stuff from AI and putting itt to good use, we need more of this ! Next time automatic translation integration from AI models and we don’t need to worry about the dredge of syncing subtitles with videos, one button compilation process and woosh ! -> in fact “on the fly” means no need for compilation, it is even better than I thought 🤩
I use mpv & it’s just a gui frontend to ffmpeg. I have some layering issues with VLC on Linux…
Isn’t MPV liberally not a GUI?
I need something like this but for image viewers and for manga/manhwa. It always amazes me how there’s options for this on mobile, even on IOS, but desktop linux doesn’t have anything comparable that has integrated text recognition and translation overlay.
Can you share those options? I’m curious.
I’m just going by what the default image viewer on iOS is capable of:
<img alt="" src="https://lemmy.ca/pictrs/image/c86eae3d-66f3-4a08-8a6d-411680f4dd16.jpeg">
Which is pretty yank, but I know that there’s also Google Lens on android, which does a lot better job, so I assume there’s actual better, more manga reading suited software out there for both mobile OSes.
I saw some implementation on Linux that worked a bit, but…
This is superb news. Now, we need audio translation and we can watch any videos in any language in the whole world.
Currently, doing that is a bit complicated than it needs to be.
After that - dubbing in realtime.
Call it dubblefish
FFmpeg is one of the most underrated software on Linux. It's so important for the ecosystem very widely used. And you most likely barely notice it.
Just like curl.
You mean underrated?
Haha yes. My bad.
I remember way back when I was still intimidated by the command line, I was having issues with a video, and the only info I could find was on using ffmpeg to do some conversions directly. I laugh at the memory of me being nonplussed at trying to launch ffmpeg and expecting a GUI to pop up.
I am glad that I spent some time getting to know ffmpeg directly. There’s been a few times where knowing that it was ffmpeg under the hood helped me.
Yeah hey, can anyone chime in if this is at all based off LLMs? Because my problems with the incorrect plagiarism machine don’t end just because it’s now the offline incorrect plagiarism machine. Making OpenAI’s garbage hockey open source doesn’t make it okay. Or should I just start calling this shit FOSSwashing?
I dug around for a bit and couldn’t find much of anything, but judging by a look at the Github pages for both versions of Whisper, it’s looking very related. If that’s the case, fuck right off. I don’t want AI in FFmpeg, either.
It’s not AI, it’s neural network models in the same way voice recognition in devices has been working for over a decade. Even Dragon has been utilizing language models vectors for a very long time, just requiring voice training instead of utilizing a premade research or open-source data set.
I hate generative AI and it’s slop too, but getting angry about neural network models in general is not only absurd, but playing exactly into what corporations want – conflation of the underlying basic technology concepts with the capitalistic vampirism of art.
EDIT: to add, “research” here can be closed source – voice models utilized with these tend to be internally-sourced for much of them, at least earlier ones do.
These used to be called AI before people decided that only LLMs and Diffusion models were AI. Both of which are types of neural networks.
But much more loosely-so, not nearly as heavily. It was more like a seldom-used term to say that it might be like what machine learning actually was.
Now they’re all being called it heavily, forcefully, by corporations which started using it for capitalistic hype reasons. Hence, the push for strong distinctions between a field that’s been around for quite a while as algorithms in mathematics being a variety of types, and lazy slop that “just one more prompt bro” and “we can replace workers”. Even DLSS wasn’t called “AI” until the hype train started, and now Jensen Huang can’t call it that often enough lest he be unable to afford yet another leather jacket as if they’re disposable glasses wipes.
the people behind ffmpeg need a medal.
Ok, but how to use it?
following
I really like this website for exploring all the options. Not sure how up to date it is with this latest ffmpeg.
ffmpeg.lav.io
Is it in the official Debian apt repos yet?