A few days ago I had written a post about this AI system that could synthesise sound clips from text and make it sound like anybody its creators wanted and that the researchers had used the voice of Joe Rogan as an example.
Although impressive, I found it really creepy that you could essentially make anybody say anything which could have huge repercussions. Well, if that was not enough to scare you, there has been a new development that takes things a step further.
Egor Zakharov has created an algorithm that can covert still portraits of people into short videos. If you're wondering where you might have seen this before, it's probably in the Harry Potter movies where a photograph of a person, acts as a video in newspapers and where paintings come alive.
You may already know about deepfakes where machine learning algorithms can be used to analyse a video of a person and then their face can be overlayed onto other person's face in another video. It's essentially a face swap in very simple terms, but this algorithm goes even beyond that.
By feeding still photos of a person, the machine learning algorithm is able to analyse the different facial features and predict what they would look like in various angles, something that is critical if a convincing video is to be made.
The more photos are fed into the system, the better the results are. What is amazing is that the algorithm works even if it is fed just one photo although the result can easily be seen as something generated by a computer.
You can check out in the video above how great the system works with even just three photos of someone. But what you will find really amusing is that this algo can be used to make videos of paintings as well. It was able to make Mona Lisa talk!
Again, as with the previous AI system, the same problems exist here also. We are quickly moving to a time where the authenticity of nothing could be sure about. Not videos, not photos and not even sound clips. I wonder how the legal system, security systems or even society as a whole will adjust to this new reality but I hope enough timely regulations are made so that the common folk don't end up paying the price for something they didn't do.
