19.04.2024
428

The Neural Network VASA-1 Converts a Photo into a Video

Yuliia Zablotska
Author at ApiX-Drive
Reading time: ~1 min

Microsoft is once again at the forefront of innovation in the field of artificial intelligence. Recently, the company presented its new neural network VASA-1, which can transform ordinary photos into realistic videos. All it takes is one picture and an audio recording for the AI to reproduce emotions and facial expressions in detail and produce an extremely lifelike video. Microsoft's official website already has a page dedicated to this technology, where you can find many examples of its use.

VASA-1 uses advanced algorithms to simulate the movement of parts of the face, ensuring the naturalness and smoothness of facial expressions. AI divides the face into muscle-like segments, which allows for the reproduction of even such complex movements as turning the head. Tools for editing characters' emotional state and gaze direction give users the ability to adapt content to different needs, from entertainment blogs to professional podcasts. The system works on powerful PCs with NVIDIA RTX 4090 graphics processors and supports the creation of videos with a frequency of up to 45 frames per second from photos with a resolution of up to 512x512 pixels.

Because VASA-1's capabilities are truly revolutionary, Microsoft is concerned about the potential use of the neural network to create false videos for manipulation or fraud purposes. Currently, the company is temporarily refusing to distribute online demos, APIs and other tools related to VASA-1 until robust mechanisms are developed to ensure the ethical use of this technology.