A project called Real Time Person Removation recently became popular on GitHub.
The magic of this project is that using JavaScript in a Web browser and over 200 lines of tensorflow.js code, characters and objects on a video screen disappear from the complex background in real time.
While this won’t make your harry Potter-like dreams of invisibility come true in real life, at least you can experience the thrill of invisibility in videos and animations.
The project was developed by Jason Meyers, a Web engineer at Google. A plugin was made through Tensorflow.js that allowed the system to separate people and backgrounds and then remove anyone from the scene in real time, meaning people could “disappear” from the video. The effect is as follows:
In order for a person to “disappear” in the shot, the location of the human body must first be found. Tensorflow.js has trained the body segmentation model and can use the machine learning model directly in the browser or node.js.
For the project address, see: github.com/jasonmayes/…