DevDays Europe 2022

Martin Förtsch

Position: Principal Consultant

Company: TNG Technology Consulting

Country: Germany

Biography

Martin Förtsch is an IT consultant of TNG Technology Consulting GmbH based in Unterföhring near Munich who studied computer sciences. Workwise his focus areas are Agile Development (mainly) in Java, Search Engine Technologies, Information Retrieval, and Databases. As an Intel Software Innovator and Intel Black Belt Software Developer he is strongly involved in the development of open-source software for gesture control with 3D-cameras like e.g. Intel RealSense and has built an Augmented Reality wearable prototype device with his team based on this technology. Furthermore, he gives many talks at national and international conferences about Artificial Intelligence, the Internet of Things, 3D-camera technologies, Augmented Reality, and Test Driven Development as well. He was awarded the Oracle JavaOne Rockstar.

Jonas Mayer

Position: Software Consultant

Company: TNG Technology Consulting

Country: Germany

Biography

Jonas Mayer works in the Innovation Hacking Team of TNG Technology Consulting where his main focus lies on creating innovative showcases and prototypes in both soft- and hardware. Since 2018 he’s been working on numerous projects ranging from real-time deepfakes, over mixed reality art experiences, all the way to autonomous miniature drones.

Prior to joining TNG, Jonas studied Informatics: Games Engineering at TU Munich. Apart from the obvious game projects throughout the course of his studies, he focused mainly on artificial intelligence and high performance computing.

Thomas Endres

Position: Partner

Company: TNG Technology Consulting

Country: Germany

Biography

Thomas studied IT at the TU Munich and is passionate about software development and all the other aspects of technology. As an Intel Software Innovator and Black Belt, he is promoting new technologies like AI, AR/VR and robotics around the world. For this he received amongst others a JavaOne Rockstar award.

Talk

Pushing Deepfakes to The Limit – Fake Video Calls With AI

Today’s real-time Deepfake technology makes it possible to create indistinguishable doppelgängers of a person and let them participate in video calls. Since 2019, the TNG Innovation Hacking Team has intensively researched and continuously developed the AI around real-time Deepfakes. The final result and the individual steps towards photorealism will be presented in this talk.

Since its first appearance in 2017, Deepfakes have evolved enormously from an AI gimmick to a powerful tool. Meanwhile, different media outlets such as “Leschs Kosmos”, Galileo, and other television formats have been using TNG Deepfakes.

In this talk we will show the different evolutionary steps of the Deepfake technology, starting with the first Deepfakes and ending with real-time Deepfakes of the entire head in high resolution. Several live demos will shed light on individual components of the software. In particular, we focus on various new technologies to improve Deepfake generation, such as Tensorflow 2 and MediaPipe, and the differences in comparison to our previous implementations.

Session Keywords

🔑 Deepfakes
🔑 OpenCV
🔑 Transfer Learning
🔑 Generative Adversarial Networks

« Back