Biography

Martin Förtsch is an IT-consultant of TNG Technology Consulting GmbH based in Unterföhring near Munich who studied computer sciences. Workwise his focus areas are Agile Development (mainly) in Java, Search Engine Technologies, Information Retrieval, and Databases. As an Intel Software Innovator and Intel Black Belt Software Developer he is strongly involved in the development of open-source software for gesture control with 3D-cameras like e.g. Intel RealSense and has built an Augmented Reality wearable prototype device with his team based on this technology. Furthermore, he gives many talks at national and international conferences about Artificial Intelligence, the Internet of Things, 3D-camera technologies, Augmented Reality, and Test Driven Development as well. He was awarded the Oracle JavaOne Rockstar.

Biography

In his role as a Partner for TNG Technology Consulting in Munich, Thomas Endres works as an IT consultant. Besides his normal work for the company and the customers he is creating various prototypes – like a telepresence robotics system with which you can see reality through the eyes of a robot, or an Augmented Reality AI that shows the world from the perspective of an artist. He is working on various applications in the fields of AR/VR, AI, and gesture control, putting them to use e.g. in autonomous or gesture-controlled drones. But he is also involved in other Open Source projects written in Java, C#, and all kinds of JavaScript languages. Thomas studied IT at the TU Munich and is passionate about software development and all the other aspects of technology. As an Intel Software Innovator and Black Belt, he is promoting new technologies like AI, AR/VR, and robotics around the world. For this, he received amongst others a JavaOne Rockstar award.

Biography

Jonas Mayer works in the Innovation Hacking Team of TNG Technology Consulting where his main focus lies on creating innovative showcases and prototypes in both soft- and hardware. Since 2018 he’s been working on numerous projects ranging from real-time deepfakes, over mixed reality art experiences, all the way to autonomous miniature drones. Prior to joining TNG, Jonas studied Informatics: Games Engineering at the TU Munich. Apart from the obvious game projects throughout the course of his studies, he focused mainly on artificial intelligence and high-performance computing.

Talk

Realtime Deepfakes – How Neural Networks Are Changing Our World

Imagine looking into a mirror, but not to see your own face. Instead, you are looking in the eyes of Barack Obama or Angela Merkel. Your facial expressions are seamlessly transferred to that other person’s face in real time.

The TNG Innovation Hacking Team has managed to create a prototype that transfers faces from one person to another in real time based on Deepfakes. Neural networks detect faces within a video input, then translate them and integrate them back to the video output. Through this technique it is possible to project deceptively real imitations onto other people. For this purpose, we used Keras trained autoencoder networks and various face recognition algorithms.

In this talk, Thomas Endres and Martin Förtsch will give an entertaining and vivid introduction into the world of real-time Deepfakes. In doing so, they particularly focus on the deep learning techniques used in within the application. Several live demonstrations will complete this event.

Session Keywords

« Back