Studio Babelsberg

Carl Laemmle Institut of Filmakademie Baden-Württemberg and Studio Babelsberg collaborate in innovative Virtual Production and applied Machine Learning (AI) research and potential applications. As a first outcome of the collaboration, a detailed scan of the Metropolitan Backlot, a 15.000 m² outdoor set for Film & TV productions representing diverse architectural styles, was realized.

Another area of investigation is the segmentation of objects from 2D images and creation of alike 3D geometry for interactive environments. The image below showcases the process. Initially showing a 2D image of a physically built set by Studio Babelsberg's Art Department. By processing the image with machine learning algorithms we can segment and extract individual objects such as the chair or the candleholder in an alike representation as 3D geometry. This allows for virtual interaction with previously built physical film set elements long after their initial use.