Toppan, a global leader in communication, security, packaging, décor materials, and electronics solutions, and 3dig, inc. (3dig) are launching a collaboration focused on high-definition virtual humans created using high-resolution real scanning data.
The project will create photorealistic virtual humans by using data from high-precision biometric scanning performed on the Light Stage1 at the Toppan Virtual Human Lab2 and applying it as training data3 for 3dig’s “anma” system, which uses artificial intelligence (AI) for automated generation of virtual humans. Use of AI-generated virtual humans not based on real-world people will enable creation of image-right-free corporate advertising, video content, and other media.
Corporate advertising and video content using virtual avatars of real-world people or 3D computer graphic (3DCG) virtual humans have garnered interest in recent years. As AI technology evolves and expands, it is being used for simple operations, such as reception desk and guidance functions, and technologies related to virtual humans are expected to grow in importance.
Issues encountered thus far, however, include unnatural expressions and movements as well as a grainy appearance that is conspicuous when virtual humans appear in printed media or on high-resolution displays. In addition to the cost of producing high-resolution replicas of humans, another problem is the so-called “uncanny valley” phenomenon, whereby humanoid objects or images provoke feelings of eeriness in viewers as expressions and movements get closer to resembling those of actual people. Creating virtual humans based on real-world people not only entails costs associated with handling image rights and managing content based on them, but also presents the risk of the content becoming unusable if problems arise in connection to the individuals concerned.
To address these issues, Toppan and 3dig are collaborating on the production of image-right-free content using AI-generated humans that are not based on specific real-world people. Data compiled from high-precision scanning of the human body performed on the Light Stage at the Toppan Virtual Human Lab will be classified and processed into datasets in suitable formats under robust security on Toppan’s Human Body Information Platform. The datasets will then be provided as training data for 3dig to incorporate into its AI-driven anma system to facilitate low-cost production of photorealistic virtual humans that replicate natural expressions and movements and avoid the “uncanny valley” phenomenon.
Toppan aims to create a new model agency business based on using 3dig’s anma system, providing advertising agencies and regional governments with image-right-free content using AI-generated virtual humans and characters not based on real-world people. 3dig will leverage knowledge gained from its research and development of 3DCG and AI to establish a business centered on anma in the form of a platform for low-cost, high-quality generation of virtual humans.
Toppan and 3dig aim to create the training data and begin operating datasets on Toppan’s Human Body Information Platform in 2022. By April 2022, the two companies hope to construct an automated generation platform for image-right-free photorealistic virtual humans, which will be provided to the advertising industry and regional governments.
1. A Light Stage is a piece of equipment for high-precision face scanning developed by the University of Southern California.
2. The Toppan Virtual Human Lab was opened in December 2020 as a facility for advancing research and application development related to the use of face scanning and various other human biometric data.
3. Training data refers to datasets used for machine learning that are typically in the format of example input-output pairs.
About 3dig
3dig aims to build a platform for the purpose of automatic generation of content, based on 3D CG research and production know-how.
About Toppan
Established in Tokyo in 1900, Toppan is a leading and diversified global provider committed to delivering sustainable, integrated solutions in fields including printing, communications, security, packaging, décor materials, electronics, and digital transformation. Toppan’s global team of more than 50,000 employees offers optimal solutions enabled by industry-leading expertise and technologies to address the diverse challenges of every business sector and society and contribute to the achievement of shared sustainability goals.
