NVIDIA Broadcast version 1.4 update supports eye contact

Setsu

March 10th, 2023

For students and workers, video conferencing is an indispensable part of work life; for the live streaming industry, improving the quality of live streaming is a prerequisite to drive the growth of the industry. For those who need live streaming and video conferencing, NVIDIA has introduced NVIDIA Broadcast to improve call and video quality for multi-functional assistance.

NVIDIA Broadcast is a multi-functional live streaming aid that leverages AI-enhanced computing to enable noise cancellation, virtual backgrounds, portrait tracking, and more. to a higher level.

Noise cancellation eliminates noise and echoes around users with AI. Whether it's the sound of keyboard tapping, microphone currents, or ambient noise, it can be eliminated with this feature. With NVIDIA Broadcast, users can always put themselves in a quiet environment for better call quality, or let participants in a noisy environment get better voice quality with this feature.

Whether it's a live broadcast or a video conference, users can use virtual backgrounds to set the scene if they don't want their surroundings to be inbound. With the background removal, replacement and blurring features, users can customize the background. Let the powerful AI green screen effect personalize the input screen with various backgrounds as you wish.

Portrait tracking dynamically tracks the user's movements in real time with the "Auto Frame" feature and automatically crops and scales. No matter how the user moves, the camera will always place the portrait in the center of the screen to ensure that the viewer can see the user's portrait continuously.

At the same time, NVIDIA Broadcast removes noise from the video and calibrates the frame with the powerful arithmetic support of AI. Whether it's due to low light or other causes, video noise can be eliminated with AI algorithms for clearer picture quality.

The NVIDIA Broadcast 1.4 update also adds eye contact and false light effects, and enhances virtual background effects.

The new eye contact effect predicts the speaker's eyes and changes the direction of their annotation to look into the camera to simulate the effect of eyes looking into the camera. This feature is able to mimic the activity of real eyes, maintaining the natural color of the eyes and normal blinking, and is able to smoothly transition between simulated and real eyes.

With eye contact, content creators can read scripts or notes while recording and keep their eyes in the middle of the camera, while speakers in a video conference can simulate the effect of looking at the conversationalist, thus increasing interaction between the speaker and the conversationalist.

This update also has enhancements to the virtual background, concentrating on the vignette effect. When combined with the background blur effect, this gives an AI-simulated depth-of-field visual effect on the webcam, which immediately improves visual quality. In addition, Broadcast has integrated "Camera Mirroring" and "Selfies", two useful new features for users to explore.

NVIDIA Broadcast supports GeForce RTX 20 series graphics cards and above.