Video Enhancement Before Publishing Stream

1 Initialize the Basic face beautification features environment

If you need to use the Basic face beautification features, you must call the startEffectsEnv interface to initialize the Face beautification environment before calling startPreview to start previewing and startPublishingStream to start publishing the stream.

// Create the Face beautification environment
ZegoExpressEngine.getEngine().startEffectsEnv();

After initializing the Face beautification environment, the SDK will use a fixed video frame data type for transmission. If you also need to use video custom pre-processing when using the Basic face beautification features, you can only configure the corresponding video frame data type:

Android platform: Only supports Texture 2D type data, which means the value of bufferType in ZegoCustomVideoCaptureConfig should be "GL_TEXTURE_2D".

2 Enable the face beautification effect

After initializing the face beautification environment, you can call the enableEffectsBeauty method to enable the face beautification feature you want to use after or before the stream publishing.

// Enable the beauty effect
ZegoExpressEngine.getEngine().enableEffectsBeauty(true);

3 Set the parameters for the Basic face beautification features

After initializing the face beautification environment, you can call the setEffectsBeautyParam method to set the intensity as needed after or before the stream publishing.

• smoothIntensity: Skin smoothing. Smooth the skin while preserving details of the face, such as moles.
• whitenIntensity: Skin tone enhancement. Turn up the overall brightness to whiten your face.
• rosyIntensity: Cheek blusher. Carry on the warm color processing to the whole picture.
• sharpenIntensity: Image sharpening. You can sharpen it slightly to make it clearer when the picture is a little blurry.

The value range for the four features is [0, 100], and the default value is 50. As this value gets larger, the intensity gets stronger.

// Create the face beautification parameter object
ZegoEffectsBeautyParam beautyParam = new ZegoEffectsBeautyParam();

// Set the parameters for Skin tone enhancement, Cheek blusher, Skin smoothing, and Image sharpening
beautyParam.whitenIntensity = 50;
beautyParam.rosyIntensity = 50;
beautyParam.smoothIntensity = 50;
beautyParam.sharpenIntensity = 50;

// Set the Face beautification parameters
ZegoExpressEngine.getEngine().setEffectsBeautyParam(beautyParam);

(Optional) Destroy the Basic face beautification environment

To disable the face beautification features, set the parameter to false when calling the enableEffectsBeauty method. While the face beautification module still occupies resources.

To destroy the face beautification environment and release the resources it occupies, call the stopEffectsEnv method before the local video preview and stream publishing.

// Destroy the face beautification environment
ZegoExpressEngine.getEngine().stopEffectsEnv();

ZEGOCLOUND provides two ways to achieve Low-Light Enhancement:

These two processing methods can be used independently or simultaneously, and are compatible with the beauty function.

1 Set the Low-Light Enhancement mode

The RTC SDK supports different algorithm-based Low-Light Enhancement modes. Call the setLowlightEnhancement interface to set the Low-Light Enhancement mode ZegoLowlightEnhancementMode:

Low light enhancement types ZegoExpLowlightEnhancementType include the following types:

For example, to enable automatic Low-Light Enhancement:

ZegoExpLowlightEnhancementParams params = new ZegoExpLowlightEnhancementParams();
params.mode = ZegoLowlightEnhancementMode.AUTO;
params.type = ZegoExpLowlightEnhancementType.AI;
engine.setLowlightEnhancementParams(params, ZegoPublishChannel.MAIN);

2 (Optional) Enable camera adaptive frame rate

When the ambient light is low and the camera capture frame rate is too high, the exposure time of each frame of the captured image may be insufficient, resulting in a dark video image. In this case, you can enable camera adaptive frame rate by calling enableCameraAdaptiveFPS. The SDK will dynamically adjust the camera capture frame rate based on the supported capture frame rate range of the camera within the set range, and adjust the camera capture frame rate according to the ambient light intensity to improve the brightness of the video image when the set frame rate is too high.

// Set the minimum frame rate
int minCamFPS = getIntent().getIntExtra("camMinFPS", 0);
// Set the maximum frame rate
int maxCamFPS = getIntent().getIntExtra("camMaxFPS", 0);
engine.enableCameraAdaptiveFPS(true, minCamFPS, maxCamFPS, ZegoPublishChannel.MAIN);

Call the setVideoDenoiseParams interface to set the video denoise parameters ZegoVideoDenoiseParams, including the video denoise mode ZegoVideoDenoiseMode and the video denoise strength ZegoVideoDenoiseStrength.

For example, to enable automatic denoise:

ZegoVideoDenoiseParams p = new ZegoVideoDenoiseParams();
p.mode = ZegoVideoDenoiseMode.AUTO;
p.strength = ZegoVideoDenoiseStrength.LIGHT;
engine.setVideoDenoiseParams(p, ZegoPublishChannel.MAIN);

Call the enableColorEnhancement interface to enable the color enhancement function and set the color enhancement parameters ZegoColorEnhancementParams (parameter attributes are shown in the following table) and other parameters. The color enhancement function is not enabled by default.

ZegoColorEnhancementParams p = new ZegoColorEnhancementParams();
p.intensity = 1; //Range: [0,1], a larger value indicates a stronger color enhancement effect. Default value: 0.
p.skinToneProtectionLevel = 1; //Range: [0,1], a larger value indicates a better skin tone protection effect. Default value: 1.
p.lipColorProtectionLevel = 1; //Range: [0,1], a larger value indicates a better lip color protection effect. Default value: 0.
engine.enableColorEnhancement(true, p, ZegoPublishChannel.MAIN); //Enable color enhancement