Publishing Stream Video Enhancement

Initialize basic beauty environment

If you need to use the basic beauty feature, you must call the startEffectsEnv interface to initialize the beauty environment before startPreview starts preview and startPublishingStream starts publishing stream.

// Create beauty environment
[[ZegoExpressEngine sharedInstance] startEffectsEnv];

// Create beauty environment
[[ZegoExpressEngine sharedInstance] startEffectsEnv];

After initializing the beauty environment, the SDK will use a fixed video frame data type for transmission internally. If you need to use custom video pre-processing while using the basic beauty feature, you can only configure the corresponding video frame data type:

iOS and macOS platforms: Only support CVPixelBuffer type data, that is, the bufferType of ZegoCustomVideoCaptureConfig is set to "ZegoVideoBufferTypeCVPixelBuffer".

Enable basic beauty effects

After initializing the beauty environment, you can call the enableEffectsBeauty interface before or after publishing stream to enable or disable beauty effects in real time.

// Toggle beauty effects
[[ZegoExpressEngine sharedInstance] enableEffectsBeauty:true];

// Toggle beauty effects
[[ZegoExpressEngine sharedInstance] enableEffectsBeauty:true];

Set basic beauty effect parameters

After initializing the beauty environment, you can call the setEffectsBeautyParam interface before or after publishing stream to set beauty effect parameters in real time.

• smoothIntensity: Smoothing, performs smoothing while retaining facial details, such as retaining moles on the face.
• whitenIntensity: Whitening, increases the overall brightness of the visuals to whiten the face.
• rosyIntensity: Rosy tones, applies warm color processing to the overall visuals.
• sharpenIntensity: Sharpening, applies sharpening processing to the overall visuals. When the visuals are slightly blurry, you can slightly increase sharpening to make contours clearer.

The value range of the above four parameters is 0 to 100. The larger the value, the higher the degree of beauty effects. The default value is 50.

// Create beauty parameter object
ZegoEffectsBeautyParam *beautyParam = [[ZegoEffectsBeautyParam alloc] init];

// Whitening, rosy tones, smoothing, sharpening
beautyParam.whitenIntensity = 50;
beautyParam.rosyIntensity = 50;
beautyParam.smoothIntensity = 50;
beautyParam.sharpenIntensity = 50;

// Set beauty parameters
[[ZegoExpressEngine sharedInstance] setEffectsBeautyParam:beautyParam];

// Create beauty parameter object
ZegoEffectsBeautyParam *beautyParam = [[ZegoEffectsBeautyParam alloc] init];

// Whitening, rosy tones, smoothing, sharpening
beautyParam.whitenIntensity = 50;
beautyParam.rosyIntensity = 50;
beautyParam.smoothIntensity = 50;
beautyParam.sharpenIntensity = 50;

// Set beauty parameters
[[ZegoExpressEngine sharedInstance] setEffectsBeautyParam:beautyParam];

(Optional) Destroy basic beauty environment

When the enableEffectsBeauty interface is called and set to "false", the beauty effects will be disabled, but the beauty module will still occupy resources and consume performance. If you want to completely release resources and save performance consumption, you need to call the stopEffectsEnv interface to destroy the beauty environment before preview and publishing stream.

// Destroy beauty environment
[[ZegoExpressEngine sharedInstance] stopEffectsEnv];

// Destroy beauty environment
[[ZegoExpressEngine sharedInstance] stopEffectsEnv];

ZEGO provides two methods for low light enhancement:

The two processing methods can be used independently or simultaneously, both compatible with beauty features.

Set low light enhancement mode

RTC SDK supports different algorithm low light enhancement modes. Call the setLowlightEnhancement interface to set the low light enhancement mode ZegoLowlightEnhancementMode:

The low light enhancement type ZegoExpLowlightEnhancementType includes the following types:

Taking enabling automatic low light enhancement feature as an example:

ZegoExpLowlightEnhancementParams *params = [[ZegoExpLowlightEnhancementParams alloc] init];
params.mode = ZegoLowlightEnhancementModeAuto;
params.type = ZegoExpLowlightEnhancementTypeAI;
[[ZegoExpressEngine sharedEngine] setLowlightEnhancementParams:params channel:ZegoPublishChannelMain];

ZegoExpLowlightEnhancementParams *params = [[ZegoExpLowlightEnhancementParams alloc] init];
params.mode = ZegoLowlightEnhancementModeAuto;
params.type = ZegoExpLowlightEnhancementTypeAI;
[[ZegoExpressEngine sharedEngine] setLowlightEnhancementParams:params channel:ZegoPublishChannelMain];

(Optional) Enable camera adaptive frame rate

When ambient light is low and the camera capture frame rate is too high, the exposure time of each frame is insufficient, which may cause the captured video visuals to be dark. At this time, you can enable camera adaptive frame rate through enableCameraAdaptiveFPS. The SDK will match the capture frame rate range supported by the camera according to the set frame rate range. Within this range, it will dynamically adjust the camera capture frame rate according to ambient brightness to improve visual brightness when the set frame rate is too high.

//Set minimum frame rate
int minCamFPS = 15;
//Set maximum frame rate
int maxCamFPS = 35;
[[ZegoExpressEngine sharedEngine] enableCameraAdaptiveFPS:YES minFPS:minCamFPS maxFPS:maxCamFPS channel:ZegoPublishChannelMain];

//Set minimum frame rate
int minCamFPS = 15;
//Set maximum frame rate
int maxCamFPS = 35;
[[ZegoExpressEngine sharedEngine] enableCameraAdaptiveFPS:YES minFPS:minCamFPS maxFPS:maxCamFPS channel:ZegoPublishChannelMain];

Call the enableColorEnhancement interface, set the color enhancement parameters ZegoColorEnhancementParams (parameter attributes are shown in the table below), and other parameters to enable the color enhancement feature. Color enhancement feature is not enabled by default.

ZegoColorEnhancementParams *p = [[ZegoColorEnhancementParams alloc]init];
p.intensity = 1f;//Value range: [0,1], the larger the value, the greater the color enhancement intensity. Default value: 0.
p.skinToneProtectionLevel = 1f;//Value range: [0,1], the larger the value, the greater the skin tone protection. Default value: 1.
p.lipColorProtectionLevel = 1f;//Value range: [0,1], the larger the value, the greater the lip color protection. Default value: 0.
[[ZegoExpressEngine sharedEngine]enableColorEnhancement:YES params:p channel:ZegoPublishChannelMain];//Enable color enhancement

ZegoColorEnhancementParams *p = [[ZegoColorEnhancementParams alloc]init];
p.intensity = 1f;//Value range: [0,1], the larger the value, the greater the color enhancement intensity. Default value: 0.
p.skinToneProtectionLevel = 1f;//Value range: [0,1], the larger the value, the greater the skin tone protection. Default value: 1.
p.lipColorProtectionLevel = 1f;//Value range: [0,1], the larger the value, the greater the lip color protection. Default value: 0.
[[ZegoExpressEngine sharedEngine]enableColorEnhancement:YES params:p channel:ZegoPublishChannelMain];//Enable color enhancement