Product Features
2024-02-05
Communication Capabilities
Basic Features
| Basic Features | Function Description | Business Scenarios |
|---|---|---|
| Video Call | Users join the same room and conduct Video Call. |
|
| Live Streaming | In the same room, including hosts and audience, hosts can conduct Live Streaming, and audience in the room can watch the live stream. |
|
| User Permission Control | Use Token to control user permissions, such as: specifying users to enter/leave rooms; specifying users to speak/mute; specifying users. | Video conference |
| Pre-call Detection | Before conducting Video Call or Live Streaming, detect devices such as cameras, microphones, and monitors to ensure the normal operation of calls or live streaming. | Normal call function detection |
| Call Quality Monitoring | Detect the quality of audio and video, such as resolution, frame rate, bitrate, sampling rate, and other indicators, to ensure stable quality. | Bank account opening, remote appraisal, and other scenarios with high requirements and limitations on audio and video quality |
| Network Speed Test | Before users publish/play streams, detect upstream and downstream network speeds to determine the suitable bitrate for publishing/playing audio and video streams in the current network environment. | Call scenarios, education scenarios, live streaming scenarios |
Advanced Features
| Advanced Features | Function Description | Business Scenarios |
|---|---|---|
| Live Co-hosting | In one room, multiple hosts can appear for co-hosting on the same screen. |
|
| Multi-source Capture | Provides flexible and easy-to-use audio and video capture source and channel management capabilities, reducing developers' development and maintenance costs. | Video conferences, online education |
| Publish Multiple Streams Simultaneously | A user can publish multiple audio and video streams, such as sharing the screen while sending the camera's video stream. | In video conferences, playing PPT while seeing the presenter's screen |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio and video content and transmitted through the streaming channel to achieve precise synchronization between text data and audio and video content. |
|
| Traffic Control | ZEGOCLOUD industry-leading technology. The SDK dynamically adjusts video publishing bitrate, frame rate, resolution, and audio bitrate based on its own and the peer's current network environment status, automatically adapting to the current network environment and network fluctuations, thereby ensuring smooth video publishing. | All scenarios that require high-quality real-time audio and video services |
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is forwarded through cloud proxy servers to enable communication with RTC and L3 (Ultra-low latency Live Streaming). | Hospitals, governments, companies, and other restrictive network environments such as intranets |
| Geofencing | Restricts the transmission of audio, video, and signaling data to a specific region to comply with regional data privacy and security regulations, limiting access to audio and video services in a specific region. | Call scenarios |
| Audio and Video Stream Encryption | Encrypts the stream when publishing, and the decryption key must match the encryption key when playing the stream. | Scenarios that require encrypting stream information to protect communication security |
| Game Voice | Mimics the real world, where people have different auditory experiences based on factors such as the direction and distance of sound. For example, the farther the distance, the smaller the sound. At the same time, groups that can receive audio sources can be limited, such as group discussions in a room where different groups cannot hear each other. |
|
Room Capabilities
Basic Features
| Basic Features | Function Description | Business Scenarios |
|---|---|---|
| Real-time Messaging and Signaling | Real-time messaging mainly provides the function of sending and receiving pure text messages. You can send broadcast messages and bullet screen comments to other users in the same room, or send custom messages to specified users, and implement interactive functions such as likes, gifts, and quizzes as needed. |
|
Advanced Features
| Advanced Features | Function Description | Business Scenarios |
|---|---|---|
| Multi-room Login | A user can enter multiple rooms simultaneously for Video Call or watch Live Streaming. | Teacher multi-class online teaching |
Audio Capabilities
Basic Features
| Basic Features | Function Description | Business Scenarios |
|---|---|---|
| Audio Spectrum and Sound Level | Audio spectrum: the energy value of digital audio signals at each frequency point. Sound level: the volume of a specific stream. |
|
| Headphone Monitor and Channel Setting |
|
|
| Audio 3A Processing | During real-time Video Call or Live Streaming, audio can be processed with 3A to improve call or live streaming quality and user experience.
| All scenarios that require high-quality real-time audio and video services |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changers for comedy effects, use reverb to enhance the atmosphere, and use stereo to make sound more three-dimensional. ZEGO Express SDK provides a variety of preset voice changer, reverb, reverb echo, and stereo effects, allowing developers to flexibly set the desired sound. |
|
Advanced Features
| Advanced Features | Function Description | Business Scenarios |
|---|---|---|
| Scenario-based AI Noise Reduction | Real-time automatic recognition of different scenarios, intelligently adjusting AI noise reduction strategies to provide the best noise reduction and audio quality effects. In call scenarios, all sounds except human voice are identified as noise and eliminated. In music scenarios, the noise reduction effect is automatically adjusted to restore music audio quality. | Voice rooms, conferences, voice chat for games, and other 1v1 or multi-person audio and video call scenarios, as well as live streaming or online KTV scenarios with sound cards, singing, and near-field music |
| Custom Audio Capture | Developers can obtain audio information themselves and hand it over to the SDK for transmission. |
|
| Custom Audio Rendering | Audio is rendered by developers themselves and then played. | Developers have their own special rendering requirements |
| Custom Audio Processing | Developers can perform special audio processing themselves. | When there are special sound processing requirements that the SDK cannot meet, such as special voice changing |
| Original Audio Data Access | The function of obtaining original audio recording, the obtained original audio data format is PCM. | Audio data retention or special processing |
Video Capabilities
Basic Features
| Basic Features | Function Description | Business Scenarios |
|---|---|---|
| Common Video Configuration | During video calls or live streaming, customize and set relevant configurations for captured and played video, such as video capture resolution, video encoding output resolution, video frame rate, bitrate, view mode, and mirror mode. |
|
| Screen Sharing | Share screen content with other users in the room as video during video calls or interactive live streaming. |
|
| Watermark and Screenshot | Watermarks such as copyright logos can be added to the video screen. | Copyrighted video sharing, etc. |
Advanced Features
| Advanced Features | Function Description | Business Scenarios |
|---|---|---|
| Set Video Encoding Mode | Detailed settings can be made for video encoding and decoding, including enabling layered video encoding, using hardware encoding and decoding, and setting encoding modes. | When there are special requirements for encoding and decoding |
| Custom Video Capture | Customizing the provision of video input sources to ZEGO Express SDK to input video data, and ZEGO Express SDK performs encoding and publishing. |
|
| Custom Video Rendering | Custom video rendering refers to the SDK providing local preview and remote played video frame data to the outside for users to render themselves. |
|
| Custom Video Preprocessing | Developers perform custom preprocessing on video data themselves. | AI Effects, adding accessories, etc. |
| H.265 | Through the more advanced H.265 encoding technology, higher clarity can be provided at the same bitrate. | Poor network environments require higher audio and video call and live streaming experiences that are more sensitive to bandwidth |
| Small and Large Video Streams and Layered Encoding | Divides the stream into a base layer and an enhancement layer, providing better experiences for users with different network states and device performance. | Video call |
| Publish Video Enhancement | ZEGO Express SDK provides various video preprocessing enhancement capabilities. Developers can adjust the screen effects on the publishing side according to business needs.
|
|
Live Streaming Capabilities
Basic Features
| Basic Features | Function Description | Business Scenarios |
|---|---|---|
| Stream Mixing | Mixes multiple video streams from multiple users into one stream, so you only need to play one stream to see the screens of all members in the room and hear the sounds of all members in the room. | Multi-person call host co-hosting |
| Using CDN for Live Streaming | Unifies access to multiple CDN capabilities. This function supports publishing streams to CDN, connecting RTC products and CDN live streaming products, making it convenient for users to watch live content directly from web pages or third-party players. | Basic live streaming with high concurrency, scenarios without strong requirements for live streaming latency |
| CDN Stream Publishing Authentication | To prevent attackers from stealing developers' publishing stream URL addresses for use elsewhere, or forging developers' servers to generate publishing stream URL addresses, thereby causing traffic loss, you can configure CDN stream publishing authentication through the ZEGOCLOUD Console. After enabling authentication, relevant authentication parameters need to be spliced into the publishing stream URL address, otherwise the stream cannot be published. | - |
| Playing Stream by URL | When the publishing end uses third-party publishing tools (such as OBS software, network camera IP Camera, etc.) to push the stream to the CDN, or uses the ZEGO SDK's re-publish to CDN function to push the audio and video screen to a third-party CDN, you can play the stream by directly passing in the URL address. | Third-party live streaming screen acquisition |
Advanced Features
| Advanced Features | Function Description | Business Scenarios |
|---|---|---|
| Ultra-low Latency Live Streaming | Focuses on providing stable and reliable live streaming services. Compared with standard video live streaming products, audio and video latency is lower, synchronization is stronger, weak network resistance is better, bringing users millisecond-level live streaming experiences. |
|
| Single Stream Transcoding | Converts a single original stream into transcoded streams with different encoding formats and resolutions in the cloud. In scenarios such as live streaming, audiences can choose streams with different resolutions to watch based on access network quality, terminal devices, etc., to ensure smooth playback. | Live streaming scenarios |
Other Capabilities
Basic Features
| Basic Features | Function Description | Business Scenarios |
|---|---|---|
| Media Player | Provides the ability to play audio and video media files, and supports pushing the audio and video data of the played media files out as streams. |
|
| Audio Effect Player | Provides an audio effect player and manages audio effects uniformly to achieve effects such as playing control of short sound effects that enhance realism or set the scene atmosphere. |
|
| Audio and Video Recording | During video calls, live streaming, and online teaching, users often need to record and save videos for subsequent on-demand viewing by other users. ZEGO provides various recording solutions to meet recording needs in different scenarios. |
|
| Camera Zoom | By setting the camera zoom ratio through the SDK, the effect of enlarging distant objects during shooting can be achieved. | Outdoor live streaming |
Advanced Features
| Advanced Features | Function Description | Business Scenarios |
|---|---|---|
| Play Transparent Gift Effects | ZEGO Express SDK media player provides the function of separating RGB channel and Alpha channel to play MP4 materials (MP4 materials after splicing RGB and Alpha), realizing the dynamic effect of playing transparent gifts, that is, when playing gift effects, it will not block the live streaming room content, greatly improving user experience. |
|