Product Features
2024-02-05
Communication Capabilities
Basic Features
| Basic Feature | Feature Description | Business Scenario |
|---|---|---|
| Audio and Video Call | Users join the same room and conduct audio and video calls. |
|
| Audio and Video Live Streaming | In the same room, including hosts and audiences, hosts can conduct audio and video live streaming, and audiences in the room can watch the live stream. |
|
| User Permission Control | Use Token to control user permissions, such as: specifying users can enter/leave rooms; specifying users to speak/mute; specifying users. | Video conference |
| Pre-call Detection | Before conducting audio and video calls or live streaming, test devices such as cameras, microphones, and monitors to ensure the normal operation of calls or live streaming. | Normal call function testing |
| Call Quality Monitoring | Test the quality of audio and video, such as resolution, frame rate, bitrate, sampling rate, and other indicators to ensure stable quality. | Bank account opening, remote authentication, and other scenarios with high requirements and restrictions on audio and video quality |
| Network Speed Testing | Before users publish/play streams, detect uplink and downlink network speeds to determine the bitrate of audio and video streams suitable for publishing/playing under the current network environment. | Call scenarios, education scenarios, live streaming scenarios |
Advanced Features
| Advanced Feature | Feature Description | Business Scenario |
|---|---|---|
| Live Co-hosting | Multiple hosts can appear in one room for same-screen co-hosting live streaming. |
|
| Multi-Source Capture | Provides flexible and easy-to-use audio and video capture source and channel management capabilities, reducing developers' development and maintenance costs. | Video conferences, online education |
| Publishing Multiple Streams Simultaneously | One user can publish multiple audio and video streams, such as sharing the screen while sending the camera's video stream. | Playing PPT in a video conference while seeing the presenter's footage |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio and video content and transmitted through the streaming media channel to achieve precise synchronization between text data and audio and video content. |
|
| Traffic Control | ZEGO industry-leading technology. The SDK dynamically adjusts the video publishing bitrate, frame rate, resolution, and audio bitrate according to its own and the remote end's current network environment status, automatically adapting to the current network environment and fluctuations, thereby ensuring smooth video publishing. | All scenarios that hope to have high-quality real-time audio and video services |
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is forwarded through the cloud proxy server to communicate with RTC, L3 (Ultra-Low Latency Live Streaming). | Hospitals, governments, inside companies, and other restrictive network environments such as intranets |
| Geofencing | Limits the transmission of audio, video, and signaling data to a certain region to meet regional data privacy and security regulations, that is, limits access to audio and video services in a specific region. | Call scenarios |
| Audio and Video Stream Encryption | Encrypt the stream when publishing, and must have a decryption key consistent with the encryption key when playing. | Scenarios that need to encrypt stream information to protect communication security |
| Game Voice | Imitates the real world, where people have different auditory experiences based on factors such as the azimuth and distance of the sound, for example, the farther the distance, the smaller the sound. At the same time, it can limit groups of people who can receive the sound source, for example, in a room, discussing in groups, and different groups cannot hear each other's sounds. |
|
| Mass-Scale Range Audio and Video | ZEGO industry-leading technology. Automatically plays remote audio and video within the listening range based on cloud user locations and provides spatial audio effects (by default plays the 12 closest routes), supporting 10,000 users to simultaneously enable microphones and cameras in a single scenario. | Virtual offices, virtual exhibitions, open virtual worlds, and other virtual scenarios |
| Real-Time Multi-User Status Sync | ZEGO industry-leading technology. Provides an ordered, high-frequency, low-latency, large-scale status synchronization service, helping developers quickly implement real-time information synchronization capabilities such as player positions, actions, and appearances in virtual gameplay, while supporting 10,000 users online simultaneously in a single scenario. | Virtual offices, virtual exhibitions, virtual social networking, virtual KTV, and other metaverse scenarios, as well as general scenarios that require ultra-high frequency, low latency, and large-scale synchronized information or control commands |
Room Capabilities
Basic Features
| Basic Feature | Feature Description | Business Scenario |
|---|---|---|
| Room Connection Status Description | Determine the user's connection status in the room, and the conversion process of each connection status. | - |
| Real-Time Messaging and Signaling | Real-time messaging mainly provides the function of sending and receiving pure text messages. You can send broadcast messages and bullet comments to other users in the same room, or send custom messages to certain specified users, and implement interactive functions such as likes, gift giving, and answering as needed. |
|
Advanced Features
| Advanced Feature | Feature Description | Business Scenario |
|---|---|---|
| Login to Multiple Rooms | One user can enter multiple rooms at the same time for audio and video calls or watch live streaming. | Teachers teaching multiple classes online |
Audio Capabilities
Basic Features
| Basic Feature | Feature Description | Business Scenario |
|---|---|---|
| Audio Spectrum and Volume Changes | Audio spectrum: The energy value of digital audio signals at each frequency point. Volume change: The volume of a certain stream. |
|
| Headphone Monitor and Channel Settings |
|
|
| Audio 3A Processing | During real-time audio and video calls or live streaming, 3A processing can be performed on the audio to improve call or live streaming quality and user experience.
| All scenarios that hope to have high-quality real-time audio and video services |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changers to be funny, use reverb to set the atmosphere, and use stereo to make the sound more three-dimensional. ZEGO Express SDK provides a variety of preset voice changer, reverb, reverb echo, and stereo effects. Developers can flexibly set the sound they want. |
|
Advanced Features
| Advanced Feature | Feature Description | Business Scenario |
|---|---|---|
| Scenario-Based AI Noise Reduction | Real-time automatic recognition of different scenarios, intelligently adjusting AI noise reduction strategies to provide the best noise reduction and sound quality effects. In call scenarios, all sounds except human voice are identified as noise and eliminated. In music scenarios, automatically adjust the noise reduction effect to restore music sound quality. | Voice rooms, conferences, voice game blacking and other 1v1 or multi-person audio and video call scenarios, as well as live streaming or online KTV scenarios such as sound cards, singing along, near-field music |
| Custom Audio Capture | Developers can obtain audio information themselves and hand it over to the SDK for transmission. |
|
| Custom Audio Rendering | The audio is rendered by the developer themselves and then played. | Developers have their own special rendering needs |
| Custom Audio Processing | Developers can perform special audio processing themselves. | When there are special sound processing requirements that the SDK cannot meet, such as special voice changers |
| Get the Raw Audio Data | Get the function of raw audio recording. The obtained raw audio data format is PCM. | Audio data retention or special processing |
| AI Voice Changer | "Conan Voice Changer Bowtie" in real-time calls, perfectly reproducing the target character's timbre and rhythm, while retaining the user's speech rate, emotion, and tone, switching timbres at will, with ultra-low latency. |
|
Video Capabilities
Basic Features
| Basic Feature | Feature Description | Business Scenario |
|---|---|---|
| Common Video Configuration | During video calls or live streaming, customize settings for capturing and playing video-related configurations, such as video capture resolution, video encoding output resolution, video frame rate, bitrate, view mode, and mirror mode. |
|
| Screen Sharing | Share screen content with other users in the room as video during video calls or interactive live streaming. |
|
| Watermark and Screenshot | Can add watermarks such as copyright logos to the video screen. | Video sharing with copyright, etc. |
Advanced Features
| Advanced Feature | Feature Description | Business Scenario |
|---|---|---|
| Set Video Encoding Method | Detailed settings for video encoding and decoding can be made, including enabling layered video encoding, using hardware encoding and decoding, and setting encoding methods. | When there are special requirements for encoding and decoding |
| Custom Video Capture | Customize providing video input sources to ZEGO Express SDK to input video data, which is then encoded and published by ZEGO Express SDK. |
|
| Custom Video Rendering | Custom video rendering refers to the SDK providing local preview and remote stream playing video frame data to the outside for users to render themselves. |
|
| Custom Video Pre-processing | Developers perform custom pre-processing on video data themselves. | AI effects, adding accessories, etc. |
| Object Segmentation | ZEGO industry-leading technology. At the publishing end, the subject (in most cases, a person) in the rectangular video is separated by an AI algorithm and transmitted in the RTC network, and rendered at the playing end. | Multi-person remote co-location, show live streaming co-location PK, multi-person online study, and other multi-person co-location scenarios |
| H.265 | Through the more advanced H.265 encoding technology, higher clarity can be provided at the same bitrate. | Poor network environment requires higher audio and video calls, live streaming experience is more sensitive to bandwidth |
| Video Small/Large Streams and Layered Encoding | Divides the stream into a base layer and an enhancement layer, which can provide better experience for users with different network states and device performance. | Video calls |
| Publish Video Enhancement | ZEGO Express SDK provides a variety of video pre-processing enhancement capabilities. Developers can adjust the effect of the screen at the publishing end according to business needs.
|
|
Live Streaming Capabilities
Basic Features
| Basic Feature | Feature Description | Business Scenario |
|---|---|---|
| Stream Mixing | Mix multiple users' multiple video streams into one stream, so you only need to play one stream to see all members' footage in the room and hear all members' voices in the room. | Multi-person call host co-hosting |
| Using CDN for Live Streaming | Unified access to multiple CDN capabilities. This feature supports publishing to CDN, connecting RTC products and CDN live streaming products, making it convenient for users to watch live content directly from web pages or third-party players. | Basic live streaming with high concurrency, scenarios without strong requirements for live streaming latency |
| CDN Stream Publishing Authentication | To prevent attackers from stealing the developer's publishing URL address for use elsewhere, or forging the developer's server to generate the publishing URL address, resulting in traffic loss, you can configure CDN publishing authentication by yourself through the ZEGOCLOUD Console. After authentication is enabled, relevant authentication parameters need to be spliced into the publishing URL address, otherwise publishing will fail. | - |
| Playing Stream by URL | When the publishing end uses third-party publishing tools (such as OBS software, network camera IP Camera, etc.) to publish streams to CDN, or pushes audio and video footage to third-party CDNs through using ZEGO SDK's relay to CDN feature, you can use the method of directly passing in the URL address to play streams. | Obtaining third-party live streaming footage |
Advanced Features
| Advanced Feature | Feature Description | Business Scenario |
|---|---|---|
| Ultra-Low Latency Live Streaming | Focused on providing stable and reliable live streaming services. Compared with standard video live streaming products, audio and video latency is lower, synchronization is stronger, weak network resistance is better, bringing users a millisecond-level live streaming experience. |
|
| Single Stream Transcoding | Converts a single original stream into transcoded streams with different encoding formats and resolutions in the cloud. In live streaming and other scenarios, audiences can choose streams with different resolutions to watch based on access network quality, terminal devices, etc., to ensure smooth playback. | Live streaming scenarios |
Other Capabilities
Basic Features
| Basic Feature | Feature Description | Business Scenario |
|---|---|---|
| Media Player | Provides the ability to play audio and video media files, and supports pushing the audio and video data of the played media files. |
|
| Audio Effect Player | Provides an audio effect player and manages audio effects uniformly to achieve enhanced realism or set the atmosphere for playing short effect sounds. |
|
| Audio and Video Recording | During video calls, live streaming, and online teaching, users often need to record and save videos for other users to watch on demand. ZEGO provides a variety of recording solutions to meet recording needs in different scenarios. |
|
| Camera Zoom | By setting the camera's zoom multiplier through the SDK, the effect of enlarging distant objects during shooting can be achieved. | Outdoor live streaming |
Advanced Features
| Advanced Feature | Feature Description | Business Scenario |
|---|---|---|
| Playing Transparent Gift Effects | ZEGO Express SDK media player provides the function of playing MP4 materials with separated RGB and Alpha channels (MP4 materials after splicing RGB and Alpha), realizing the dynamic effect of playing transparent gifts, that is, when playing gift effects, it will not block the live room content, greatly improving user experience. |
|