Product Features
2024-02-05
Communication Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Audio/Video Call | Users join the same room and conduct audio/video calls. |
|
| Audio/Video Live Streaming | In the same room, including hosts and viewers, hosts can conduct audio/video live streaming, and viewers in the room can watch the live stream. |
|
| User Permission Control | Use Token to control user permissions, such as: specifying users can enter/leave rooms; specifying users to speak/mute; specifying users. | Video conference |
| Pre-call Detection | Before conducting audio/video calls or live streaming, detect devices such as cameras, microphones, and monitors to ensure normal operation of calls or live streaming. | Normal call function detection |
| Call Quality Monitoring | Detect the quality of audio/video, such as resolution, frame rate, bitrate, sampling rate, and other multi-indicator detection to ensure quality stability. | Bank account opening, remote authentication, and other scenarios with high requirements and limitations on audio/video quality |
| Network Speed Testing | Before users publish/play streams, detect uplink and downlink network speeds to determine what bitrate audio/video streams are suitable for publishing/playing in the current network environment. | Call scenarios, education scenarios, live streaming scenarios |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Live Streaming Co-hosting | Multiple hosts can appear in one room for same-screen co-hosting live streaming. |
|
| Multi-Source Capture | Provides flexible and easy-to-use audio/video capture source and channel management capabilities, reducing developers' development and maintenance costs. | Video conferences, online education |
| Publish Multiple Streams Simultaneously | One user can publish multiple audio/video streams, such as sharing the screen while sending the camera's video stream. | See the speaker's visuals while playing PPT in a video conference |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio/video content and transmitted through the streaming media channel to achieve precise synchronization of text data with audio/video content. |
|
| Traffic Control | ZEGO industry-leading technology. The SDK dynamically adjusts the video publishing stream bitrate, frame rate, resolution, and audio bitrate according to its own and the peer's current network environment status, automatically adapting to the current network environment and network fluctuations, thereby ensuring smooth video publishing. | All scenarios that require high-quality real-time audio/video services |
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is forwarded through the cloud's proxy server to communicate with RTC and L3 (ultra-low latency live streaming). | Hospitals, governments, companies internals, and other restricted network environments such as intranets |
| Geofencing | Limit audio/video and signaling data transmission to a certain region to meet regional data privacy security regulations, that is, limit access to audio/video services in a specific region. | Call scenarios |
| Audio/Video Stream Encryption | Encrypt the stream when publishing, and must have a decryption key consistent with the encryption key when playing the stream. | Scenarios that need to encrypt stream information to protect communication security |
| Game Voice | Imitate the real world, where people have different auditory experiences based on factors such as the direction and distance of sound, for example, the farther the distance, the smaller the sound. At the same time, you can group people who can receive the sound source, for example, in a room, discuss in groups, and different groups cannot hear each other's sounds. |
|
| Mass-Scale Range Audio and Video | ZEGO industry-leading technology. Automatically pulls remote audio/video within the listening range based on cloud user locations and provides spatial audio effects (default pulls the closest 12 streams). A single scenario supports 10,000 users to enable microphones and cameras simultaneously. | Virtual offices, virtual exhibitions, open virtual worlds, and other virtual scenarios |
| Real-time Multi-Person Status Synchronization | ZEGO industry-leading technology. Provides an orderly, high-frequency, low-latency, large-scale status synchronization service to help developers quickly implement real-time information synchronization capabilities such as player positions, actions, and images in virtual gameplay, while supporting 10,000 users online simultaneously in a single scenario. | Virtual offices, virtual exhibitions, virtual social networking, virtual KTV, and other metaverse scenarios, as well as general scenarios that require ultra-high frequency, low latency, and large-scale synchronization of information or control commands |
Room Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Room Connection Status Description | Determine the user's connection status in the room and the conversion process of each connection status. | - |
| Real-time Messages and Signaling | Real-time messaging mainly provides the function of sending and receiving pure text messages. You can send broadcast messages and bullet screen messages to other users in the same room, or send custom messages to specific users, and implement interactive functions such as likes, gifts, and quizzes according to your needs. |
|
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Login to Multiple Rooms | One user can enter multiple rooms at the same time for audio/video calls or watch live streaming. | Teachers teaching multiple classes online |
Audio Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Audio Spectrum and Sound Level | Audio spectrum: The energy value of digital audio signals at various frequency points. Sound level: The volume level of a specific stream. |
|
| Headphone Monitoring and Channel Settings |
|
|
| Audio 3A Processing | During real-time audio/video calls or live streaming, 3A processing can be performed on audio to improve call or live streaming quality and user experience.
| All scenarios that require high-quality real-time audio/video services |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changers for humor, use reverb to enhance the atmosphere, and use stereo to make sound more three-dimensional. ZEGO Express SDK provides multiple preset voice changer, reverb, reverb echo, and stereo effects. Developers can flexibly set their desired sound. |
|
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Scenario-Based AI Noise Reduction | Real-time automatic recognition of different scenarios, intelligently adjusts AI noise reduction strategy to provide optimal noise reduction and audio quality effects. In call scenarios, all sounds except human voice are identified as noise and eliminated. In music scenarios, automatically adjusts noise reduction effect to restore music sound quality. | Voice chat rooms, conferences, voice gaming and other 1v1 or multi-person audio/video call scenarios, as well as live streaming or online KTV scenarios such as sound cards, singing accompaniment, and near-field music |
| Custom Audio Capture | Developers can obtain audio information themselves and hand it over to the SDK for transmission. |
|
| Custom Audio Rendering | Audio is rendered and played by the developer themselves. | Developers have special rendering requirements |
| Custom Audio Processing | Developers can perform special audio processing themselves. | When there are special sound processing requirements that the SDK cannot meet, such as special voice changing |
| Raw Audio Data Acquisition | Function to obtain raw audio recording. The obtained raw audio data format is PCM. | Audio data retention or special processing |
Video Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Common Video Configuration | During video calls or live streaming, customize settings related to capture and playback of video, such as video capture resolution, video encoding output resolution, video frame rate, bitrate, view mode, and mirror mode. |
|
| Screen Sharing | Share screen content as video with other users in the room during video calls or interactive live streaming. |
|
| Watermark and Screenshot | Can add watermarks such as copyright logos to video visuals. | Video sharing with copyright, etc. |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Set Video Encoding Method | Can set video encoding and decoding in detail, including enabling layered video encoding, using hardware encoding and decoding, and setting encoding methods. | When there are special requirements for encoding and decoding |
| Custom Video Capture | Customize providing video input source to ZEGO Express SDK for video data, and ZEGO Express SDK performs encoding and publishing. |
|
| Custom Video Rendering | Custom video rendering means the SDK provides local preview and remote pulling video frame data to the outside for users to render themselves. |
|
| Subject Segmentation | ZEGO industry-leading technology. At the publishing end, separates the subject (usually a person) in the rectangular video through AI algorithm and transmits it in the RTC network, and renders it at the pulling end. | Multi-person remote co-hosting, showcase live streaming co-hosting PK, multi-person online study, and other multi-person co-hosting scenarios |
| Video Large/Small Streams and Layered Encoding | Divides streams into base layer and enhancement layer, providing better experience for users with different network states and device performance. | Video calls |
| Publishing Stream Video Enhancement | ZEGO Express SDK provides various video pre-processing enhancement capabilities. Developers can adjust the visual effects on the publishing side according to business needs.
|
|
Live Streaming Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Stream Mixing | Mixes multiple video streams from multiple users into one stream, so you only need to pull one stream to see all members' visuals in the room and hear all members' voices. | Multi-person call host co-hosting |
| Using CDN Live Streaming | Unifies access to multiple CDN capabilities. This feature supports publishing to CDN, connecting RTC products and CDN live streaming products, making it convenient for users to watch live content directly from web pages or third-party players. | High-concurrency basic live streaming, scenarios without strong requirements for live streaming latency |
| CDN Stream Publishing Authentication | To prevent attackers from stealing the developer's publishing URL address for use elsewhere, or forging the developer's server to generate publishing URL addresses, thereby causing traffic loss, you can configure CDN stream publishing authentication through the ZEGO Console. When authentication is enabled, relevant authentication parameters must be appended to the publishing URL address, otherwise publishing cannot be performed. | - |
| Playing Stream by URL | When the publishing end uses third-party publishing tools (such as OBS software, network camera IP Camera, etc.) to push streams to CDN, or uses the ZEGO SDK to forward CDN function to push audio/video content to third-party CDN, you can use the method of directly passing the URL address to pull streams. | Third-party live streaming content acquisition |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Ultra-Low Latency Live Streaming | Focuses on providing stable and reliable live streaming services. Compared to standard video live streaming products, it has lower audio/video latency, stronger synchronization, better weak network resistance, bringing users millisecond-level live streaming experience. |
|
| Single Stream Transcoding | Converts a single original stream into transcoded streams with different encoding formats and resolutions in the cloud. In live streaming and other scenarios, audiences can choose streams with different resolutions for viewing based on access network quality, terminal devices, etc., to ensure playback smoothness. | Live streaming scenarios |
Other Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Media Player | Provides the ability to play audio/video media files and supports pushing the audio/video data of played media files. |
|
| Audio Effect Player | Provides an audio effect player and manages audio effects uniformly, achieving playback control effects such as enhancing realism or setting the scene atmosphere by playing short sound effects. |
|
| Audio/Video Recording | During video calls, live streaming, or online teaching, users often need to record and save videos for subsequent on-demand viewing by other users. ZEGO provides multiple recording solutions to meet recording needs in different scenarios. |
|
| Camera Zoom | By setting the camera zoom factor through the SDK, you can achieve the effect of zooming in on distant objects during shooting. | Outdoor live streaming |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Play Transparent Gift Effects | ZEGO Express SDK media player provides the function of playing MP4 materials (MP4 materials after splicing RGB and Alpha) by separating RGB channel and Alpha channel, achieving the dynamic effect of playing transparent gifts, that is, when playing gift effects, it will not block the live streaming room content, greatly improving user experience. |
|