Product Features
2024-02-05
Communication Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Audio and Video Call | Users join the same room and conduct audio and video calls. |
|
| Audio and Video Live Streaming | In the same room, including hosts and audience, hosts can conduct audio and video live streaming, and audience in the room can watch the live stream. |
|
| User Permission Control | Use Token to control user permissions, such as: specified users can join/leave room; specified users speak/mute; specified users. | Video Conference |
| Pre-call Detection | Before conducting audio and video calls or live streaming, detect devices such as cameras, microphones, monitors, etc. to ensure the normal operation of calls or live streaming. | Normal call function detection |
| Call Quality Monitoring | Detect the quality of audio and video, such as resolution, frame rate, bitrate, sample rate, and other multi-indicator detection to ensure quality stability. | Bank account opening, remote authentication, and other scenarios with high and limited requirements for audio and video quality |
| Network Speed Test | Can detect uplink and downlink network speeds before users publish/play stream to determine the bitrate of audio and video streams suitable for publishing/playing under current network environment. | Call scenarios, education scenarios, live streaming scenarios |
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Live Streaming Co-hosting | Multiple hosts can appear in one room for on-screen co-hosting live streaming. |
|
| Multi-source Capture | Provide flexible and easy-to-use audio and video capture sources and channel management capabilities, reducing development and maintenance costs for developers. | Video Conference, Online Education |
| Publish Multiple Streams Simultaneously | One user can publish multiple audio and video streams, such as sharing the screen while sending the camera's video stream. | See the speaker's screen while playing PPT in a video conference |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio and video content and transmitted through the streaming channel to achieve precise synchronization between text data and audio and video content. |
|
| Flow Control | ZEGO industry-leading technology. The SDK dynamically adjusts video publishing bitrate, frame rate, resolution, and audio bitrate based on its own and the remote end's current network environment status, automatically adapting to current network environment and fluctuations, thereby ensuring smooth video publishing. | All scenarios that require high-quality real-time audio and video services |
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is forwarded through the cloud proxy server to communicate with RTC and L3 (ultra-low latency live streaming). | Hospitals, government, company internals, and other restricted network environments such as intranets |
| Game Voice | Imitate the real world, people have different auditory experiences based on factors such as the direction and distance of the sound, for example, the farther the distance, the smaller the sound, etc. At the same time, people who can receive the sound source can be grouped and limited, for example, in a room, grouped discussions, different groups cannot hear each other's sounds, etc. |
|
| Mass-scale Range Audio and Video | ZEGO industry-leading technology. Automatically pull remote audio and video within the listening range based on user locations in the cloud and provide spatial audio effects (default pulls the closest 12 streams). Supports 10,000 users simultaneously enabling microphones and cameras in a single scene. | Virtual offices, virtual exhibitions, open virtual worlds, and other virtual scenarios |
| Multi-user Status Real-time Sync | ZEGO industry-leading technology. Provides ordered, high-frequency, low-latency, large-scale status synchronization services to help developers quickly implement real-time information synchronization capabilities such as player positions, actions, and images in virtual gameplay. At the same time, it supports 10,000 users online simultaneously in a single scene. | Virtual offices, virtual exhibitions, virtual social networking, virtual KTV, and other metaverse scenarios, as well as general scenarios that require ultra-high frequency, low latency, and large-scale synchronization of information or control commands |
Room Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Room Connection Status Description | Determine the user's connection status in the room and the conversion process of each connection status. | - |
| Real-time Message and Signaling | Real-time messages mainly provide the function of sending and receiving pure text messages. They can send broadcast messages and barrage messages to other users in the same room, or send custom messages to certain specified users, and can implement interactive functions such as likes, gift giving, and quizzes as needed. |
|
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Login to Multiple Rooms | One user can enter multiple rooms at the same time for audio and video calls or watch live streaming. | Teacher multi-class online teaching |
Audio Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Audio Spectrum and Volume Change | Audio spectrum: the energy value of digital audio signals at each frequency point. Volume change: the volume level of a certain stream. |
|
| Headphone Monitor and Channel Setting |
|
|
| Audio 3A Processing | In real-time audio and video calls or live streaming, audio can be processed with 3A to improve the quality of calls or live streaming and user experience.
| All scenarios that require high-quality real-time audio and video services |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changers to be funny, use reverb to enhance the atmosphere, and use stereo to make the sound more three-dimensional. ZEGO Express SDK provides a variety of preset voice changer, reverb, reverb echo, and stereo effects. Developers can flexibly set the sound they want. |
|
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Custom Audio Capture | Developers can obtain audio information by themselves and then hand it over to the SDK for transmission. |
|
| Get the Raw Audio Data | The function of getting raw audio recording, the obtained raw audio data format is PCM. | Audio data retention or special processing |
Video Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Common Video Configurations | In video calls or live streaming, customize and set related configurations for captured and played video, such as video capture resolution, video encoding output resolution, video frame rate, bitrate, view mode, mirror mode, etc. |
|
| Video Screen Rotation | When users use mobile devices for live streaming or video calls, they can use different video capture directions and adapt and adjust according to the angle of the remote user's camera direction. | Video calls and live streaming scenarios with multiple types of devices, scenarios requiring the best video playback angle |
| Screen Sharing | Share screen content with other users in the room as video during video calls or interactive live streaming. |
|
| Watermark and Screenshot | Can add watermarks such as copyright logos to the video screen. | Video sharing with copyright, etc. |
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Set Video Encoding Method | Can set video encoding and decoding in detail, including enabling layered video encoding, using hardware encoding and decoding, and setting encoding methods, etc. | When there are special requirements for encoding and decoding |
| Custom Video Capture | Customize providing video input sources to ZEGO Express SDK to input video data, and encode and publish stream by ZEGO Express SDK. |
|
| Custom Video Pre-processing | Developers perform custom pre-processing on video data by themselves. | AI Effects, adding accessories, etc. |
| Video Small and Large Stream and Layered Encoding | Divide the bitstream into a base layer and an enhancement layer, providing better experience for users with different network statuses and device performances. | Video Call |
| Publish Video Enhancement | ZEGO Express SDK provides various video pre-processing enhancement capabilities. Developers can adjust the screen effects at the publishing end according to business needs.
|
|
Live Streaming Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Stream Mixing | Mix multiple people's multiple video streams into one stream, so you only need to pull one stream to see the screens of all members in the room and hear the sounds of all members in the room. | Multi-person call host co-hosting |
| Use CDN for Live Streaming | Unify access to multiple CDN capabilities. This function supports publishing stream to CDN, connecting RTC products and CDN live streaming products, making it convenient for users to directly watch live streaming content from web pages or third-party players. | Basic live streaming with high concurrency, scenarios without strong requirements for live streaming latency |
| CDN Stream Publishing Authentication | To prevent attackers from stealing the developer's publishing URL address to publish stream elsewhere, or forging the developer's server to generate the publishing URL address, resulting in traffic loss, you can configure CDN stream publishing authentication through ZEGOCLOUD Console. When authentication is enabled, relevant authentication parameters need to be spliced into the publishing URL address, otherwise stream cannot be published. | - |
| Playing Stream by URL | When the publishing end uses third-party publishing tools (such as OBS software, network camera IP Camera, etc.) to publish the stream to CDN, or uses ZEGO SDK to relay CDN function to push the audio and video screen to a third-party CDN, you can use the method of directly passing in the URL address to play stream. | Third-party live streaming screen acquisition |
Other Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Media Player | Provides the ability to play audio and video media files and supports pushing the audio and video data of played media files. |
|
| Audio Effect Player | Provides an audio effect player and performs unified management of audio effects to achieve effects such as enhancing realism or setting the atmosphere for playing short effect sounds. |
|
| Audio and Video Recording | When conducting video calls, live streaming, or online teaching, users often need to record and save videos for other users to watch on demand later. ZEGO provides multiple recording solutions to meet recording needs in different scenarios. |
|
| Camera Zoom | Set the camera's zoom multiplier through the SDK to achieve the effect of enlarging distant objects when shooting. | Outdoor Live Streaming |