Product Features
2024-02-05
Communication Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Audio/Video Call | Users join the same room and conduct audio/video calls. |
|
| Audio/Video Live Streaming | In the same room, including hosts and viewers, hosts can conduct audio/video live streaming, and viewers in the room can watch the live stream. |
|
| User Permission Control | Use Token to control user permissions, such as: specifying users can enter/leave rooms; specifying users to speak/mute; specifying users. | Video conference |
| Call Quality Monitoring | Monitor the quality of audio and video, such as resolution, frame rate, bitrate, sampling rate and other multi-indicator detection to ensure stable quality. | Bank account opening, remote authentication and other scenarios with high requirements and limitations on audio/video quality |
| Network Speed Testing | Before users publish/play streams, detect uplink and downlink network speeds to determine what bitrate of audio/video streams are suitable for publishing/playing in the current network environment. | Call scenarios, education scenarios, live streaming scenarios |
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Live Co-Hosting | Multiple hosts can appear in the same room for co-hosting live streaming on the same screen. |
|
| Multi-Source Capture | Provides flexible and easy-to-use audio/video capture source and channel management capabilities, reducing developers' development and maintenance costs. | Video conference, online education |
| Publishing Multiple Streams Simultaneously | A user can publish multiple audio/video streams, such as sharing the screen while sending the camera's video stream. | Play PPT during video conference while seeing the presenter's screen |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio/video content and transmitted through the streaming media channel to achieve precise synchronization between text data and audio/video content. |
|
| Traffic Control | ZEGO's industry-leading technology. The SDK dynamically adjusts video publishing bitrate, frame rate, and resolution, as well as audio bitrate based on its own and the peer's current network environment status, automatically adapting to the current network environment and network fluctuations, thereby ensuring smooth video publishing. | All scenarios that require high-quality real-time audio/video services |
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is forwarded through cloud proxy servers, achieving communication with RTC and L3 (ultra-low latency live streaming). | Hospitals, government, companies internal and other restrictive network environments such as intranets |
Room Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Room Connection Status Description | Determine the user's connection status in the room and the conversion process of each connection status. | - |
| Real-Time Messages and Signaling | Real-time messages mainly provide text message sending and receiving functions. You can send broadcast messages and barrage messages to other users in the same room, or send custom messages to specified users, and implement interactive functions such as likes, sending gifts, and answering questions as needed. |
|
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Login to Multiple Rooms | A user can enter multiple rooms at the same time for audio/video calls or watch live streaming. | Teacher multi-class online teaching |
Audio Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Audio Spectrum and Volume Change | Audio spectrum: energy value of digital audio signal at each frequency point. Volume change: the volume level of a stream. |
|
| Headphone Monitor and Channel Settings |
|
|
| Audio 3A Processing | During real-time audio/video calls or live streaming, 3A processing can be performed on audio to improve call or live streaming quality and user experience.
| All scenarios that require high-quality real-time audio/video services |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changers to be funny, use reverb to enhance the atmosphere, and use stereo to make sound more three-dimensional. ZEGO Express SDK provides a variety of preset voice changer, reverb, reverb echo, and stereo effects. Developers can flexibly set the sound they want. |
|
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Audio Mixing | The SDK obtains one audio data stream from the App, integrates the audio data provided by the App with the audio data captured by the SDK into one audio data stream, thereby achieving the ability to play custom sounds and music files during calls or live streaming, and letting others in the room hear them. |
|
| Scenario-Based AI Noise Reduction | Real-time automatic recognition of different scenarios, intelligently adjusting AI noise reduction strategies to provide the best noise reduction and sound quality effects. In call scenarios, all sounds except human voice are identified as noise and eliminated. In music scenarios, noise reduction effects are automatically adjusted to restore music sound quality. | Voice rooms, conferences, voice gaming and other 1v1 or multi-person audio/video call scenarios, as well as live streaming or online KTV scenarios for sound cards, impromptu singing, near-field music |
| Custom Audio Capture | Developers can obtain audio information themselves and hand it over to the SDK for transmission. |
|
| Custom Audio Rendering | Audio is rendered by developers themselves and then played. | Developers have their own special rendering requirements |
| Custom Audio Processing | Developers can perform special audio processing themselves. | When there are special sound processing requirements that the SDK cannot meet, such as special voice changing |
| Get the Raw Audio Data | Get the function of raw audio recording. The obtained raw audio data format is PCM. | Audio data retention or special processing |
Video Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Common Video Configuration | During video calls or live streaming, customize settings related to captured and played video, such as video capture resolution, video encoding output resolution, video frame rate, bitrate, view mode, and mirror mode, etc. |
|
| Set Video Attributes | Set video attributes as needed to adjust the clarity, smoothness, and mirroring of the video screen to achieve a better user experience. | Video call |
| Basic Beauty Effects | When in video calls or live streaming, if you want to present good skin condition to the other party, you can combine with AI Effects to implement basic beauty effects. |
|
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Set Video Encoding Method | Detailed settings for video encoding/decoding can be made, including enabling layered video encoding, using hardware encoding/decoding, and setting encoding methods, etc. | When there are special requirements for encoding/decoding |
| Custom Video Capture | Customize the provision of video input sources to ZEGO Express SDK to input video data, and ZEGO Express SDK performs encoding and publishing. |
|
| Custom Video Rendering | Custom video rendering refers to the SDK providing local preview and remote stream playing video frame data to the outside for users to render themselves. |
|
| Custom Video Pre-Processing | Developers perform custom pre-processing on video data themselves. | Beauty effects, adding accessories, etc. |
| H.265 | Through more advanced H.265 encoding technology, higher clarity can be provided at the same bitrate. | Video calls and live streaming require higher experience under poor network environments and are more sensitive to bandwidth |
| Small/Large Video Stream and Layered Encoding | Divide the bitstream into base layer and extension layer to provide a better experience for users with different network statuses and device performance. | Video call |
Live Streaming Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Use CDN for Live Streaming | Unified access to multiple CDN capabilities. This function supports publishing to CDN, connecting RTC products and CDN live streaming products, making it convenient for users to watch live content directly from web pages or third-party players. | Basic live streaming with high concurrency, scenarios without strong requirements for live streaming delay |
| CDN Stream Publishing Authentication | To prevent attackers from stealing the developer's publishing URL address for use elsewhere, or forging the developer's server to generate publishing URL addresses, resulting in traffic loss, you can configure CDN stream publishing authentication through the ZEGOCLOUD Console. When authentication is enabled, relevant authentication parameters need to be spliced into the publishing URL address, otherwise publishing will fail. | - |
| Play Stream by URL | When the publishing end uses third-party publishing tools (e.g., OBS software, network camera IP Camera, etc.) to publish streams to CDN, or uses ZEGO SDK to relay audio/video screens to third-party CDNs through the CDN relay function, you can use the method of directly passing in the URL address to play streams. | Third-party live streaming screen acquisition |
Advanced Functions
| Advanced Functions | Function Description | Business Scenarios |
|---|---|---|
| Ultra-Low Latency Live Streaming | Focus on providing stable and reliable live streaming services. Compared with standard video live streaming products, audio and video latency is lower, synchronization is stronger, weak network resistance is better, bringing users millisecond-level live streaming experience. |
|
| Direct to CDN | The process of pushing audio/video streams directly from the local client to CDN, allowing users to watch directly from web pages or third-party players by pulling the stream URL address. | Developers who have audio/video distribution service cooperation with third-party CDNs can use |
| Single Stream Transcoding | In the cloud, convert a single original stream into transcoded streams with different encoding formats and resolutions. In live streaming and other scenarios, viewers can choose streams with different resolutions to watch based on access network quality, terminal devices, etc., to ensure smooth playback. | Live streaming scenarios |
Other Capabilities
Basic Functions
| Basic Functions | Function Description | Business Scenarios |
|---|---|---|
| Media Player | Provides the ability to play audio/video media files and supports pushing the audio and video data of played media files out. |
|
| Sound Effect Player | Provides a sound effect player and performs unified management of sound effects, achieving effects such as enhancing realism or setting the atmosphere by playing brief sound effects. |
|
| Audio/Video Recording | During video calls, live streaming, and online teaching, users often need to record and save videos for other users to watch on demand. ZEGO provides multiple recording solutions to meet recording needs in different scenarios. |
|
| Camera Zoom | Set the camera zoom factor through the SDK to achieve the effect of enlarging distant objects when shooting. | Outdoor live streaming |