Product Features
Live Streaming Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| RTMP Push Stream to ZEGO Server | In live streaming scenarios, hosts can push audio and video streams to ZEGO servers through RTMP push streaming tools to achieve low latency effects. | Live streaming scenarios. |
| Stream Mixing | Mixes multiple video streams from multiple users into a single stream, so you only need to pull one stream to see all room members' screens and hear all room members' voices. | Multi-person call host co-hosting. |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Single Stream Transcoding | Converts a single original stream into transcoded streams with different encoding formats and resolutions in the cloud. In live streaming and other scenarios, viewers can choose streams of different resolutions to watch based on network quality, terminal devices, etc., to ensure playback smoothness. | Live streaming scenarios. |
Communication Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| User Permission Control | Uses Token to control user permissions, such as: specifying users to enter/leave rooms; specifying users to speak/mute; specifying users. | Video conferences. |
| Call Quality Monitoring | Detects audio and video quality, such as resolution, frame rate, bitrate, sampling rate, and other multi-indicator detection, ensuring stable quality. | Bank account opening, remote authentication, and other scenarios with high and specific requirements for audio and video quality. |
| Network Speed Testing | Can detect uplink and downlink network speeds before users perform publish/play streams, determining what bitrate audio and video streams are suitable for publish/play under current network conditions. | Call scenarios, education scenarios, live streaming scenarios. |
| Device Detection | To ensure real-time communication experience, device detection can be performed before calls or live streaming to identify and troubleshoot problems in advance. Device detection mainly detects whether the local microphone, camera, and speaker can work normally. | Call scenarios, education scenarios, live streaming scenarios. |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Live Co-hosting | Multiple hosts can appear in one room for on-screen co-hosting live streaming. |
|
| Multi-source Capture | Provides flexible and easy-to-use audio and video capture source and channel management capabilities, reducing developer development and maintenance costs. | Video conferences, online education. |
| Publish Multiple Streams | One user can publish multiple audio and video streams, such as sharing the screen while sending the camera's video stream. | In a video conference, playing PPT while seeing the speaker's picture. |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio and video content and transmitted through streaming media channels to achieve precise synchronization between text data and audio and video content. |
|
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is forwarded through cloud proxy servers to communicate with RTC and L3 (ultra-low latency live streaming). | Hospitals, governments, companies internal, and other restrictive network environments such as intranets. |
| Audio and Video Stream Encryption | Encrypts the stream when publishing, and playing streams must have a decryption key consistent with the encryption key. | Scenarios that need to encrypt stream information to protect communication security. |
| Game Voice | Mimics the real world, where people have different auditory experiences based on factors such as the direction and distance of sound. For example, the farther the distance, the smaller the sound. At the same time, you can group people who can receive the sound source. For example, in a room, group discussions can be held, and different groups cannot hear each other. |
|
Room Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Room Connection Status Description | Determines the user's connection status in the room and the transition process of each connection status. | - |
| Real-time Messaging and Signaling | Real-time messaging mainly provides the function of sending and receiving pure text messages. You can send broadcast messages and bullet screen messages to other users in the same room, or send custom messages to specific users, and implement interactive functions such as likes, gifts, and quizzes as needed. |
|
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Multi-room Login | One user can enter multiple rooms at the same time for audio and video calls or watching live streaming. | Teachers teaching multiple classes online. |
Audio Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Sound Level Spectrum | Audio spectrum: the energy value of digital audio signals at each frequency point. Volume level: the volume level of a specific stream. |
|
| Headphone Monitor | Headphone capture monitoring. After inserting headphones (ordinary headphones or Bluetooth headphones) on the device, you can hear the sound captured by the device's microphone from the local headphone side. |
|
| Audio 3A Processing | During real-time audio and video calls or live streaming, 3A processing can be performed on audio to improve call or live streaming quality and user experience.
| All scenarios that hope to have high-quality real-time audio and video services. |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changers to be funny, use reverb to enhance the atmosphere, and use stereo to make sound more stereo. ZEGO Express SDK provides a variety of preset voice changer, reverb, reverb echo, and stereo effects. Developers can flexibly set the sound they want. |
|
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Scenario-based AI Noise Reduction | Real-time automatic recognition of different scenarios, intelligently adjusting AI noise reduction strategies to provide the best noise reduction and sound quality effects.
| Voice rooms, meetings, voice game chat, and other 1v1 or multi-person audio and video call scenarios, as well as live streaming or online KTV scenarios such as sound cards, impromptu singing, and near-field music. |
| Custom Audio Capture | Developers can obtain audio information themselves and then hand it over to Zego Express SDK for transmission. |
|
| Custom Audio Rendering | Audio is rendered and played by the developer themselves. | Developers have their own special rendering requirements. |
| Custom Audio Processing | Developers can perform special audio processing themselves. | When there are special sound processing requirements that Zego Express SDK cannot meet, such as special voice changers. |
| AI Voice Changer | The "Conan Voice Changer Bowtie" in real-time calls, perfectly reproduces the target character's timbre and rhythm, while retaining the user's speech rate, emotion, and tone. Switch timbres at will with ultra-low latency. |
|
Video Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Common Video Configuration | During live streaming, customize and set video-related configurations for capture and playback, such as video capture resolution, video encoding output resolution, video frame rate, video bitrate, view mode, and mirror mode. | Scenarios with special requirements for resolution, bitrate, mirroring, etc. |
| Video Capture Rotation | When users use mobile devices for live streaming, they can use different video capture directions and can adapt and adjust based on the peer user's camera direction and angle. | Live streaming scenarios with multiple device types, or scenarios requiring the best video playback angle. |
| Screen Sharing | Shares screen content with other users in the room as video during video calls or interactive live streaming. |
|
| Watermark and Screenshot | Can add watermarks such as copyright logos to the video screen. | Video sharing with copyright, etc. |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Set Video Encoding | Can set video encoding and decoding in detail, including enabling layered video encoding, using hardware encoding and decoding, and setting encoding methods. | When there are special requirements for encoding and decoding. |
| Custom Video Capture | Customizing the provision of video input sources to Zego Express SDK to input video data, which is then encoded and published by Zego Express SDK. |
|
| Custom Video Rendering | Custom video rendering means Zego Express SDK provides video frame data for local preview and remote play streams to the outside for users to render themselves. |
|
| Custom Video Preprocessing | Developers perform custom preprocessing on video data themselves. | Beauty effects, adding accessories, etc. |
| Super Resolution | Doubles the width and height of the played video stream screen at the play stream end. For example: the original screen resolution pulled by the play stream end is 640p x 360p, after super-resolution processing, the resolution will be increased to 1280p x 720p. | 1V1 video call scenarios, live streaming scenarios, online education. |
| Object Segmentation | ZEGO industry-leading technology. At the publish stream end, the subject (mostly a person) in the rectangular video is separated through AI algorithms and transmitted in the RTC network, and rendered at the play stream end. | Multi-person remote on-stage, showroom live streaming on-stage PK, multi-person online study, and other multi-person on-stage scenarios. |
| H.265 | Through the more advanced H.265 encoding technology, provides higher clarity at the same bitrate. | Higher audio and video call and live streaming experience is required in poor network environments and is more sensitive to bandwidth. |
| Video Small/Large Stream and Layered Encoding | Divides the stream into a base layer and an enhancement layer, providing better experience for users with different network states and device performance. | Video calls. |
| Publish Video Enhancement | ZEGO Express SDK provides a variety of video pre-processing enhancement capabilities. Developers can adjust the picture effects at the publish stream end according to business needs.
|
|
Other Capabilities
Basic Features
| Basic Features | Feature Description | Business Scenarios |
|---|---|---|
| Media Player | Provides the ability to play audio and video media files, and supports pushing the audio and video data of played media files. |
|
| Audio Effect Player | Provides an audio effect player and manages audio effects uniformly, implementing playback/control and other functions for short effect sounds that enhance realism or enhance scene atmosphere. |
|
| Audio and Video Recording | The local media recording component provides local media recording capabilities, recording and storing audio and video data during live streaming to local files. | Conference recording, live streaming recording. |
Advanced Features
| Advanced Features | Feature Description | Business Scenarios |
|---|---|---|
| Play Transparent Gift Effects | ZEGO Express SDK media player provides the function of playing MP4 materials with separated RGB channel and Alpha channel (MP4 materials after splicing RGB and Alpha), realizing the dynamic effect of playing transparent gifts, that is, when playing gift effects, it does not block live streaming room content, greatly improving user experience. |
|