Product Features
Live Streaming Capabilities
Basic Features
| Basic Features | Feature Description | Use Cases |
|---|---|---|
| RTMP Push Stream to ZEGO Server | In live streaming scenarios, hosts can push audio and video streams to ZEGO servers via RTMP push streaming tools to achieve low latency. | Live streaming scenarios. |
| Stream Mixing | Mix multiple video streams from multiple users into a single stream, so you only need to pull one stream to see all room members' screens and hear all room members' audio. | Multi-person call host co-hosting. |
Advanced Features
| Advanced Features | Feature Description | Use Cases |
|---|---|---|
| Single Stream Transcoding | Convert a single original stream into transcoded streams with different encoding formats and resolutions in the cloud. In live streaming and other scenarios, audiences can choose streams with different resolutions to watch based on network quality and device performance to ensure smooth playback. | Live streaming scenarios. |
Communication Capabilities
Basic Features
| Basic Features | Feature Description | Use Cases |
|---|---|---|
| User Permission Control | Use Token to control user permissions, such as: specifying users can enter/leave rooms; specifying users to speak/mute; specifying users. | Video conferences. |
| Call Quality Monitoring | Monitor audio and video quality, such as resolution, frame rate, bitrate, sample rate, and other multi-metric detection to ensure stable quality. | Bank account opening, remote authentication, and other scenarios with high requirements and limitations on audio and video quality. |
| Network Speed Test | Before users publish/play streams, detect uplink and downlink network speeds to determine what bitrate audio and video streams are suitable for publishing/playing in the current network environment. | Call scenarios, education scenarios, live streaming scenarios. |
| Device Detection | To ensure real-time communication experience, device detection can be performed before calls or live streaming to identify and troubleshoot problems in advance. Device detection mainly checks whether local microphones, cameras, and speakers work normally. | Call scenarios, education scenarios, live streaming scenarios. |
Advanced Features
| Advanced Features | Feature Description | Use Cases |
|---|---|---|
| Live Co-hosting | Multiple hosts can appear in the same room for on-screen co-hosting live streaming. |
|
| Multi-source Capture | Provide flexible and easy-to-use audio and video capture source and channel management capabilities, reducing developers' development and maintenance costs. | Video conferences, online education |
| Push Multiple Streams | One user can publish multiple audio and video streams, such as sharing screen while sending camera video stream. | Seeing the speaker's image while playing PPT in video conferences. |
| Supplemental Enhancement Information (SEI) | Text information is packaged with audio and video content and transmitted through streaming media channels to achieve precise synchronization between text data and audio and video content. |
|
| Cloud Proxy | By setting the SDK's cloud proxy interface, all traffic corresponding to the SDK is relayed through the cloud proxy server to communicate with RTC and L3 (Ultra-low Latency Live Streaming). | Hospitals, government, companies internal, and other restricted network environments such as intranets. |
| Audio and Video Stream Encryption | Encrypt streams when publishing, and must have decryption key consistent with encryption key when playing. | Scenarios that need to encrypt stream information to protect communication security. |
| Game Audio | Mimic the real world, people have different auditory experiences based on factors such as the direction and distance of sound, such as the farther the distance, the smaller the sound. At the same time, people who can receive the sound source can be grouped and limited, such as in a room, group discussion, different groups cannot hear each other's sounds. |
|
Room Capabilities
Basic Features
| Basic Features | Feature Description | Use Cases |
|---|---|---|
| Room Connection Status Description | Determine the user's connection status in the room and the transition process of each connection status. | - |
| Real-time Messaging and Signaling | Real-time messages mainly provide the ability to send and receive pure text messages. You can send broadcast and barrage messages to other users in the same room, or send custom messages to specified users, and implement interactive functions such as likes, gifts, and quizzes as needed. |
|
Advanced Features
| Advanced Features | Feature Description | Use Cases |
|---|---|---|
| Multi-room Login | One user can simultaneously enter multiple rooms for audio and video calls or watch live streaming. | Teacher multi-class online teaching. |
Audio Capabilities
Basic Features
| Basic Features | Feature Description | Use Cases |
|---|---|---|
| Sound Level Spectrum | Audio spectrum: the energy value of digital audio signals at each frequency point. Volume change: the volume of a certain stream. |
|
| Headphone Monitor | Headphone capture monitoring. After inserting headphones (ordinary headphones or Bluetooth headphones) on the device, you can hear the sound collected by the device's microphone from the local headphone side. |
|
| Audio 3A Processing | During real-time audio and video calls or live streaming, the audio can be processed with 3A to improve call or live streaming quality and user experience.
| All scenarios that hope to have high-quality real-time audio and video services. |
| Voice Changer/Reverb/Stereo | To increase fun and interactivity, users can use voice changer to be funny, use reverb to set the atmosphere, and use stereo to make sound more three-dimensional. ZEGO Express SDK provides a variety of preset voice changer, reverb, reverb echo, and stereo effects. Developers can flexibly set the sound they want. |
|
Advanced Features
| Advanced Features | Feature Description | Use Cases |
|---|---|---|
| Scenario-based AI Noise Reduction | Real-time automatic identification of different scenarios, intelligently adjust AI noise reduction strategy to provide the best noise reduction and sound quality effects. In call scenarios, all sounds except human voice are identified as noise and eliminated. In music scenarios, automatically adjust noise reduction effect to restore music sound quality. | Voice rooms, conferences, voice team-up and other 1v1 or multi-person audio and video call scenarios, as well as live streaming or online KTV scenarios such as sound cards, impromptu singing, and near-field music. |
| Custom Audio Capture | Developers can obtain audio information themselves and then hand it over to Zego Express SDK for transmission. |
|
| Custom Audio Rendering | Audio is played after being rendered by the developer themselves. | Developers have their own special rendering requirements. |
| Custom Audio Processing | Developers can perform special audio processing themselves. | When there are special sound processing requirements that Zego Express SDK cannot meet, such as special voice changing. |
| AI Voice Changer | The "Conan Voice Changer Bowtie" in real-time calls, perfectly reproduces the target character's timbre and rhythm, while retaining the user's speech rate, emotion, and tone, switching timbres at will, with ultra-low latency. |
|
Video Capabilities
Basic Features
| Basic Features | Feature Description | Use Cases |
|---|---|---|
| Common Video Configuration | During live streaming, customize video-related settings for capture and playback, such as video capture resolution, video encoding output resolution, video frame rate, video bitrate, view mode, and mirror mode. | Scenarios with special requirements for resolution, bitrate, mirror, etc. |
| Screen Sharing | Share screen content with other users in the room as video during video calls or interactive live streaming. |
|
| Watermark and Screenshot | Add watermarks such as copyright logos to the video screen. | Video sharing with copyright, etc. |
Advanced Features
| Advanced Features | Feature Description | Use Cases |
|---|---|---|
| Set Video Encoding | Detailed settings for video encoding and decoding, including enabling layered video coding, using hardware encoding and decoding, and setting encoding modes. | When there are special requirements for encoding and decoding. |
| Custom Video Capture | Customize the video input source provided to Zego Express SDK to input video data, and encode and publish streams by Zego Express SDK. |
|
| Custom Video Rendering | Custom video rendering refers to Zego Express SDK providing local preview and remote playing stream video frame data to users for their own rendering. |
|
| Custom Video Preprocessing | Developers perform custom preprocessing on video data themselves. | Beauty operations, adding accessories, etc. |
| Object Segmentation | ZEGO industry-leading technology. At the publishing end, the subject (mostly human) in the rectangular video is separated by AI algorithm and transmitted in the RTC network, and rendered at the playing end. | Multi-person remote co-stage, showroom live streaming co-stage PK, multi-person online study, and other multi-person co-stage scenarios. |
| H.265 | Through the more advanced H.265 encoding technology, provide higher clarity at the same bitrate. | Poor network environment requires higher audio and video calls, and live streaming experience is sensitive to bandwidth. |
| Video Small/Large Stream and Layered Coding | Divide the stream into a base layer and an enhancement layer, which can provide better experience for users with different network states and device performance. | Video calls. |
| Publish Video Enhancement | ZEGO Express SDK provides a variety of video pre-processing enhancement capabilities. Developers can adjust the effect of the screen at the publishing end according to business needs.
|
|
Other Capabilities
Basic Features
| Basic Features | Feature Description | Use Cases |
|---|---|---|
| Media Player | Provide the ability to play audio and video media files, and support pushing the audio and video data of played media files. |
|
| Audio Effect Player | Provide an audio effect player, uniformly manage audio effects, and implement playback/control of short effect sounds that enhance realism or set off scene atmosphere. |
|
| Local Media Recording | Local media recording component provides the ability to record media locally, storing audio and video data during live streaming to local files. | Conference recording, live streaming recording. |
Advanced Features
| Advanced Features | Feature Description | Use Cases |
|---|---|---|
| Play Transparent Gift Effects | ZEGO Express SDK media player provides the function to separately play MP4 materials with RGB channel and Alpha channel (MP4 materials after splicing RGB and Alpha), realizing the dynamic effect of playing transparent gifts, that is, when playing gift effects, it will not block live streaming room content, greatly improving user experience. |
|