ROI (region of interest) recognition can identify the positions of important visual elements in a video in real time, such as faces, game characters, or streaming hosts, and send this information along with the video to the playback device. Using the ROI information, the player can do things like blur the background in a scene and prevent on-screen comments from covering important elements of the video. This document explains how to create, modify, and delete ROI recognition templates in the console.
Notes
A template takes effect about 5-10 minutes after it is created.
To use the ROI recognition feature, you need to add the parameter roirecognition= ROI configuration name to your streaming URL. This lets the player access and process ROI data from the live stream, which can enable features like background blur and preventing on-screen comments from covering important parts of the video. For detailed instructions, see ROI Intelligent Recognition Feature Practice. Example streaming URL:
rtmp://domain/AppName/StreamName?
txSecret=Md5(key+StreamName+hex(time))&txTime=hex(time)&roirecognition=Template Name
The ROI recognition feature is a paid value-added service. Using this feature incurs live transcoding fees and Media Processing Service (MPS) intelligent content recognition fees. For specific billing rules, refer to the billing documentation.
Prerequisites
You have activated Tencent Cloud Streaming Services.
Creating an ROI Configuration Template
1. Log in to the CSS Console and navigate to AI Features >ROI Intelligent Recognition.
Note:
To use the ROI intelligent recognition feature in the Live Streaming Lab, the first time you create a template, you will also need to create a service role and authorize the current account to use MPS. Click Authorize Now to enter the CAM for authorization.
2. Click Authorize Now to enter the CAM role management page.
3. On the role management page, click Grant to complete the identity verification and finalize the Media Processing Service authorization, enabling normal use of the Media Processing Service.
4. After successful authorization, check the service agreement and click Start, and the system will automatically activate the MPS product and open the Intelligent Streaming Media Processing management page.
5. Enter the ROI Intelligent Recognition management page, and click Create ROI template.
6. Enter the ROI configuration page and proceed with the following configuration:
Configuration Item
Description
Name
The default prefix "roi" is added to the template name. The template name can be 1-10 characters long (only combinations of letters and digits are supported).
Description
Supports only Chinese, English, digits, spaces, underscores (_), hyphens (-) and can be up to 100 characters long.
Training Model
Default is General. Supported training models include: Honor of Kings, NBA2K Game, and Live Shows.
General: Capable of recognizing common areas of human eye focus in different environments.
Honor of Kings: Capable of recognizing hero roles and zones in different environments within the Honor of Kings game.
NBA2K Game: Capable of recognizing players, basketballs, scoreboards, and other zones in different environments within the NBA2K game.
Live Shows: Capable of recognizing the host's face.
Note:
The system can identify elements such as faces and game characters within the video. Selecting an appropriate training model for the scenario can greatly improve the accuracy of ROI intelligent recognition. If the models provided do not meet the needs of your specific scenario, you can submit a ticket to request a model.
7. After filling in the configuration items, click Confirm to complete.
Modifying a Template
1. Log in to the CSS Console and navigate to AI Features >ROI Intelligent Recognition.
2. Select your successfully created ROI configuration template, and click Edit on the right to modify the template information.
3. Click Confirm to complete.
Deleting a Template
1. Log in to the CSS Console and navigate to AI Features > ROI Intelligent Recognition.
2. Select your successfully created ROI configuration template, and click Delete to the right.
3. Click OK to confirm that you want to delete the template.
