Content Filtering

Last updated: 2020-09-27 14:58:42

    Feature Overview

    Content filtering uses natural language processing (NLP) technologies to determine whether user profiles, group profiles, one-to-one chat text messages, and group chat text messages in the IM system comply with regulations. This ensures automatic and intelligent message review, significantly reduces labor costs for content review, and enhances the product experience.

    Note:

    Currently, content filtering does not support passed-through custom messages.

    Content Filtering – Basic Edition

    The Content Filtering Basic feature only provides the default dictionary and you cannot add custom dictionary. To use the custom sensitive word feature, you can click Upgrade on the IM Console.

    Content Filtering - Professional Edition

    The Content Filtering Pro service provides sensitive word customization, query, and other features.

    How to enable

    1. Log in to the IM console, click a target application card, and click Content Filtering in the left sidebar.
    2. Click Upgrade to go to the purchase page.
    3. Select Enable content filtering and complete payment.

    Sensitive word customization

    After the Content Filtering Pro service is enabled, you can customize sensitive words by selecting Content Filtering -> Custom List in the IM console.

    Click Add Sample, enter keywords, select tags, and click Submit.

    Note:

    A maximum of 50 custom sensitive words can be added at a time. The total number of sensitive words cannot exceed 3,000, and a single sensitive word cannot exceed 10 characters in length.

    Tags for custom sensitive words include general, political, pornographic, violence and terrorism, abuse, drug-related, and ads.

    Sensitive word query

    After the Content Filtering Pro service is enabled, you can click the target application card in the IM console, select Content Filtering in the left sidebar, and click Details to query sensitive words.

    You can query content filtering details for sensitive words with certain tags within the past 7, 14, or 30 days. The content filtering details include the filtered content, keywords, review results, review identifiers, and review time.

    Custom Message Filtering

    To provide custom message filtering, IM needs to use a third-party content filtering service.

    The following figure shows the detailed process of custom message filtering. First, the IM SDK sends a message to the IM backend. The IM backend then calls a callback (Invoke a Callback Before Sending One-to-One Messages or Invoke a Callback Before Delivering Group Messages) before sending the message to the third-party content filtering service. Second, the business backend copies the content of the message to the third-party content filtering service. After the third-party content filtering service returns the content filtering result, the business backend forwards the result to the IM backend. Lastly, the IM backend determines whether to deliver the message.

    Image, Short Video, and Voice Filtering

    To provide image, short video, and voice filtering, IM needs to use a third-party content filtering service.

    The following figure shows the detailed process for image, short video, and voice filtering. First, the IM SDK sends a message to the IM backend. The IM backend then calls a callback (Invoke a Callback Before Sending One-to-One Messages or Invoke a Callback Before Delivering Group Messages) before sending the message to the third-party content filtering service. Second, the business backend copies the content of the message to the third-party content filtering service. After the third-party content filtering service returns the content filtering result, the business backend forwards the result to the IM backend. Lastly, the IM backend determines whether to recall the one-to-one chat message or group chat message.

    Was this page helpful?

    Was this page helpful?

    • Not at all
    • Not very helpful
    • Somewhat helpful
    • Very helpful
    • Extremely helpful
    Send Feedback
    Help