The Review Feeds tab allows you to tie in human-in-the-loop moderation alongside your automated moderation flow. You can leverage your team of human moderators to manually review users and posts to ensure the highest level of accuracy.

There are two ways you can send users and posts to the Review Feed. To automatically flag for review, you can customize your review thresholds and create rules to send users and posts to the Review Feed (refer to Rules). To manually flag a user or post, you can click the flag icon on the User/Content Feeds and provide a reason for the flag.

Review Feed Types

There are three main review feed types:

1. Post: For reviewing content posted on your platform.
2. User: For reviewing users on your platform.
3. CSAM: For reviewing tasks flagged as CSAM by Thorn. This tab is split into two sub-feeds: 1) CSAM Flagged By Thorn (Hash) and 2) CSAM Flagged By Thorn (Classify).
   1. Note: This review feed can only be enabled for CSAM Detection API customers.

📘

Review Feed Task Limit

All post review feeds have a shared 10K task limit. Similarly, all user feeds have a shared 10K task limit. After the 10K limit has reached, we will prioritize newer review tasks by replacing older tasks in the queue with newer review tasks.

By default, we provide two sub-review feeds (or filters) for the Posts and Users Review Feeds:

1. Flagged Posts/Users: All non-reported tasks.
2. Reported Posts/Users: All reported tasks.

Although these default feed filters can not be edited or deleted, you can create additional filtered feeds, which are sub-review feeds within the overall Post and User feeds that you can organize specific types of tasks into.

Create Custom Filtered Feeds

To create a filtered feed, click the “Create Filter” button at the top right of the screen. The following window will pop up:

For each new filtered feed, you will specify the following information in the General tab:

• Filter Name: Name of the filtered feed.
• Moderation Categories: Tasks designated for review matching at least one of these categories will show up in your filtered feed.
• Report Categories: Select whether you want reported tasks, no reported tasks, or both reported and not reported tasks to show up in your filtered feed. If you would like reported tasks to enter this filtered feed, configure which report categories apply.
• Moderation Rules: Tasks designated for review that trigger the selected rules will show up in this filtered feed.
• Content Variant: Select which content variant enters this filtered feed. This differentiates different types of content published on your platform.

These essentially “filter” your tasks from the larger task pool. If any task matches at least one of the filters above, the task will enter that feed.

🚧

A post or user can enter multiple review feeds

A post or user review task can enter multiple review feeds if it matches the filters in more than one feed filter configuration. However, the task can only be assigned to one moderator at a time. The moment a review task is assigned to a moderator for review, it will be removed from all review feeds.

You can configure additional settings on the other tabs, such as:

1. Moderation Preferences:

   1. Number of Tasks per Review: Number of tasks that a moderator can check out in the filter at once.
   2. Sort Tasks: Choose how tasks are sorted.
   3. Review Feed Task Expiry Time (minutes): Configure expiry time for review tasks in this filter. After tasks are assigned to a moderator, they will have this set amount of minutes to submit for review. After time is up, the tasks will expire and will re-enter the review queue to be re-assigned to a moderator.

2. Policies: Only posts that trigger selected policies will be shown in this filtered feed.

3. Actions:

   1. Limit Review Actions to Target Posts Only: When turned on, posts that are not the main review task (e.g., related posts that provide surrounding context to the main task) can no longer be reviewed.
   2. Disable Multiple Actions on a Single Post: If turned on, only one action can be applied when reviewing tasks.
      1. Note: Applying or removing a user tag is considered to be an action.
   3. Default Assigned Actions: The default action that will trigger for target posts with no review selections made. The selected default action will be shown at the top of the content in grey.
   
   

4. Permissions: Indicate any permission groups that you wish to have access to this filtered feed.

Review Feed Settings

Within the filtered feed itself, you can click the top-right gear icon to configure its settings. There is only one setting to configure here: which action is taken when review tasks are booted from the queue.

Since the user and post queues have a default cap of 10K review tasks, after the 10K limit has reached, the Dashboard will prioritize newer review tasks by booting older tasks in the queue and replacing them with newer review tasks.

By default, there are no actions taken on the tasks that are booted from the queue. You can configure a default action that is triggered when review tasks are booted from the queue through Review Feed settings.

👍

Optimized for multiple human moderators

The Post and User Review Feeds are optimized for multi-moderator use at the same time. Tasks assigned to moderators will be unique for all moderators so that two moderators never have the same assigned tasks.

CSAM Feed

On the Settings page, you can enable the NCMEC Review Feed. This will display only content flagged by the CSAM Detection API (Thorn) as potential instances of CSAM content. Images flagged by Thorn will automatically be sent to the NCMEC Review Feed for Review.

CSAM Review Feeds are split into:

1. CSAM Flagged By Thorn (Hash): Content flagged by the Hash Matching model. This refers to known CSAM, which can be found in Thorn’s database.
2. CSAM Flagged by Thorn (Classify): Content flagged by the Classifier model. This refers to novel CSAM detected (i.e., the content did not match to anything in Thorn’s database, but was still detected as CSAM).

❗️

Displaying CSAM Content

Moderation Dashboard will never display CSAM content in the Review Feed. Instead, each task will surface a link that the moderator can click on. Once clicked, the media will open in a new browser tab for the moderator to review.

Sample Moderator Workflow

Post Review Feed

1. When a moderator first enters, they will have a set number of assigned tasks that need to be reviewed. At the top of the page, moderators can view how many other moderators are currently reviewing and view the total number of remaining tasks to help manage time.

2. Moderators can see why a post was flagged by viewing the flag reason at the top of the tile. A post can be flagged for review manually by a moderator, or automatically via rules. You can view more details on the flag reason by hovering the top of the tile.

3. After viewing all the posts, the moderator can mark only the problematic posts by selecting the tile. All actions on this page are populated from the actions that are configured for this review feed filter. All tiles that are not selected will be marked with the default action, if there is one. Otherwise, it will be marked as “No Action”.
4. Moderators can escalate posts from one feed to an escalation feed for review tasks that require a second opinion using the icon to the right of the information icon.

4. After reviewing, the moderator can click “Submit All Tasks” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the posts that were selected will be triggered and can be viewed in the Actions Log.

User Review Feed

1. When a moderator first enters, they will have a set number of assigned tasks that need to be reviewed.

2. Moderators see why a user was sent to the Review Feed by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the user rule that triggered the flag.

   1. You can view additional user information like user ID, last active date, start date, flagged post %, and the user's top moderation categories.
   
   

   

3. Each user review tile has the top three most relevant posts from that user to allow for the best judgement possible. The moderator can click into each of these posts to view more details on the post.

4. To get more insight on a specific user, the moderator can click into the User to view the user's post history. You can search and filter through the content table and select a review action for the user.

4. After viewing all the users, the moderator can mark only the problematic users by selecting the tile. All tiles that are not selected will be marked as “No Action”.

5. Moderators can escalate posts from one feed to another for review tasks that require a second opinion using the icon to the right of the information icon.

6. After reviewing, the moderator can click “Submit All Tasks” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the users that were selected will be triggered and can be viewed in the Actions Log.