Integrate Human in the Loop Moderation

The Review Feed allows for easy and effective human-in-the-loop moderation alongside your automated moderation flow. You can leverage your team of human moderators to manually review users and posts to ensure the highest level of accuracy.

There are two ways you can send users and posts to the Review Feed. To automatically flag for review, you can customize your review thresholds and create rules to send users and posts to the Review Feed (refer to Rules). To manually flag a user or post, you can click the flag icon on the User/Content Feeds and provide a reason for the flag

Review Feeds & Task Expiry

Default Review Feeds

• By default, there are two different review feeds for Posts and Users. The Flagged Posts and Flagged Users feed will have all non-reported tasks. The Reported Posts and Reported Users feed will have all reported tasks.
• Although default feeds can not be edited or deleted, you can create new review feeds to customize the type of tasks that enter the feed.

📘

Review Feed Task Limit

All post review feeds have a shared 10K task limit. Similarly, all user feeds have a shared 10K task limit. After the 10K limit has reached, we will prioritize newer review tasks by replacing older tasks in the queue with newer review tasks

Create Custom Review Feeds

• You can create custom review feeds to direct specific types of posts and users to their own feeds.
• To create a new review feed, click the "Create New" button on the top right. In the create view, you will need to specify the following:
  • Feed Name - Name of the Review Feed
  • Moderation Categories - Review tasks matching at least one of these categories will show up in your review feed
  • Report Categories - Select whether you want reported tasks, no reported tasks, or both reported and not reported tasks to show up in your review feed. If you would like reported tasks to enter in this review feed, configure which report categories apply.
  • Rules - Review tasks that trigger the selected rules, will show up in your review feed.
• If any task matches at least one of the filters above for a given review feed, the task will enter that feed.

🚧

A post or user can enter multiple review feeds

A post or user review task can enter multiple review feeds if it matches the filters in more than one feed. However, the task can only be assigned to one moderator at a time. The moment a review task is assigned to a moderator for review, it will be removed from all review feeds.

Task Expiry

• After tasks are assigned to a moderator, they will have 5 minutes to submit for review. After 5 minutes, the tasks will expire and will re-enter the review queue to be re-assigned to a moderator.

Review Feed Settings

1. Default Assigned Action

The default action for a Review Feed tile is "No Action" (no actions will trigger when tasks are submitted). However, you can configure a default action that will trigger for all un-selected tiles at the time tasks are submitted for review. The selected default action will be shown at the top of the tile (in light gray).

2. Action Taken when Review Tasks Booted from Queue

Since the user and post queues have a cap of 10K review tasks, after the 10K limit has reached, the Dashboard will prioritize newer review tasks by booting older tasks in the queue and replacing them with newer review tasks. By default, there are no actions taken on the tasks that are booted from the queue. You can configure a default action that is triggered when review tasks are booted from the queue through Review Feed settings.

👍

Optimized for multiple human moderators

The Post and User Review Feeds are optimized for multi-moderator use at the same time. Tasks assigned to moderators will be unique for all moderators so that two moderators never have the same assigned tasks.

Guide for Moderators

Post Review Feed

1. When a moderator first enters, they will have a set of 8 assigned tasks that need to be reviewed. At the top of the page, moderators can view how many other moderators are currently reviewing and view the total number of remaining tasks to help manage time.

2. Moderators can very easily know why a post was flagged by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the top 2 model classes that were triggered by the Review Thresholds.

3. Moderators can get more information on a content if needed, by hovering or clicking into the content.

4. After viewing all the posts, the moderator can mark only the problematic posts by selecting the tile. The review action will depend on the Default Action dropdown at the top of the page. All actions on this page are populated from the Actions page on the Dashboard. All tiles that are not selected will be “Marked as no action”.

5. Moderators can escalate posts from one feed to another for review tasks that require a second opinion.

6. After reviewing, the moderator can click “Submit Review” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the posts that were selected will be triggered and can be viewed in the Actions Log.

User Review Feed

1. When a moderator first enters, they will have a set of 4 assigned tasks that need to be reviewed.

2. Moderators can very easily know why a user was sent to the Review Feed by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the user rule that triggered the flag.

You can view additional user information like userID, Last Active date, Start Date, Flagged post %, and the user's top moderation categories.

3. Each user review tile has the top three most relevant posts from that user to allow for the best judgement possible. The moderator can click into each of these posts to view more details on the post.

4. To get more insight on a specific user, the moderator can click into the User to view the user's post history. You can search and filter through the content table and select a review action for the user.

4. After viewing all the users, the moderator can mark only the problematic users by selecting the tile. The review action will depend on the Default Action dropdown at the top of the page. All tiles that are not selected will be “Marked as no action.”

5. Moderators can escalate users from one feed to another for review tasks that require a second opinion.

6. After reviewing, the moderator can click “Submit Review” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the users that were selected will be triggered and can be viewed in the Actions Log.