Integrate Human in the Loop Moderation

The Review Feed allows for easy and effective human-in-the-loop moderation alongside your automated moderation flow. You can leverage your team of human moderators to manually review users and posts to ensure the highest level of accuracy.

There are two ways you can send users and posts to the Review Feed. To automatically flag for review, you can customize your review thresholds and create rules to send users and posts to the Review Feed (refer to Rules). To manually flag a user or post, you can click the flag icon on the User/Content Feeds and provide a reason for the flag

Review Queue & Task Expiry

Review Queue

  • Users and posts have their own queue of review tasks. When a user or post is flagged for review, it first enters the queue to be assigned to a moderator. Both the user and post queues have a cap of 10K review tasks.
  • After the 10K limit has reached, we will prioritize newer review tasks by removing older tasks in the queue with newer review tasks

Task Expiry

  • After tasks are assigned to a moderator, they will have 5 minutes to submit for review. After 5 minutes, the tasks will expire and will re-enter the review queue to be re-assigned to a moderator.

👍

Optimized for multiple human moderators

The Post and User Review Feeds are optimized for multi-moderator use at the same time. Tasks assigned to moderators will be unique for all moderators so that two moderators never have the same assigned tasks.

Guide for Moderators

Post Review Feed

  1. When a moderator first enters, they will have a set of 8 assigned tasks that need to be reviewed. At the top of the page, moderators can view how many other moderators are currently reviewing and view the total number of remaining tasks to help manage time.
Post Review FeedPost Review Feed

Post Review Feed

  1. Moderators can very easily know why a post was flagged by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the top 2 model classes that were triggered by the Review Thresholds.
Flag ReasonFlag Reason

Flag Reason

  1. Moderators can get more information on a content if needed, by hovering or clicking into the content.
Hover to view more informationHover to view more information

Hover to view more information

Click into a content to view additional model resultsClick into a content to view additional model results

Click into a content to view additional model results

  1. After viewing all the posts, the moderator can mark only the problematic posts by selecting the tile. The review action will depend on the Default Action dropdown at the top of the page. All actions on this page are populated from the Actions page on the Dashboard. All tiles that are not selected will be “Marked as no action”.

  2. After reviewing, the moderator can click “Submit Review” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the posts that were selected will be triggered and can be viewed in the Actions Log.


User Review Feed

  1. When a moderator first enters, they will have a set of 4 assigned tasks that need to be reviewed.
User Review FeedUser Review Feed

User Review Feed

  1. Moderators can very easily know why a user was sent to the Review Feed by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the user rule that triggered the flag.

You can view additional user information like userID, Last Active date, Start Date, Flagged post %, and the user's top moderation categories.

Flag reason + Additional user detailsFlag reason + Additional user details

Flag reason + Additional user details

  1. Each user review tile has the top three most relevant posts from that user to allow for the best judgement possible. The moderator can click into each of these posts to view more details on the post.

  2. To get more insight on a specific user, the moderator can click into the User to view the user's post history. You can search and filter through the content table and select a review action for the user.

Click into a user to view their post historyClick into a user to view their post history

Click into a user to view their post history

  1. After viewing all the users, the moderator can mark only the problematic users by selecting the tile. The review action will depend on the Default Action dropdown at the top of the page. All tiles that are not selected will be “Marked as no action”.

  2. After reviewing, the moderator can click “Submit Review” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the users that were selected will be triggered and can be viewed in the Actions Log.