Integrate Human in the Loop Moderation

The Review Feed allows for easy and effective human-in-the-loop moderation alongside your automated moderation flow. You can leverage your team of human moderators to manually review users and posts to ensure the highest level of accuracy.

There are two ways you can send users and posts to the Review Feed. To automatically flag for review, you can customize your review thresholds and create rules to send users and posts to the Review Feed (refer to Rules). To manually flag a user or post, you can click the flag icon on the User/Content Feeds and provide a reason for the flag

Review Queue & Task Expiry

Review Queue

  • Users and posts have their own queue of review tasks. When a user or post is flagged for review, it first enters the queue to be assigned to a moderator. Both the user and post queues have a cap of 10K review tasks.
  • After the 10K limit has reached, we will prioritize newer review tasks by replacing older tasks in the queue with newer review tasks

Task Expiry

  • After tasks are assigned to a moderator, they will have 5 minutes to submit for review. After 5 minutes, the tasks will expire and will re-enter the review queue to be re-assigned to a moderator.

Review Feed Settings

15861586

Review Feed Settings

1. Default Assigned Action

The default action for a Review Feed tile is "No Action" (no actions will trigger when tasks are submitted). However, you can configure a default action that will trigger for all un-selected tiles at the time tasks are submitted for review. The selected default action will be shown at the top of the tile (in light gray).

642642

Default action for this application is "Delete Post". Since this tile is un-selected, the Delete Post action will trigger for this tile when the review is submitted.

2. Action Taken when Review Tasks Booted from Queue

Since the user and post queues have a cap of 10K review tasks, after the 10K limit has reached, the Dashboard will prioritize newer review tasks by booting older tasks in the queue and replacing them with newer review tasks. By default, there are no actions taken on the tasks that are booted from the queue. You can configure a default action that is triggered when review tasks are booted from the queue through Review Feed settings.

👍

Optimized for multiple human moderators

The Post and User Review Feeds are optimized for multi-moderator use at the same time. Tasks assigned to moderators will be unique for all moderators so that two moderators never have the same assigned tasks.

Guide for Moderators

Post Review Feed

  1. When a moderator first enters, they will have a set of 8 assigned tasks that need to be reviewed. At the top of the page, moderators can view how many other moderators are currently reviewing and view the total number of remaining tasks to help manage time.
22282228

Post Review Feed

  1. Moderators can very easily know why a post was flagged by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the top 2 model classes that were triggered by the Review Thresholds.
311311

Flag Reason

  1. Moderators can get more information on a content if needed, by hovering or clicking into the content.
436436

Hover to view more information

22362236

Click into a content to view additional model results

  1. After viewing all the posts, the moderator can mark only the problematic posts by selecting the tile. The review action will depend on the Default Action dropdown at the top of the page. All actions on this page are populated from the Actions page on the Dashboard. All tiles that are not selected will be “Marked as no action”.

  2. After reviewing, the moderator can click “Submit Review” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the posts that were selected will be triggered and can be viewed in the Actions Log.


User Review Feed

  1. When a moderator first enters, they will have a set of 4 assigned tasks that need to be reviewed.
22262226

User Review Feed

  1. Moderators can very easily know why a user was sent to the Review Feed by viewing the flag reason at the top of the tile. If the post was manually flagged, it will show the message specified by the moderator at the time of flagging. If the post was automatically flagged, it will show the user rule that triggered the flag.

You can view additional user information like userID, Last Active date, Start Date, Flagged post %, and the user's top moderation categories.

482482

Flag reason + Additional user details

  1. Each user review tile has the top three most relevant posts from that user to allow for the best judgement possible. The moderator can click into each of these posts to view more details on the post.

  2. To get more insight on a specific user, the moderator can click into the User to view the user's post history. You can search and filter through the content table and select a review action for the user.

22262226

Click into a user to view their post history

  1. After viewing all the users, the moderator can mark only the problematic users by selecting the tile. The review action will depend on the Default Action dropdown at the top of the page. All tiles that are not selected will be “Marked as no action.”

  2. After reviewing, the moderator can click “Submit Review” to submit current judgements and get a new set of assigned review tasks. On Submit, the actions for the users that were selected will be triggered and can be viewed in the Actions Log.