Review flagged media
Send uncertain moderation results to a person instead of guessing. Give reviewers time-limited signed access to unpublished media, the flagged moment, and enough context to decide quickly.
What you’re building
A review queue where the expensive part is the judgement, not the investigation.
Moderation returns a confidence score, and scores in the middle are exactly the cases a classifier cannot settle. The same few seconds of footage can be acceptable in a documentary and unacceptable in a promotional clip. A slur quoted in order to condemn it is not the same act as a slur directed at someone. Those distinctions are why the item was escalated, so sending a reviewer the score and nothing else asks them to do a job they have not been equipped for.
Two things make a review queue work. The reviewer must be able to watch media that is not published, which means short-lived signed access rather than making it public. And they must open on the flagged moment with context already assembled, rather than scrubbing a forty minute asset to work out what they are looking at.
Prerequisites
- A FastPix account with an active workspace (Activate your account)
- A signing key for signed playback (Generate JWTs for secure media)
- Thresholds that define your review band. See Content moderation.
Keep the media reviewable but unpublished
Media created with accessPolicy set to private has no public route to a viewer. It can still be played, but only through a signed token your application issues, which is exactly the property a review queue needs. Create it with playback closed exactly as in Gate uploads before publishing.
Do not create a public playback ID for anything in review. Publishing is the outcome of the review, not its starting point.
If the asset was already public when a finding arrived, revoke it first and review afterwards:
The media and its moderation history are untouched, so the decision stays reversible.
Build the review task from the finding
A review task is not a link to a video. Assemble it from the moderation result so the reviewer starts with the facts:
Order the queue by risk rather than by arrival time. A single high-confidence self-harm finding deserves attention before a backlog of borderline profanity, and a queue sorted by timestamp buries it.
Give the reviewer time-limited access
Generate a signed playback token scoped to the reviewer’s session, with an expiry short enough that a leaked link is not a lasting exposure. See Generate JWTs for secure media and Secure media access with JWTs.
Point the player at the flagged timestamp so the reviewer lands on the moment. On a long asset this single detail is most of the throughput difference, and it also limits how much distressing material a reviewer sits through to reach a decision they could make in ten seconds.
Give the reviewer enough context to decide
Context is what separates a correct decision from a fast one. Everything below is already available for the same media, and assembling it into the review task costs the reviewer nothing to read.
- A video summary tells them what the content is before they press play, so they know whether this is a lecture, a match report or an advertisement.
- Chapters show where the flagged moment sits in the structure. A violent scene forty minutes into a documentary and the same scene opening a promotional clip are different decisions.
- An attributed transcript gives the words around a flagged audio segment, which resolves most spoken findings without watching anything. It also names the speaker, which matters when only one participant in a recording is responsible.
- Named entities identify the people, organisations and products that appear, which is what turns a generic judgement into a specific one.
These support the decision rather than replacing the policy. A reviewer overriding your thresholds because the summary sounded reasonable is a tuning signal, not a precedent.
Record the decision and act
Each outcome maps to a concrete action:
Publishing is a single call:
Record the decision against the automated call that preceded it. Comparing the two over time is how you learn where your thresholds are wrong, and it is the only basis on which they should be retuned. A high reversal rate on one category means that threshold is set badly, not that reviewers are being difficult.
Handling appeals
An appeal attaches to the original review record rather than opening a new case, so the full history of a decision reads as one narrative.
Give the second reviewer the original finding, the policy applied at the time, the first reviewer’s reasoning, and whatever the contributor said in response. Assessing an appeal against the rules as they existed then, rather than as they exist now, is what makes the outcome defensible.
Keeping media restricted rather than deleting it is what makes an appeal possible at all. Deletion forecloses the outcome.
What to watch for
- Set a deadline on the pending state. Build a timeout into your pipeline and route anything still pending when it expires straight to a reviewer, rather than leaving an asset held.
- Keep review tokens short. A signed URL for a reviewer should outlive the review and nothing more.
- Measure reversal rate, not queue volume. Volume tells you how busy the queue is. Reversal rate tells you whether your thresholds are right.
- Escalation band width is a business decision. Widening it sends more to humans and catches more. Narrowing it cuts cost and misses more. Choose it deliberately rather than inheriting a default.
- Reviewers see the worst content you hold. Opening on the flagged moment, and showing the transcript where the finding is audio, limits unnecessary exposure.
Frequently asked questions
How does a reviewer watch a video that has not been published?
Keep the media on a private access policy and issue a short-lived signed playback token for the reviewer’s session. The media stays unavailable to everyone else, and the token expires on its own.
What should a moderation review task contain?
The flagged segments with their start and end times, the categories and scores, the modality of each finding, the policy being applied, and the decision options. Add the summary, chapters, transcript and named entities so the reviewer has context without scrubbing the asset.
How do I handle an appeal against a moderation decision?
Attach the appeal to the original review record and give the second reviewer the original finding, the policy as it stood at the time, and the first reviewer’s reasoning. Keep the media restricted rather than deleting it, since deletion removes the option to reverse.
How do I know whether my thresholds are set correctly?
Compare reviewer decisions against the automated call that escalated them. A category with a high reversal rate has a badly set threshold. Retune per category rather than adjusting one global sensitivity.
What’s next
- Put the gate in front of the queue: Gate uploads before publishing.
- Act on what a reviewer approves with edits: Fix flagged content and publish.
- Understand the categories and scores behind a finding: Content moderation.