Recommended triage buckets
- Likely AI: generator metadata, workflow terms, explicit AI provenance, or strong enhanced-model evidence.
- Likely real or edited: camera metadata, normal capture clues, or editor-only traces without generator evidence.
- Uncertain: screenshots, compressed files, stripped metadata, or conflicting signals.
Bulk review checklist
- Keep the original file name, source URL, uploader, and upload date together.
- Run a first-pass check and copy the ImgShield explanation for each image that matters.
- Prioritize files with monetization, trust, legal, or editorial impact.
- Send uncertain files to human review instead of treating them as clean or fake.
Define the decision before reviewing
Write down what the review will change. A newsroom may only need to flag images for source verification. A marketplace may temporarily hold a listing. A creative team may label licensed AI work rather than reject it. The same technical clue can lead to different actions, so reviewers need a written policy before they see scores.
Keep the consequences proportional. Metadata checks are suitable for prioritizing work; they are not suitable as the sole basis for firing a contributor, accusing a seller of fraud, or making a legal claim.
Create a small evidence record
For each reviewed file, record a stable item ID, original filename, source URL, submission time, whether it is an original or screenshot, and the reviewer. Copy the individual clues rather than only the percentage. Useful fields include generator terms, camera fields, C2PA labels, editing software, enhanced-model result, reverse-search result, and the final human decision.
A spreadsheet is enough for a small queue. Use one row per file, controlled values for the triage bucket, and a free-text evidence column. Do not place private originals in a shared sheet; store them in an access-controlled location and link by internal ID.
Use a two-pass queue
- Pass one: remove duplicates, unsupported files, obvious screenshots, and items that do not need a decision.
- Pass two: check remaining originals, copy the readable evidence, and assign likely AI, likely real/edited, or uncertain.
- Escalation: send high-impact and conflicting cases to a second reviewer who has not seen the first conclusion.
- Closure: record what action was taken and which evidence justified it. Keep uncertain cases uncertain.
Quality-control a sample
Review a random sample of each bucket every week or release cycle. Compare reviewer agreement and look for recurring failure modes: one platform stripping metadata, one editor writing misleading fields, or reviewers treating missing EXIF as proof. If the error pattern changes, update the written policy before processing the next batch.
Include known reference files when possible: untouched camera originals, social-media copies of those originals, generated files with intact workflow metadata, and generated files exported through an editor. These references do not measure every model, but they reveal whether your process is reacting to file handling rather than origin.
Related pages
- How to tell if an image is AI generated
- How ImgShield classifies evidence
- How uploaded images are processed