Fast facts
- Only 26.5% of AI-generated references are correct — that means 73.5% contain errors or are entirely invented.
- A single DOI lookup at
doi.org catches the majority of fake references in under 10 seconds.
- A working DOI does not prove quality: DOIs verify persistent identification, not peer review or journal reputation.
Most students never learned how to verify a reference. You were taught how to format them in APA or MLA — the commas, the italics, the hanging indent — but nobody explained how to confirm they actually exist. Then comes the moment when an AI-generated citation appears in your reference list, looks perfectly formatted, and you have no idea whether the paper behind it is real.
Here’s how to check.
The Quick Verification Workflow
Before diving into each tool, here is the master workflow. It maps every source type to the best verification method and the difficulty level you should expect.
| Source Type |
Primary Tool |
Secondary Check |
Difficulty |
| Journal article (has DOI) |
Resolve at doi.org |
CrossRef metadata comparison |
Easy |
| Journal article (no DOI) |
Google Scholar (title search) |
Publisher website archive |
Medium |
| Biomedical / clinical source |
PubMed |
CrossRef or PMID resolution |
Easy |
| Book or monograph |
WorldCat (ISBN or title) |
Publisher catalogue |
Medium |
| Conference paper |
IEEE Xplore / ACM Digital Library |
Conference proceedings website |
Medium |
| AI-generated reference |
doi.org + Google Scholar |
Publisher issue archive |
Hard |
Bottom line: Start with the DOI. If the reference has a DOI, resolve it — that’s the fastest filter. If there’s no DOI, fall back to Google Scholar or the relevant database. Always do a secondary check for anything you plan to cite in a submitted paper.
Step 1: Resolve the DOI
The DOI (Digital Object Identifier) is your first and best defense against fake references. A DOI looks like this:
10.1037/a0018218
To verify it, go to https://doi.org/ and append the DOI at the end. For the example above: https://doi.org/10.1037/a0018218
Three possible outcomes
- Resolves to the correct paper — The DOI is valid. Move to Step 2 (metadata comparison).
- Returns “DOI not found” — The DOI is fabricated or mistyped. Stop: this reference is fake.
- Resolves to a different paper — You have a chimera (Frankenstein) citation: a real DOI attached to a non-matching paper. This is one of the trickiest forms of AI hallucination.
Pro tip: Don’t trust the DOI alone. A valid DOI confirms the identifier exists, not that it belongs to the paper you’re citing. You still need to compare metadata — the title, authors, journal, and year.
What DOIs do NOT tell you
A DOI is an identification system. It does not prove that:
- The journal is peer-reviewed
- The journal is reputable or indexed (Scopus, Web of Science)
- The paper is high quality
- The DOI is legitimate or not registered by a predatory publisher
A DOI means “this paper has a persistent identifier.” Nothing more. For quality assessment, you need separate tools like Beall’s Lists (a registry of suspect predatory journals) and journal ranking databases.
Step 2: Compare Metadata in CrossRef
CrossRef is the official DOI registration agency — it’s not a third-party service or a startup tool. It is the primary authority for DOI metadata, managing 150+ million works from 20,000+ publishers.
Go to https://www.crossref.org/ and use their search. Enter the title or DOI and compare the result against your citation.
What to check in CrossRef
Match each field:
- Title — Should match closely. Watch for AI-garbled titles that swap one word.
- Author names — Verify spelling and order. AI often gets these right but pairs them with wrong papers.
- Year — Must align. A paper from 2025 cannot appear in a journal volume from 2023.
- Journal name — Check the exact title. Some AI-generated citations use real journal names with wrong titles inside them.
- Volume, issue, pages — These fields reveal many fake citations. A volume number that doesn’t align with the publication year is a red flag.
Mathematical inconsistency red flags from SourceChecker include:
- Issue numbers higher than the journal’s publication frequency (e.g., Issue 7 for a quarterly journal)
- Volume numbers higher than the journal’s age (a journal founded in 2020 cannot have Volume 15)
- Page ranges that exceed the journal’s known pagination
If any of these mismatch, the reference is almost certainly fake.
Step 3: Search by Title in Google Scholar
When a source has no DOI (many older papers, conference proceedings, grey literature), use Google Scholar to search the exact title in quotation marks:
"title of paper here" site:scholar.google.com
Why Google Scholar works for this
- It indexes a broader range of sources than most databases: journals, repositories, university papers, conference proceedings, and grey literature
- The exact-title search is more reliable than the title fields in citation management software
- Absence from Google Scholar is not conclusive (some articles are paywalled or unpublished in repositories) — but it’s a useful secondary signal
Rule of thumb: Always cross-check against at least one additional database. If a paper appears in Google Scholar but nowhere else, search the publisher’s website. If it appears nowhere, the source is likely fabricated.
Step 4: Use PubMed for Biomedical Sources
PubMed is the U.S. National Library of Medicine’s database. It contains 35+ million citations from biomedical and life sciences journals.
If you’re citing a medical, clinical, or health-related source:
- Go to https://pubmed.ncbi.nlm.nih.gov/
- Search the title or PMID (PubMed ID)
- Check the Retraction Notice tag — PubMed prominently displays retraction status
PMIDs function like DOIs for PubMed-indexed articles. Every PubMed record includes an [AID] field showing the DOI or PMID. You can verify the article exists by confirming this field.
Step 5: Search WorldCat for Books
Books don’t use DOIs. Instead, WorldCat is the world’s largest library catalog, connecting millions of holdings across institutions.
- Search by ISBN (the most reliable method) or title
- WorldCat shows which libraries hold the book, publication details, and confirmed bibliographic metadata
- For older books without ISBNs, verify through the publisher’s catalogue
When to use WorldCat: Any book or monograph in your reference list. If you can’t find the book in WorldCat or the publisher’s catalogue, it probably doesn’t exist — or you’ve misremembered the title.
Step 6: Check Retraction Status
Even a verified paper can be retracted. Retractions occur when a journal or publisher withdraws a paper due to errors, misconduct, or other issues. A retracted paper is still citable in some contexts (for discussing the retraction), but it should not be used as evidence for a claim.
How to check
Retraction Watch Database tracks 68,000+ retractions across all disciplines. Search by DOI, PMID, title, or author at https://retractionwatch.com/.
Zotero integration
If you use Zotero, install the Retraction Watch integration. It automatically scans your library and documents for retracted works.
- Flags items with warning banners in your item list
- The Word Processor Plugin pops up a warning when you cite a retracted paper in Word
- Requires the DOI or PMID in the item record (works for ~75% of Retraction Watch entries)
- Currently tracks full retractions only, not Expressions of Concern or individual corrections
Scholar Sidekick Retraction Checker
Free online tool at https://scholar-sidekick.com/. Check retraction status by DOI or PMID. Reports: “Retracted,” “Expression of Concern,” or “Correction/Erratum.”
How to Verify a Quote on the Cited Page
Checking whether a quote actually appears on the page you cite is harder than verifying a reference. Here’s the process:
The 5-step quote verification
- Locate the exact edition — Quotations shift across editions due to re-pagination. Verify the edition you used (year, publisher, format).
- Search digital archives — Use Google Books preview, Internet Archive, or academic indexes. Search exact phrases in quotation marks.
- Verify exact wording — Check word-for-word spelling, punctuation, capitalization, and italics. Academic writing demands precision.
- Check PDF page numbers vs. printed pagination — A PDF may have different page numbers than the printed version.
- Trace citations backward — If you found a quote in a secondary source (someone else cited it), open the primary source and verify. Don’t trust secondary citations blindly.
Avoid quote swamps
Unverified quotation repositories (like Quotations Page or similar sites) frequently misattribute quotes or detach them from real page numbers. Always verify against the primary source.
Frankenstein (Chimera) Citations: How to Spot Them
Frankenstein citations — also called chimera citations — are among the hardest AI hallucinations to detect because they combine:
- Real author names
- Real journal names
- Real DOI prefixes
- Invented titles, volumes, or years
A chimera citation looks legitimate at a glance. The DOI resolves. The journal exists. The authors exist. But the paper doesn’t.
How to detect chimera citations
- Resolve the DOI — Verify it resolves to a paper (not a 404).
- Compare metadata — Title, authors, journal, year. If any field doesn’t align, it’s chimera.
- Check the author’s Google Scholar profile — If the paper doesn’t appear in the author’s publication history, it’s chimera.
Real-world examples
- Mata v. Avianca (June 2023): Attorney Steven A. Schwartz submitted a court filing with six AI-generated fake case citations. Judge P. Kevin Castel fined the attorneys $5,000. This case is now the standard example for AI citation risks.
- NeurIPS 2025: Approximately 100 hallucinated citations made it through peer review before being flagged by reviewers.
Automated Reference Checking Tools
Automated tools are useful when you have 30+ references to verify or are doing a final pre-submission pass. They cannot replace manual checking for content accuracy, but they catch the majority of formatting and DOI errors quickly.
|
|
|
| Tool |
Best for |
Free tier |
Notes |
| CiteTrue (citetrue.com) |
AI-powered citation verification |
Yes |
Batch checking |
| TrueCitation (truecitation.com) |
Bulk reference list checker |
Yes |
Good for APA/MLA |
| CiteMe (citeme.app/tools) |
APA, MLA, Harvard formats |
Yes |
Format conversion included |
| Research Gold (researchgold.org) |
Crossref + PubMed cross-checking |
Yes |
Dual database |
| Citely (citely.ai) |
CrossRef DOI + metadata matching |
Yes |
Queries CrossRef, flags mismatches |
| Litrevu (litrevu.com) |
Compares Crossref, OpenAlex, Zotero |
Yes |
Aggregates 4 tools |
|
|
|
When to use automated tools: Large reference lists (30+), AI-assisted writing, final pre-submission verification, DOI format and resolution checking.
When manual checking is still needed: Content accuracy (does the source actually support your claim?), grey literature, retraction status, quotation page numbers, unusual source types.
When Should You Check References?
Preventative checking
If you’re using AI research tools (ChatGPT, Perplexity, etc.), verify every citation before you cite it. Don’t wait until the end. Checking as you go saves time because you fix errors in real-time rather than hunting for them in a completed reference list.
Reactive checking
If someone else provided the references (a co-author, a group project partner, a professor), check everything in your reference list. It costs 10 minutes per paper and protects you from inadvertently citing fake or retracted work.
Relatable moment: You copy-paste ChatGPT’s reference list straight into your paper. You feel good because the formatting is perfect. Then you realize one DOI resolves to a completely unrelated paper about marine biology instead of your thesis on cognitive behavioral therapy. You could’ve saved the paper in 30 seconds.
Common Reference Checking Mistakes
| Mistake |
Why it’s bad |
How to fix it |
| Checking only the DOI |
A valid DOI doesn’t prove the paper matches your citation |
Resolve DOI → compare metadata field-by-field |
| Trusting citation managers |
Zotero, EndNote, and Mendeley format citations but don’t verify them |
Cross-check every reference in a database |
| Using only Google Scholar |
Scholar misses paywalled papers and some publishers |
Always cross-check against CrossRef or the publisher |
| Skipping retraction checks |
A retracted paper is not evidence — it’s a liability |
Retraction Watch or Zotero Retraction Watch plugin |
| Citing secondhand sources |
If Source B cites Source A, verify Source A yourself |
Always go to the primary source |
Verifying a reference doesn’t require advanced technology or expensive software. It requires a systematic approach:
- Resolve the DOI at
doi.org — 10 seconds, catches the majority of fake citations
- Compare metadata in CrossRef — title, authors, year, journal, volume
- Search Google Scholar by title for non-DOI sources
- Use PubMed for biomedical sources (includes retraction notices)
- Search WorldCat for books and monographs
- Check retraction status — Retraction Watch, Zotero plugin, Scholar Sidekick
- Verify quotes against primary sources
- Spot chimera citations by checking author publication histories
The most important rule: A DOI confirms identity, not quality. Always compare the resolved metadata against your citation. A working DOI with garbled title, wrong year, or mismatched journal is still a fake reference.
If you have 30+ references or are working with AI-assisted writing, use automated tools like Citely or CiteTrue for a quick format and DOI pass. But always follow up with manual checking for content accuracy and retraction status.
FAQ
Is it enough to just check if a DOI resolves?
No. A valid DOI confirms the identifier exists, but the paper it resolves to might not match your citation. Always compare metadata — title, authors, year, journal — against the DOI-resolved record.
What if a reference doesn’t have a DOI?
Use Google Scholar to search the exact title. If that fails, check the publisher’s website or, for books, WorldCat. Absence from Google Scholar is not conclusive but is a useful secondary signal.
How do I know if a source is predatory?
Check if the journal appears in Beall’s Lists (a registry of suspect predatory journals), verify it’s indexed in Scopus or Web of Science, and review the journal’s editorial board and publication fees. See our guide on journal legitimacy for detailed detection steps.
Should I cite a retracted paper?
A retracted paper should not be used as evidence. It may be cited in a paper about the retraction, or to discuss why the finding was invalidated — but it should not support a claim. Always check Retraction Watch before citing.
Can I use an automated tool to check all my references?
Automated tools are great for format checking and DOI resolution across 30+ references. They cannot verify whether a source actually supports your claim, whether it’s retracted, or whether quotes are on the correct page. Always follow up automated checks with manual verification.
Need help verifying your references before submission? Contact our team for reference verification and citation audit services.
