Impactful legal scholarship evaluation
Status, May 2026: paused/exploratory. We deprioritized this in late 2025 while handling other priorities and funding/operations constraints, and because we had not found a clear legal-scholarship champion. We would consider reviving it if we found a senior or promising mid-career legal scholar to help lead it, ideally alongside existing law-and-AI, animal welfare law, or legal-priorities initiatives.
The Unjournal has mainly focused on public evaluation of quantitative social science, economics, and policy research. We have also explored whether to evaluate high-impact legal scholarship, especially work relevant to AI governance and safety, biosecurity, animal welfare, global health, institutional design, and other global-priorities areas.
The model would be close to our existing work, with legal-specific adaptations:
identify and curate public legal research that may be unusually decision-relevant, influential, or neglected;
maintain a candidate list of potentially high-impact legal research, with public labels and short prioritization notes;
commission legal scholars, practitioners, and relevant subject-matter experts to evaluate its legal claims, reasoning, usefulness, likely influence, impact pathway, and limits;
pay evaluators for full evaluations, with a rough target around $500 where funding allows;
let authors respond where appropriate;
publish citable public evaluations and ratings, while allowing evaluators to sign or remain anonymous;
explore whether law reviews, workshops, funders, practitioner organizations, policy groups, and legal research organizations can use these evaluations as an additional signal.
This should complement law reviews rather than replace them. Authors may still need journal placement for career, citation, and field-recognition reasons, while The Unjournal can add a public expert signal around quality, practical relevance, and expected impact.
Why this might matter
Legal scholarship can influence legislation, litigation, regulation, judicial reasoning and jurisprudence, law-school curricula, advocacy strategy, funding choices, and policy design. In the US in particular, many high-prestige law reviews, such as Harvard Law Review, Yale Law Journal, and Stanford Law Review, are edited primarily by law students rather than through standard expert peer review, so credible public expert evaluation may add value.
The potential theory of change is:
Better legal scholarship in globally important areas gets faster and more useful feedback.
Strong legal arguments become easier for courts, policymakers, researchers, and advocates to identify and use.
Public evaluations create a clearer quality signal than journal placement alone.
The availability of this signal nudges more legal scholars toward work with high expected social value.
What we had developed
We developed an initial framework for finding, prioritizing, and evaluating legal scholarship. The current draft emphasizes four prioritization criteria:
global or societal impact;
practical applicability, existing prominence, and influence;
contribution to legal research, theory, and practice;
evaluability, including whether the work makes specific claims that experts can meaningfully assess.
We also began listing candidate papers and research areas for a pilot, including work on deepfakes, AI liability, international law, animal welfare law, health law, and other areas with possible global-priorities relevance.
One near-term path is a curation-first version: adapt our prioritization workflow to legal scholarship, invite people to suggest papers and label them (e.g., "highly impactful," "not practical," "needs legal expert review," "too broad," "strong AI-safety relevance"), and offer modest incentives for useful suggestions and prioritization notes. This could become a public-good filter before we commission full evaluations. We would expect to use AI tools for initial search, filtering, clustering, and summarization, while leaving final prioritization judgments to legal scholars, practitioners, and research users. See our early prioritization prototype, currently focused mainly on economics and related research rather than law.
Why we paused
The main blocker was not the lack of promising legal topics. It was leadership and fit.
For this to work, we likely need someone with legal-scholarship credibility to help decide what counts as strong legal analysis, recruit evaluators, adapt our scoring and publication model, and communicate with law journals or partner organizations. Without that person, the risk is that we either misread the norms of legal academia or stretch The Unjournal's existing team beyond its current expertise.
We also deprioritized this during a period of competing priorities and operational overstretch in late 2025.
What would make revival promising
We would be interested in revisiting this if one or more of the following came together:
a senior or mid-career legal scholar willing to act as a lead, advisor, or field specialist;
a partnership with an existing initiative in law and AI safety, animal welfare law, legal priorities research, or legal research evaluation;
a workshop or fellowship pipeline where Unjournal-style evaluation could add structure and public visibility;
a small funded pilot evaluating 1-3 legal papers, with authors and evaluators willing to engage publicly;
interest from law reviews, legal blogs, funders, or policy organizations in using evaluations as an additional triage or quality signal.
Possible first pilot formats include:
evaluating a small cluster of public AI-safety, AI-governance, biosecurity, or animal welfare legal papers;
building a high-impact legal research candidate list and paying modest rewards for useful labels, suggestions, and prioritization notes;
partnering with a law-and-AI workshop to publish structured evaluations of selected working papers. Workshops may be useful as an intermediate signal: they already screen papers, convene relevant scholars, and generate feedback, even if they are not a final quality judgment;
running a prize or call for high-impact legal scholarship on global catastrophic risk;
asking funders or fellowship programs whether public evaluation could become a useful requirement or default for some grantees;
doing post-publication evaluations of influential legal articles where extra expert scrutiny would still be valuable.
For AI-governance work, an "AI-safety framing" should probably mean that evaluators can assess whether the paper improves AI-risk governance, legal incentives, institutional control, or law-following AI. It should not require evaluators to share a single substantive view about AI policy.
Open design questions include whether the first pilot should focus mainly on the US context because of the greater review gap and role of court jurisprudence; whether US legal scholars can be recruited at the available compensation; and which ratings are useful without becoming misleading in legal contexts.
Source materials
Public-facing:
Working notes and planning docs (access-controlled; review sharing settings before wider circulation):
Potential partner/context links (context only, not confirmed partnerships):
This page is a public summary. It does not quote private Slack messages, private meeting transcripts, or sensitive outreach notes.
Last updated
Was this helpful?