Skip to content
Thank you for agreeing to be a Pivotal Question (PQ) evaluator for The Unjournal. We’re providing these forms to help clarify what we’re asking you to do. If you prefer, you can always share your responses in another way, such as a Google Doc.
Please follow the steps below, and let us know if you have any questions.

0. , if you don’t have one already

You can get one with an ‘anonymous ID’ if you prefer.


1. State your initial beliefs about the specific pivotal questions

Consider the background and goals of this PQ project. With this in mind, state your initial beliefs about the Pivotal Questions.
To see the canonical statement of this PQ, its subquestions, and the specific operationalized questions for evaluators to consider, see
Express your beliefs
In Metaculus, as relevant (see the “metaculus link” columns), which should take you to our
and (also embedded below), sharing your Metaculus ID in the form for tracking, and responding to any non-Metaculus questions
Provide a brief discussion of the reasoning behind your stated beliefs (in either space)

2. Consider and ‘rank’ papers/projects for PQ usefulness

Consider the papers and syntheses .
You may have been asked to focus on a subset of these only. If so, please ignore the others.
You don’t have to read each in full. Use your best judgment; feel free to use NotebookLM (we share a notebook
) to extract summaries and query key features of each. You can also consult the GPT “deep research report” , summarized in . You can use other LLM tools if you wish, but please be transparent about your use and do not rely on them for final judgments. (See our initially proposed AI use policy
.)
If there’s a paper not on this list that you know is particularly relevant to the pivotal question, please let us know immediately.
Please consider and discuss in your response:
Why (and to what extent) do you think these come to different results from one another?
You can use to query and compare all of the papers
You can consult the GPT “deep research report” , summarized in to get an overall picture of what they did differently.
Which approaches and assumptions do you find most plausible, and why?
Rank or otherwise assess the credibility of these in terms of their implications for the pivotal question.
Explain and discuss your reasoning (at least briefly); what choices do some of these make correctly/incorrectly, etc?

3. Evaluate one paper/project, or a small subset of these carefully

For the paper (or a few papers— this may depend on step 2) you find most credible and useful, do a careful evaluation of this work, largely following The Unjournal’s (applied stream) but focusing on the implications for the Pivotal Question.
Some things to consider (add specifics here)

4. State and justify your (revised) beliefs about the PQ in light of this evaluation and your work above



Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.