Organizational roles and responsibilities

14 Jan 2025: The Unjournal is still looking to build our team and evaluator pool. Please consider the roles below and express your interest here or contact us at [e-mail].

Management committee members

Activities of those on the management committee may involve a combination of the following (although you can choose your focus):

• Contributing to the decision-making process regarding research focus, reviewer assignment, and prize distribution.

• Collaborating with other committee members on the establishment of rules and guidelines, such as determining the metrics for research evaluation and defining the mode of assessment publication.

• Helping plan The Unjournal’s future path.

• Helping monitor and prioritize research for The Unjournal to evaluate (i.e., acting as a field specialist; see further discussion below). Acting as an evaluation manager for research in your area.

Time commitment: A minimum of 15–20 hours per year.

Compensation: We have funding for a $57.50 per hour honorarium for the first 20 hours, with possible compensation . Evaluation management work will be further compensated (at roughly $300–$450 per paper).

Who we are looking for: All applicants are welcome. We are especially interested in those involved in global priorities research (and related fields), policy research and practice, open science and meta-science, bibliometrics and scholarly publishing, and any other academic research. We want individuals with a solid interest in The Unjournal project and its goals, and the ability to meet the minimal time commitment. Applying is extremely quick, and those not chosen will be considered for other roles and work going forward.

Advisory board (AB) members

Beyond direct roles within The Unjournal, we're building a larger, more passive advisory board to be part of our network, to offer occasional feedback and guidance. There is essentially no minimum time commitment for advisory board members—only opportunities to engage. We sketch some of the expectations in the fold below.

Advisory board members: expectations

As an AB member...

• you agree to be listed on our page as being on the advisory board.

• you have the option (but not the expectation or requirement) to join our Slack, and to check in once in a while.

• you will be looped in for your input on some decisions surrounding The Unjournal's policies and direction. Such communications might occur once per month, and you are not obligated to respond.

• you may be invited to occasional video meetings (again optional).

• you are “in our system” and we may consult you for other work.

• you will be compensated for anything that requires a substantial amount of your time that does not overlap with your regular work.

Field specialists (FS), Unjournal Research Affiliates (URA)

Dec 2024: We're introducing a lower-commitment "Unjournal Research Affiliate" role, targeted at PhD students, but available more broadly. See below.

FSs will focus on a particular area of research, policy, or impactful outcome. They will keep track of new or under-considered research with potential for impact and explain and assess the extent to which The Unjournal can add value by commissioning its evaluation. They will "curate" this research and may also serve as evaluation managers for this work.

Time commitment: There is no specific time obligation—only opportunities to engage. We may also consult you occasionally on your areas of expertise. Perhaps 1–4 hours a month is a reasonable starting expectation for people already involved in doing or using research, plus potential additional paid assignments.

Our Incentives and norms document also provides some guidance on the nature of work and the time involved.

Compensation: We aim to fairly compensate people for time spent on work done to support The Unjournal, and to provide incentives for suggesting and helping to prioritize research for evaluation. See the Norms and Compensation page. Evaluation management work will be compensated at roughly $300–$450 per project.

Who we are looking for: For the FS roles, we are seeking active researchers, practitioners, and stakeholders with a strong publication record and/or involvement in the research and/or research-linked policy and prioritization processes. For the AB, also people with connections to academic, governmental, or relevant non-profit institutions, and/or involvement in open science, publication, and research evaluation processes. People who can offer relevant advice, experience, guidance, or help communicate our goals, processes, and progress.

Interested? Please fill out this form (about 3–5 min, using the same form for all roles).

If you become a field specialist, what happens next?

You will be asked to fill out to let us know what fields, topics, and sources of research you would like to "monitor" or dig into to help identify and curate work relevant for Unjournal evaluation, as well as outlining your areas of expertise (the form takes perhaps 5–20 minutes).

This survey helps us understand when to contact you to ask if you want to be an evaluation manager on a paper we have prioritized for evaluation.

Guided by this survey form (along with discussions we will have with you, and coordination with the team), we will develop an “assignment” that specifies the area you will cover. We will try to divide the space and not overlap between field specialists. This scope can be as broad or focused as you like.

Within your area, you keep a record of the research that seems relevant (and why, and what particularly needs evaluation, etc.) and enter it in our database. (Alternatively, you can pass your notes to us for recording.)

We will compensate you for the time you spend on this process (details tbd), particularly to the extent that the time you spend does not contribute to your other work or research. (See incentives and norms here.)

Field specialist "area teams"

We are organizing several teams of field specialists (and management and advisory board members). These teams will hold occasional online meetings (perhaps every 3 months) to discuss research to prioritize, and to help coordinate 'who covers what'. If team members are interested, further discussions, meetings, and seminars might be arranged, but this is very much optional.

As of Dec 2024, we have the following teams (organized around fields and outcomes)

1. Development economics and global health and development

2. Economics, welfare, and governance

3. Psychology, behavioral science, and attitudes

4. Innovation and meta-science, impact of emerging technologies, catastrophic risks

5. Animal welfare: markets, attitudes

6. Environmental economics

Other teams are being organized or considered

"Monitoring" a research area or source as a field specialist

The Unjournal's field specialists choose an area they want to monitor. By this we mean that a field specialist will

• Keep an eye on designated sources (e.g., particular working paper series) and fields (or outcomes or area codes), perhaps every month or so; consider new work, dig into archives

• Let us know what you have been able to cover; if you need to reduce the scope, we can adjust it

• Suggest/Input work into our database … papers/projects/research that seems relevant for The Unjournal to evaluate. Give some quick ‘prioritization ratings’

• If you have time, give a brief on why this work relevant for UJ (impactful, credible, timely, open presentation, policy-relevant, etc) and what areas need particular evaluation and feedback

See: Unjournal Field Specialists: Incentives and norms (trial)

Unjournal Research Affiliates (URA)

We are looking to recruit a small number of "Unjournal Research Affiliates (URAs)". Applicants will selected based on (1) their ability to assess, discuss, and communicate the global impact of research, (2) their understanding of The Unjournal approach, (3) their research skills, interests, and experience.

URAs will support open evaluation and impactful, credible research, helping The Unjournal keep on top of the latest, most interesting, influential, and potentially impactful work. They will help raise awareness of The Unjournal, helping foster a transition to a better system. Being a URA offers a range of benefits:

• It publicly signals your commitment to open science principles, innovation, and research impact.

• Credibility and career capital: URAs are chosen through a selective process, and will be publicly acknowledged

• Build contacts with others in your field and with related interests. Stay on top of cutting-edge research, discuss and understand its value and connection to the field and to policy/impact.

• Have a say in the agenda.

• Be compensated ($) and get credit for research surveying and scoping you are already doing. See the compensation details here.

• Build your portfolio and unlock other opportunities in this space in the future, such as Unjournal Field Specialist and management positions

Why are we offering this role? Early career researchers and PhD students may be interested in getting involved but worried about making . But getting busy students and researchers involved even minimally could keep us in touch with the cutting edge of research and help us forge collaborations in academia. So we're offering the role, which is similar to the Field Specialist role, but with less responsibility and time commitment. This role comes with , but URAs are eligible for incentive compensation for suggesting papers, for doing high-value assessment for prioritization, and more (see here).

Unjournal Research Affiliates will be expected to

1. Join our Slack and Coda, but there is no expectation to check in regularly.

2. Suggest 2-3 papers per term (Spring, Summer, Autumn), and explain why these have potential for global impact. This comes with modest compensation; see above.

3. Write up the prioritization assessment (the second opinion) for three papers per term.

4. Vote on 5-10 papers per term; check in to vote once per month or more

5. Understand and be able to explain The Unjournal to your colleagues/on social media

6. Join at least one (one hour) FS or Unjournal general meeting per year.

Evaluation management work is not expected, but we may may consult URAs for occasional help in suggesting evaluators, with potential compensation.

Apply here for this and other roles.

Contact us

If you are interested in discussing any of the above in person, please email us ([e-mail]) to arrange a conversation.

We invite you to fill in this form (the same as that linked above) to leave your contact information and outline which parts of the project interest you.

Note: These descriptions are under continual refinement; see our policies for more details.