See:

We are currently using PubPub (https://unjournal.pubpub.org/) as our main platform for hosting evaluations and ratings, manager summaries, and author responses. It offers flexibility, a good user-experience, and a range of features to help us integrate this work into the bibliometrics and archives (e.g., assigning DOIs). (See discussion of options in "Options for hosting reviews" doc.) We may find ways to use it in our submission platform and editorial management workflow as well; we are exploring this further.Some relevant private Gdocs (ask for access):

• ​Unjournal pubpub current process and automation plans (~instructions for adding evaluation packages to our page)

• ​ (includes discussion of initial setup of PubPub space)

Updated see Gdoc on 'Editorial Management Tech needs HERE and embedded at bottom (to do: integrate these discussions)

Core needs

1. Hosting 'qualitative' evaluation content: A place to host the evaluations (as well as the authors’ responses and the editors' comments), allowing the public to read them in an attractive and convenient way (and perhaps respond to them). Ideally this will also make the quantitative ratings and predictions prominent and connected to the evaluations. This system needs to allow evaluations of any research that is publicly hosted and has a DOI.

2. DOIs, Bibliometrics, Google Scholar: We need these evaluations to be visible in "bibliometric systems". They need a DOI, they need to show up in Google scholar and other search tools. The references cited in the evaluations (including the original paper) should also appear in the bibliometric record. Right now 'CrossRef' seems to be the leading system for this.

Some other desirable capabilities

• Ways to enable evaluators and others to do collaborative annotation on pre-prints

• Integrations with other platforms including prediction markets and OSF

• Platforms for people to engage in other ways, perhaps up- and downrating evaluations etc

Further discussion ("Unjournal platform discussion")

We have a partially-built system combining Sciety, Kotahi, and Hypothes.is. However, other tools and bespoke work will be needed to achieve some of the goals stated above.

2023 Update: We have moved mainly to PubPub, at least for hosting evaluation output (see )

Partial restatement and update, 2023

\

1. Ideally also, this would update automatically. We might also want to give some nice analysis and visualization for this (although we could do that in one of the other pages, simply bringing in the data from this place where it’s stored). An API and link to other data archives could be useful.

Our first evaluation is up!!

See:

• "Desired Sciety group output" (Gdoc section)

Editorial management and paper intake: Kotahi

14 Nov 2022: For now, only managers/editors and authors will interact with this page. We plan to adapt it to become the interface for evaluations as well.

13 Dec 2022: Moving in this direction

Currently, the majority of our process is not done through Kotahi. We would need funds to make a more bespoke interface.

Host for Kotahi: Cloud68

Domain name: should take people to dashboard page (or login if necessary)

Will change this to: unjournalplatform.org 14 Nov 2022-- the login page is taking people to the wrong place for now

Output from evaluations goes to...

Gets into a single hypothes.is account:

This is essentially a workaround database. We are not using the full features of hypothes.is yet. See /this Gdoc for the thoughts and progress on this.

Main public curated space: Sciety.org

Group in preparation:

Goal: get Unjournal.org to redirect here

Expected to be ready in early December 2022.

Automating reminder/response emails

Anonymity

What is GitBook? How to edit it?

Some quick points:

• GitBook is mainly used for tech documentation; but it has some important strengths and it's pretty good for general use.

• It is based in markdown and other simple flat text files.

• It synchronizes through Git/Github, and you can push and pull ... but you can also select "edit" and "merge" and use it fairly WYSIWYG.

Shortcut for switching between public and private versions of the same page

Switching between the public and private versions of GitBook (while maintaining the same relative page) is a pain.

Semi-automate: going from the editable to the public version with a 'bookmarklet'

Setting the following as a ‘bookmark’ seems to help (Chrome: bookmarks manager, edit any existing bookmark by right click --> edit)

Name: “Switch to Public GitBook page” (or whatever)

URL: set to:

To go in the other direction (public to editable version of a page)

Setting the following as a "bookmark" seems to help (chrome: bookmarks manager, edit any existing bookmark by right click --> edit)

Name: “Switch to Editable GitBook page” (or whatever)

URL: set to:

Team members: see also for a quick guide to 'the things you need to access and use'

: Overview of the tools and solutions the Unjournal uses, is building, and needs

: Where we host the evaluation output and submission/editorial management processes

(See also )

See Gdocs