Syras vs Rayyan

This article provides a simple comparison of Syras and Rayyan. Both of these products are cloud solutions – no installation or software management on your computer – and each has it's pros and cons.

Summary

Syras is a modern, low cost, flexible product for screening abstracts in a variety of situations, from dissertations to Cochrane systematic reviews. Syras is self-funded, and bought by academics.

Rayyan is a freemium, low cost screening solution, good for simple situations. Rayyan was funded by the Qatar foundation, and claims ownership of all content (including screening responses) in their fine print, so keep this in mind.

Comparison table

Syras Rayyan
Pricing $30USD per review (double)
$80USD per review (team)
Free option
$4+USD per month paid
Workflow steps covered Screening
Full text review
Data extraction (for Cochrane)
Screening
Notable Pros / Cons + Fully featured solution (for medical reviews)
+ Institutional licenses
- Rigid format, limited configurability
- Expensive annual subscription model
+ Free option
- Risky data policy: they keep + can reuse your screening data
- Poor design
- Screening process only

Workflow

Systematic reviews have three high level stages, with steps inside each stage. Here’s our summary from a blog post we wrote about the definition of a systematic review.

Let’s look at how these three products differ in what they offer, within this workflow.

Systematic review step Syras Rayyan
Step 1 & 2 - Decide on your research question This is all you! This is all you!
Step 3 – Search for all potentially relevant articles - No support - No support
Step 4 – Title and abstract screening + Great support + Great support
Step 5 – Full text screening - No support ? Possible, but tedious compared to Endnote.
Step 6 – Data extraction - No support - No support
Step 7 – Synthesis This is all you! This is all you!
Step 8 – Write your paper This is all you! This is all you!

That looks pretty bleak, but there are a couple of things worth noting:

  • 80% of the repetitive, tedious, painful, error-prone effort is within steps 4, 5, and 6.

  • There are lots of other software solutions that support the rest of the workflow. Products like Endnote, and even Excel or Google Docs can be used successfully for the other workflow steps.

Breaking down the Title and Abstract screening step

There are actually a number of steps within the step here, where we can really compare the products.

Title and Abstract screening step Syras Rayyan
Import articles + Refman RIS (.ris)
Medline / Pubmed (.nbib)
Endnote XML
Endnote JSON
EndNote Export (.enw)
 Refman RIS (.ris)
CSV
PubMed XML
Remove duplicates from multiple imports Multiple manual scans allowed, using algorithmic approaches, with bulk resolution.
Less likely to leave some duplicates than both
Automatically checked, opaque rules, record-by-record resolution. (They recommend doing deduplication in Endnote)
Screening - interface Ergonomically designed, high-efficiency interface with shortcut keys Cluttered and complex screening interface
Screening - keyboard shortcuts Configurable shortcut keys Specified shortcut keys
Screening - Highlight keywords Supported Supported
Screening - Screening criteria Supported, as hints, or an interactive check-list Support, as “exclusion reasons”
Screening with a team of researchers Structured + tracked allocation of screening work between sub-teams Unstructured approach - requires effort to coordinate
Resolving disagreements Specific workflow within assigned sets, or across entire corpus Completed by unblinding, and changing original votes
Exporting Refman, RIS (.ris), Medline / Pubmed (.nbib), Endnote CSV (with comments, ratings, etc) Refman, RIS (.ris), Medline / Pubmed (.nbib), Endnote, CSV
Knowledge-base / Help docs Support, knowledge base with Youtube videos Community support, knowledge base, Youtube videos
Non-Cochrane screening approaches Corpus Cleanup for preparing corpus Super-fast title-only screening

In a nutshell

Syras

The product: Syras is a flexible screening tool, useful in a variety of scenarios, including smaller scale pieces of work like dissertations, yet powerful enough to work well with a team doing a Cochrane review. Payment is per-project, and not subscription based, which aligns with the expectations of academics funding their work.

Syras is reasonably priced, and is sold to the academics doing the reviews. To thrive, Syras will need to be a pleasure to use for academics. Expect this aspiration to be a constant into the future.

The company: The Scipilot (the makers of Syras) mission is about accelerating the scientific process.\

Accelerate the scientific process, for the betterment of humanity.

Scipilot mission

While both Covidence and Rayyan are born from the world of academia, Syras is delivered by two tech-sector veterans, wanting to apply their experience to academic software. With loose ties to academia, they’re approaching things with a different perspective, looking for new and innovative ways to improve the scientific process.

Scipilot is based in Australia.

Sign up for your free account and start demo project

Rayyan

The product: Rayyan provides a free tool to get through the screening process of your systematic review. It’s great for small scale reviews, but has limited configurability, and a fairly rough interface. If good looks, and the privacy of your review data aren’t important to you, it’s a good solution for you.

The company: Rayyan’s mission is about accelerating scientific discovery.

Rayyan Systems Inc. is a leading provider of collaboration and research tools that power the global research community in pursuit of accelerated scientific discovery.

Rayyan - About

It’s worth noting that “Rayyan was developed through the Qatar Computing Research Institute, funded by the Qatar Foundation, a nonprofit that supports education, science, research, and community development initiatives in Qatar.” (source), and as part of the Rayyan terms, there is a fairly sweeping clause around “ownership and content", which gives them ownership rights on content you upload, including content such as comments in a review.

When products are free, you are probably the product. This idiom holds true for almost all products. While it’s difficult to be certain, it’s hard to not wonder, when reading the Rayyan fine-print.

Previous
Previous

Introducing Corpus Cleanup and Syras 2.0

Next
Next

Syras vs. Covidence