All Collections
Getting Started
Test IO vs Other Testing Platforms
Comparison of uTest and Test IO Platforms for Testers
Comparison of uTest and Test IO Platforms for Testers

Quickly learn about the differences between uTest and Test IO platforms

Charlie avatar
Written by Charlie
Updated over a week ago

Motivation

Software testing plays a vital role in ensuring the quality and reliability of software products. Crowdsourced testing platforms like uTest and Test IO allow freelance testers to contribute their skills to various testing projects.

This article compares the differences between uTest and Test IO platforms, specifically focusing on the test processes, types of bugs, the severity of functional bugs, attachments, payouts and test communication.

Aspect

uTest

Test IO

Test Processes

uTest follows a structured test process that typically includes project onboarding, test case execution, bug reporting, and test cycle closure. Testers are assigned specific test cases and executed within the designated test environment. After execution, testers submit detailed bug reports to the platform.

If a bug report gets rejected, it negatively affects the tester's scores based on the type of rejection received.

Testers can dispute rejected bugs from customers.

Placeholders are forbidden.

Testers can use any registered device if it matches the test cycle requirements.

The Test Engineer selects the testers to participate in a test.

Test IO employs an agile test process that involves test planning, execution, and continuous feedback. Testers participate in test cycles that match their language, devices and location. We emphasize real-time and manual exploratory testing, enabling testers to discover and report bugs on the fly.

To start contributing to a test cycle, testers need to start test sessions in advance and acknowledge that the instructions of the features in scope were read and understood.

To identify duplicates, when submitting a bug, the ❝Similar bugs❞ list on the right-hand side of the bug form will show you the list of already submitted bugs in the current test, and you can also search and filter the bugs and Known Bugs list to do so.

If a bug report gets rejected, it negatively affects the tester's scores based on the type of rejection received.

Testers can dispute rejected bugs by Team Leaders. Once a report is disputed, it gets locked for review by the Bug Dispute Team.

Placeholder reports are highly forbidden.

Based on the devices registered in the Tester's Profile and other information, the system selects one of the devices and invites you to participate in the test. Depending on the seats left for each cycle, you may be unable to select a different device than the one the system chose. You cannot switch to another device once you have been invited to a device. Therefore, you can only submit bugs found on this device.

Bug form

The uTest bug form is structured as follows:

  1. Issue Type

  2. Frequency

  3. Priority

  4. Source

  5. Environment

  6. Actions Performed

  7. Expected Results

  8. Actual Results

  9. Error Messages

  10. Additional Environment Info

  11. Attachment.

Test IO's bug form, on the other hand, simplifies tester documentation with the following structure:

  1. Bug Title

  2. Type of bug with severity for functional bugs

  3. URL field (where the bug happens)

  4. Steps which are the actions performed

  5. Actual result

  6. Expected result.

  7. Attachments

You don't have to follow a specific format to construct a title. However, you must respond to what happened, where the bug occurred and when it triggered.

On our bug form, you don't have to add the step number; our form already provides it. You can drag them around and rearrange them at will.

Except for the browser while website testing, the device's information is retrieved from the device you selected when accepting to participate in a test cycle, which cannot be changed afterward.

Types of Bugs

uTest classify bugs such as:

  • Functionality

  • Usability

  • Security

  • Performance

  • Localization issues.

Testers are required to identify and report these bugs with accuracy.

Test IO categorizes bugs as:

  • Functional

  • Visual

  • Content

  • Usability

  • Test Case bugs.

We don't perform security tests.

Here are more specifications. Content bugs are related to every type of information, not only text (e.g., translations; typos are not reported), so missing images and buttons are content bugs rather than visual bugs.


Functional bugs considered performance, like endless loading can be regarded as functional bugs if they directly affect end-users, for instance, accessing content or progress over a task.

On the other hand, during performance test cycles, which are run as per demand, endless loading is a performance issue, and they are reported as such; therefore, measuring the internet speed and .har files is part of the attachments needed to attach to the report.

The Severity of Functional Bugs

uTest bug severity is:

  • Critical

  • High

  • Medium

  • Low

In which you decide which severity applies better to the issue.

At Test IO, we offer specific scenarios to guide you through the correct selection of the severity; these are only three:

  • Low

  • High

  • Critical

The scenarios we provide will help analyse the issue in different ways, such as considering the functionality compromised and the bug's potential impact on end-users. For instance, showstopper bugs are critical, while if there is an easy and intuitive workaround like reloading the page, the correct severity will be low.

The Attachments in Bug Report

uTest allows testers to attach relevant files, such as screenshots, screen recordings, and log files, to their bug reports.

Screenshots:

  • Highlight

  • JPG or PNG format.

  • Do not use a hand-drawing tool

  • Capture the complete screen

  • Close unnecessary tabs

  • Upright orientation.

Screencasts:

  • No noise

  • Entire screen

  • Must match actions performed

  • Only mp4 format

  • Keep it short

Test IO testers can include attachments, such as screenshots, screencasts, and crash logs.

Screenshots:

  • Highlight

  • JPG or PNG format.

  • We recommend not using hand drawing but shapes like squares, rectangles and arrows.

  • Capture the complete screen.

  • Unnecessary tabs or applications shouldn't be seen, but more importantly, Test IO customers' information must not be visible (e.g. notifications with a test cycle ID and customer's name)

  • The orientation shown in the screenshot should be the one user while testing.

Screencast:

  • No noise

  • Entire screen

  • The length for bug reports is 60 seconds, while for User Stories and reproductions is 15 seconds.

  • The steps recorded must be only the last navigational step, the action that triggers the bug and the bug itself.

  • Only mp4 format

  • Tap/touches/clicks must be visible on desktop and Android devices.

For performance testing, .har files are required.

Test Communication

uTest fosters communication between testers, project managers, and developers through a dedicated messaging system. Testers can seek clarifications on requirements and interact with stakeholders throughout the testing cycle.


Test IO emphasises real-time communication, enabling testers to collaborate and discuss issues through test chat, bug report comments, Discord server, and email platforms between testers, team leaders (TL), Customer Success Managers (CSMs), and customers. Testers can ask questions, seek clarifications, and receive instant feedback from the abovementioned stakeholders, as these can request information from testers' tasks.

Bug payout

uTest, the payout depends on how valuable the bug is:

  • Somewhat Valuable (Won't Fix)

  • Somewhat Valuable

  • Very Valuable

  • Exceptionally Valuable

Test IO payout depends on the type of task performed. There are tasks directly related to Test Cycles. In contrast, others, like Reproductions, Bug Fix Confirmation and Bug Report Confirmation, can be performed without joining the test cycle the report belongs to.

However, in a test cycle, the payout depends on the type and severity of the bug, as well as device specifications.

Paid Tasks & Bonuses

At uTest, testers can perform:

  • Test cases

  • Bug Reporting

  • Usability surveys


At Test IO, freelance testers can perform these paid tasks and receive the following bonuses:

  • Bug reporting

  • Bug reproduction

  • User Stories

  • Test cases

  • Bug fix confirmation

  • Bug Report confirmation

  • Participation in special projects bonus

  • Paid Activity Sessions

  • Purchase Reports

  • Test Feedback (paid in some rare cases)

  • Bug Like Bonus

Instead of waiting for the client to accept or reject your work at Test IO, you're being paid as soon as the Team Leader takes your bug or execution.

In conclusion, both uTest and Test IO platforms offer unique experiences for testers regarding test processes, bug types, severity assessment, attachments, and test communication.

There are several differences between uTest and Test IO. uTest follows a structured testing process with assigned test cases, and testers submit bug reports using a structured form. Testers can dispute rejected bugs, but the rejection affects their scores. In contrast, Test IO prioritizes real-time exploratory testing and engages testers in continuous feedback and collaboration during test cycles matching their profile. Test IO streamlines the bug reporting process with simplified bug titles, types, and severity levels, allowing for the rearrangement of steps. The payment schemes also differ, with uTest categorizing bug values and Test IO basing payouts on task types, severity, and device specifications. Communication channels and payment timing also differ between the two platforms.

Testers are critical in enhancing software quality and ensuring end-user satisfaction regardless of the platform.

Did this answer your question?