Forte Case Study

Improving Forte Worker Docs

Improving Forte Worker Docs
Name
Notes
1
Introduction to Forte
Open
2
Getting Started
Open
3
Updating Profile
Open
4
Navigation
Open
5
Skill Path
Open
6
Remote Work Flexibility
Open
7
Community Guidelines
Open
8
Community Channels
Open
9
Privacy Policy
Open
10
Challenge Projects
Open
11
FAQs
Open
12
Release Notes
Open
13
Terminology Page
Open
There are no rows in this table

Release Notes

Version 1.1 (August 9, 2024)

Minor Updates
Count elapsed time continuously in Forte
Previously, the elapsed time would only count up when the screen was actively focused. This was not ideal for projects that required workers to switch tabs to reference external resources needed to accomplish objective of task. Now it will count as long as the task is open.
Allowed editing connected batches
There was a high impact bug that deleted connected batch submission data when editing it. It has been fixed
There was a bug where updating the connected batch would regenerate the task data, causing the loss of all corresponding assignment and submission data. The team had to restore from a backup to recover this. Now, managers can safely edit a connected batch without this issue occurring.
Adjust est min per task in batch preview
Change Est min / task to Est time / task and show HH:MM:SS
Bug Fixes
Fixed bug that perpetually pushes out “reminders” to complete onboarding
Fixed duplicated resulting from case sensitive emails

Version 1.2 (August 15, 2024)

Major Updates
A new approach to QA enables a small group of expert workers to review all submissions within a batch
Changes on the manager side include adding a field to the batch configuration to designate the worker group with access to the 'expert review' batch. Additionally, the submission status and feedback will be updated by these expert reviewers.
Changes on the worker side include a new workflow called Expert Review, which will resemble the Available Work section. Workers will have the ability to click on a batch, view all submissions, update the statuses of those submissions, and add feedback.
The form builder for data generation batches is a significant addition to Forte, impacting all projects involving data generation, such as prompt generation and GPQA. This feature allows project managers to create batches for data generation in a manner similar to Google Forms.
Manager-side changes involve updates to batch configuration, introducing a new data generation option during the task upload step. When this option is selected, project managers can use the form builder, which is anticipated to be much easier than the XML editor.
Allows managers to export table data from the worker DB, make changes and reupload to the worker DB to persist those changes
Export button above table will only download what is currently filtered
Changes made in spreadsheet will be changed in worker records if reuploaded using ‘import data’ feature
Discord invite link automatically included in the “Onboarding complete” email
Minor Updates
Added T&S to see Forte Groups workflow
Changed “Review applicants” to “Project Applications”
Organized projects alphabetically in worker DB
Made “First-name Last-name” searchable in worker DB
Added flagging to manager workflows
Allows managers to select ‘Reject type’ when rejecting worker
When rejecting a worker via Project applications or the Onboarding progress workflows in the worker database, a new field labeled 'Reject type' has been added.
Allows manager to reject worker in onboarding phase
Removed some irrelevant statuses from peer review
Document upload form
Adding a google form hooked up to the appscript automation to handle re-uploading tax form, cv, resume
Bug Fixes
Capped size of table for Submissions
Fixed occasional Zoho sign issue (sign request not being sent)

Version 1.3 (September 2, 2024)

Major Updates
When discord roles are changed on the worker DB (manually or when application is approved), they are reflected in discord
Minor Updates
Added discord username to Expert review submission table
The numbers associated with breaking down workers submissions by status now updates every 5 seconds
View historical applications in worker DB, and filter by application status
Bug Fixes
Bulk review fix — uploading bulk review in Batch > Submissions was failing

Version 1.3.5 (September 13, 2024)

Minor Updates
Added assignment_id to submission download
Added payment fields to worker db (IFS code, Institution number, Transit number)
Validate XML configuration in the batch configuration
Removed expert review from manager navigation options
Changed Batch status name for ‘Draft’ to ‘Prototype’
Added number input to form builder
Bug Fixes
Fixed account manager lookup (some people were not showing in search) in requester create / update flows
Fixed submission download errors due to bounding box, empty submissions, and data normalization
Fixed task variables not mapping to XML editor in batch configuration
Ensure updated at time is updated when a submission is reviewed
Fixed banking form so ‘Payoneer email’ information is saved correctly

Version 1.3.6 (September 19, 2024)

Minor Updates
Compatibility improvement necessary to service Carbon Coal
Managers can now indicate whether a batch contains multi-part tasks in the batch configuration and specify if the batch is compensated per part within the same configuration.
Worker-side changes, when applicable, include the ability to grade submissions in parts for QA batches and the option to view submissions graded by part.
Bug Fixes
Fixed XML editor not showing the appropriate comment with the actual variables from the task upload step
Fixed issues where submissions would occasionally be duplicated when submitted
Fixed forgot-password redirect url in forte-development
Added attachment urls (from file upload via form builder) to submission download
Fixed issue that prevented connected tasks from downloading correctly
Fixed issue where worker would get logged out of Forte mid-task

Version 1.3.7 (September 24, 2024)

Major Updates
Infrastructure related to compensation tracking
All projects, will need time to test. Will not require compliance, no frontend changes. This is just setting us up for future contributions to track compensation automatically through Forte.
Minor Updates
Added “To be paid” submission status
Added partial compensation rate to submissions
This is a field to document ‘partial compensation’ for submissions that are not subject to full compensation (because they did not meet acceptance criteria through QA). It does not affect any automations.
Bug Fixes
Fixed issue where worker gets logged out mid task
Fixed E&A permissions to see batch preview
Fixed bulk review to use statuses that are case insensitive

Version 1.7 (October 7, 2024)

Minor Updates
Buttons will be disabled when they are loading to prevent triggering the same action multiple times, which can cause issues
Show all submissions in expert review
Bug Fixes
Duplicating a batch will now preserve the labeling configuration, as the labeling XML was previously not included in the duplicate
Fixed the notification spacing
Fixed blacklisted workers holding up editing groups

Version 2.0 (October 21, 2024)

Minor Updates
Added compensation for rejected submissions (optional)
Added support group to available work / batch preview
Bug Fixes
Fixed issue where expert worker cannot flag submission




Draft

Getting Started
Introduction Page
About Forte
Short Intro Indicating Forte Purpose
What it allows you to do
Quick start guide
How to log in
How to update their profile.
Terminology Page
Code of Conduct Page
Community Page
FAQ Page
Navigation

Key Features

Skill Path

Challenge Projects

Release Notes


Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.