Label and annotate data
After you set up your project, configure your labeling interface, and import your data, you can start labeling and annotating your data.
Tip
Before you begin, you can filter or sort the data. Enable Sequential Sampling to ensure that the tasks in the label stream are shown in the same order they appear in the Data Manager.
Start labeling
There are several ways you can begin labeling tasks:
Quick view–Manually select each task to label.
From the Data Manager list view, click a task to open the labeling interface.
Label stream–As you finish each task, you move on to the next task automatically. You are shown all incomplete tasks within the project.
From the Data Manager, click Label All Tasks to enter the label stream. You are also shown additional navigation actions such as Skip and Save and Submit.
Label stream with a filter applied–Similar to the label stream, but you are only shown the incomplete tasks that are visible in the Data Manager.
First, apply a filter using the Data Manager. Then click the drop-down arrow next to Label All Tasks and select Label Tasks as Displayed.
Label stream for selected tasks–Similar to the label stream, but first you select the checkboxes next to the tasks you want to label.
When one or more tasks are selected, click Label n Tasks at the top of the Data Manager.
note
When labeling tasks, you should not open the label stream simultaneously in two tabs. This could result in you receiving the same task twice, which can circumvent project settings that address annotator overlap.
Label a region
Click on a label and then click on the text/image/video/other data to begin labeling. They type of tools available to you depend on the labeling configuration.
For more information, see Label regions.
Reset an annotation
You can reset your working copy of an annotation by clicking the reset action at the bottom of the labeling interface:
Resetting an annotation removes all regions and relations in your working copy. It does not affect comments and does not affect the annotation history.
Resetting only affects work done in the current working copy of the annotation and does not affect work that has been previously saved as a draft.
For example, if you add a region, leave the task (automatically saving a draft), and then return to the task, clicking Reset does not remove the region you previously added.
However, if you add a new region, the new region becomes part of your working copy. Clicking reset would remove this region.
Delete an annotation
When you delete an annotation, you delete everything that is included with the annotation - labels, regions, comments, drafts, etc.
- From the Data Manager, click a task to open it in Quick View.
- Click the overflow menu next to the task ID that appears above the task.
- Select Delete Annotation.
To delete all annotations across all tasks, use the Actions menu available from the Data Manager.
Label with collaborators
In both Label Studio and Label Studio Enterprise, you can label tasks with collaborators. Tasks are locked while someone performs annotations so that you don’t accidentally overwrite the annotations of another annotator. After the other annotator finishes with the task, it can appear in your queue for labeling if the minimum annotations per task is set to more than one. By default, tasks only need to be annotated by one annotator.
If you want to label tasks more than once, even if the minimum annotations required is set to one, do the following:
To label tasks multiple times while the minimum annotations required is set to one, do the following:
- In the data manager for the project, click a task to open the quick labeling view.
- Click the
+icon next to the task annotation ID to open an annotation tab. - Label the task.
- Click Submit to save your annotation.
- Click the next task in the data manager to open the quick labeling view for that task and repeat steps 2-4.