Supporting Dynamic Construction of Datasets with Annotator Suggestions

Abstract

The construction process for machine learning datasets is costly for experts as it requires going through multiple iterations to build a label set and communicating and resolving issues with annotators. To make the process more efficient for experts, we propose DynamicLabels, which allows experts to refine the dataset structure with label set suggestions collected by the annotators.