Crowd-sourced reliability of an assessment of lower facial aging using a validated visual scale

JD Kelly, B Comstock, TM Kowalewski… - … Surgery–Global Open, 2021 - journals.lww.com
Background: Reliable and valid assessments of the visual endpoints of aesthetic surgery
procedures are needed. Currently, most assessments are based on the opinion of patients …

[PDF][PDF] Annotation quality framework-accuracy, credibility, and consistency

L Lavitas, O Redfield, A Lee, D Fletcher… - … 2021 Workshop for …, 2021 - datacentricai.org
Success of many machine learning and offline measurement efforts is highly dependent on
the quality of labeled data that they use. Development of supervised machine learning …

Metric Space Indices for Dynamic Optimization in a Peer to Peer-Based Image Classification Crowdsourcing Platform

F Loor, V Gil-Costa, M Marin - Future Internet, 2024 - mdpi.com
Large-scale computer platforms that process users' online requests must be capable of
handling unexpected spikes in arrival rates. These platforms, which are composed of …

Rethinking and Recomputing the Value of Machine Learning Models

B Sayin, J Yang, X Chen, A Passerini, F Casati - 2024 - researchsquare.com
In this paper, we contend that the conventional approach to training and evaluating machine
learning models frequently overlooks their application within the real-world organizational or …

A Crowdsourcing Based Framework for Sentiment Analysis: A Product Reputation

F Zohra Ennaji, A El Fazziki… - … Software and Systems, 2020 - hrcak.srce.hr
Sažetak As social networking has spread, people started sharing their personal opinions
and thoughts widely via these online platforms. The resulting vast valuable data represent a …

Active learning from crowd in document screening

E Krivosheev, B Sayin, A Bozzon, Z Szlávik - arXiv preprint arXiv …, 2020 - arxiv.org
In this paper, we explore how to efficiently combine crowdsourcing and machine intelligence
for the problem of document screening, where we need to screen documents with a set of …