Overcoming algorithm aversion: A comparison between process and outcome control

L Cheng, A Chouldechova - Proceedings of the 2023 CHI Conference …, 2023 - dl.acm.org
Algorithm aversion occurs when humans are reluctant to use algorithms despite their
superior performance. Studies show that giving users outcome control by providing agency …

On the state of reporting in crowdsourcing experiments and a checklist to aid current practices

J Ramírez, B Sayin, M Baez, F Casati… - Proceedings of the …, 2021 - dl.acm.org
Crowdsourcing is being increasingly adopted as a platform to run studies with human
subjects. Running a crowdsourcing experiment involves several choices and strategies to …

Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19

K Roitero, M Soprano, B Portelli, M De Luise… - Personal and Ubiquitous …, 2023 - Springer
Recently, the misinformation problem has been addressed with a crowdsourcing-based
approach: to assess the truthfulness of a statement, instead of relying on a few experts, a …

Collect, measure, repeat: Reliability factors for responsible AI data collection

O Inel, T Draws, L Aroyo - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
The rapid entry of machine learning approaches in our daily activities and high-stakes
domains demands transparency and scrutiny of their fairness and reliability. To help gauge …

The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and Guidelines

J Oppenlaender, T Abbas, U Gadiraju - … of the ACM on Human-Computer …, 2024 - dl.acm.org
Pilot studies are an essential cornerstone of the design of crowdsourcing campaigns, yet
they are often only mentioned in passing in the scholarly literature. A lack of details …

Task design for crowdsourced glioma cell annotation in microscopy images

S Schwarze, NS Schaadt, VMG Sobotta, N Spicher… - Scientific Reports, 2024 - nature.com
Crowdsourcing has been used in computational pathology to generate cell and cell nuclei
annotations for machine learning. Herein, we broaden its scope to the previously unsolved …

It's about time: a view of crowdsourced data before and during the pandemic

E Christoforou, P Barlas, J Otterbacher - … of the 2021 CHI Conference on …, 2021 - dl.acm.org
Data attained through crowdsourcing have an essential role in the development of computer
vision algorithms. Crowdsourced data might include reporting biases, since crowdworkers …

Towards explainable automatic knowledge graph construction with human-in-the-loop

B Zhang, A Meroño Peñuela… - HHAI 2023: Augmenting …, 2023 - ebooks.iospress.nl
Abstract Knowledge graphs are important in human-centered AI because of their ability to
reduce the need for large labelled machine-learning datasets, facilitate transfer learning …

DREC: towards a Datasheet for Reporting Experiments in Crowdsourcing

J Ramírez, M Baez, F Casati, L Cernuzzi… - … Publication of the 2020 …, 2020 - dl.acm.org
Factors such as instructions, payment schemes, platform demographics, along with
strategies for mapping studies into crowdsourcing environments, play an important role in …

On the impact of predicate complexity in crowdsourced classification tasks

J Ramírez, M Baez, F Casati, L Cernuzzi… - Proceedings of the 14th …, 2021 - dl.acm.org
This paper explores and offers guidance on a specific and relevant problem in task design
for crowdsourcing: how to formulate a complex question used to classify a set of items. In …