[Context] Freelancers could catalyze the software development process by providing their niche skills to generate high quality outputs. They could help companies (including startups) …
When crowdsourcing the creation of machine learning datasets, statistical distributions that capture diverse answers can represent ambiguous data better than a single best answer …
Professional designers and developers often struggle when transitioning between the design and implementation of an interactive system. We conducted three studies that …
With the widespread availability and pervasiveness of artificial intelligence (AI) in many application areas across the globe, the role of crowdsourcing has seen an upsurge in terms …
Expert investigators bring advanced skills and deep experience to analyze visual evidence, but they face limits on their time and attention. In contrast, crowds of novices can be highly …
Web design is a complex and challenging task. It involves making many design decisions that materialise preconceived notions of user needs that may or may not be true. In this …
In this work we explore confidence elicitation methods for crowdsourcing" soft" labels, eg, probability estimates, to reduce the annotation costs for domains with ambiguous data …
S Wallace, T Cai, B Le, LA Leiva - CHI Conference on Human Factors in …, 2022 - dl.acm.org
Human Intelligence Tasks (HITs) allow people to collect and curate labeled data from multiple annotators. Then labels are often aggregated to create an annotated dataset …
Similar to a design process for designing graphical user interfaces, conversation designers often apply an iterative design process by defining a conversation flow, testing with users …