Equi-vocal: Synthesizing queries for compositional video events from limited user interactions

E Zhang, M Daum, D He, B Haynes, R Krishna… - Proceedings of the …, 2023 - dl.acm.org
We introduce EQUI-VOCAL: a new system that automatically synthesizes queries over
videos from limited user interactions. The user only provides a handful of positive and …

MaskSearch: Querying Image Masks at Scale

D He, J Zhang, M Daum, A Ratner… - arXiv preprint arXiv …, 2023 - arxiv.org
Machine learning tasks over image databases often generate masks that annotate image
content (eg, saliency maps, segmentation maps, depth maps) and enable a variety of …

MetaStore: Analyzing Deep Learning Meta-Data at Scale

H Zhang, B Yan, L Cao, S Madden… - Proceedings of the …, 2024 - dl.acm.org
The process of training deep learning models produces a huge amount of meta-data,
including but not limited to losses, hidden feature embeddings, and gradients. Model …

Task Me Anything

J Zhang, W Huang, Z Ma, O Michel, D He… - arXiv preprint arXiv …, 2024 - arxiv.org
Benchmarks for large multimodal language models (MLMs) now serve to simultaneously
assess the general capabilities of models instead of evaluating for a specific capability. As a …

EQUI-VOCAL: Synthesizing Queries for Compositional Video Events from Limited User Interactions [Technical Report]

E Zhang, M Daum, D He, B Haynes, R Krishna… - arXiv preprint arXiv …, 2023 - arxiv.org
We introduce EQUI-VOCAL: a new system that automatically synthesizes queries over
videos from limited user interactions. The user only provides a handful of positive and …

AIDB: a Sparsely Materialized Database for Queries using Machine Learning

T Jin, A Mittal, C Mo, J Fang, C Zhang, T Dai… - Proceedings of the …, 2024 - dl.acm.org
Analysts and scientists are interested in automatically analyzing the semantic contents of
unstructured, non-tabular data (videos, images, text, and audio). These analysts have turned …

[PDF][PDF] AIDB: Unstructured Data Queries via Fully Virtual Tables

D Kang - 2023 - ddkang.github.io
Analysts and scientists are increasingly interested in automatically analyzing the semantic
contents of unstructured, non-tabular data. In order to extract semantic information, analysts …

[PDF][PDF] Towards an End-to-End Training Data Management System for Machine Learning Models

H Zhang - 2023 - digital.wpi.edu
A successful machine learning application requires powerful machine learning models and
high-quality training data. In recent years, the machine learning community has proposed …