Cross-modal generalization: Learning in low resource modalities via meta-alignment

PP Liang, P Wu, L Ziyin, LP Morency… - Proceedings of the 29th …, 2021 - dl.acm.org
How can we generalize to a new prediction task at test time when it also uses a new
modality as input? More importantly, how can we do this with as little annotated data as …

Brainish: formalizing a multimodal language for intelligence and consciousness

PP Liang - arXiv preprint arXiv:2205.00001, 2022 - arxiv.org
Having a rich multimodal inner language is an important component of human intelligence
that enables several necessary core cognitive functions such as multimodal prediction …

[引用][C] Learning in Low-resource Modalities via Cross-modal Generalization