Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data

Authors

  • Nisha Pillai University of Maryland, Baltimore County
  • Cynthia Matuszek University of Maryland, Baltimore County
  • Francis Ferraro University of Maryland, Baltimore County

DOI:

https://doi.org/10.32473/flairs.v34i1.128450

Keywords:

robotics, natural language processing, multimodal, complexity

Abstract

The success of grounded language acquisition using perceptual data (e.g., in robotics) is affected by the complexity of both the perceptual concepts being learned and the language describing those concepts. We present methods for analyzing this complexity, using both visual features and entropy-based evaluation of sentences. Our work illuminates core, quantifiable statistical differences in how language is used to describe different traits of objects, and the visual representation of those objects. The methods we use provide an additional analytical tool for research in perceptual language learning.

Downloads

Published

2021-04-18

How to Cite

Pillai, N., Matuszek, C., & Ferraro, F. (2021). Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data. The International FLAIRS Conference Proceedings, 34. https://doi.org/10.32473/flairs.v34i1.128450

Issue

Section

Main Track Proceedings