In Search of a Lightweight "Good Enough" Offline Generative AI for Mobile Robots: Performance Benchmarking

Authors

  • Yegin Genc Pace University
  • Gonca Altuger-Genc Farmingdale State College
  • Akin Tatoglu University of Hartford

DOI:

https://doi.org/10.32473/flairs.38.1.138943

Keywords:

Robotics, Offline LLM, Resource Constraints, Performance Benchmarking, Edge Computing

Abstract

We present a novel benchmarking methodology for evaluating offline Large Language Models (LLMs) in resource-constrained mobile robotics applications. Using an Nvidia Jetson Nano platform with 4GB RAM limitation, we demonstrate the feasibility of deploying tuned ChatGPT4All for robotic control tasks. The model, trained on 22,000+ ICRA proceedings papers, achieves 82% similarity to ChatGPT responses while maintaining sub-second inference time. Our evaluation framework combines TF-IDF similarity scoring and LDA topic coherence analysis across several thousand test cases. Results show consistent performance within hardware constraints, with 92% of responses exceeding 0.80 similarity threshold and 98% completing within one second. This study establishes viability of lightweight LLMs for offline mobile robotics applications, providing a foundation for future resource-aware AI deployments.

Downloads

Published

14-05-2025

How to Cite

Genc, Y., Altuger-Genc, G., & Tatoglu, A. (2025). In Search of a Lightweight "Good Enough" Offline Generative AI for Mobile Robots: Performance Benchmarking . The International FLAIRS Conference Proceedings, 38(1). https://doi.org/10.32473/flairs.38.1.138943

Issue

Section

Special Track: Applied Natural Language Processing