The Metadata Authors Write Themselves: A Content Analysis of arXiv Comment Fields

Preprint servers, like arXiv, are an important component in contemporary scholarly communication system. While various aspects of preprint repositories have been studied, author-supplied comments remain an understudied area. We conducted a content analysis of arXiv comments across three Computer Science subfields (Artificial Intelligence, Computer Vision, and Machine Learning) from 2015 to 2024 to examine what information authors provide and how practices vary across communities and over time. Our analysis of 1,500 manuscripts reveals that comments related to document dimensions, such as page and figure counts, are the most prevalent category, suggesting authors perceive a gap in arXiv’s native metadata interface. Additionally, comments linking manuscripts to project pages and code repositories have grown steadily over the past decade, reflecting the influence of the Open Science movement. These findings point to concrete opportunities for enhancing digital library systems with structured, optional metadata fields that better support author needs and improve machine-readability.