RT Journal Article
T1 Adapting LLMs for Satellite Communications: Methodology, Challenges, and Impact.
A1 Mozo-Quesada, Alejandro Jesús
A1 Gálvez-Rojas, Sergio
A1 Christou, Ioannis
A1 Vogiatzis, Dimitrios
A1 Navarro, Tomás
A1 López-Valverde, Francisco
K1 Inteligencia artificial
K1 Aprendizaje automático (Inteligencia artificial)
K1 Comunicaciones vía satélite
K1 Proceso en lenguaje natural (Informática)
AB The application of large language models (LLMs) to specialized fields, such as Satellite Communications (SatCom), presents unique challenges due to the extensive and cutting-edge knowledge required. SatCom encompasses a wide range of technical details, protocols, and operational guidelines that must be addressed to produce effective and accurate models for practical use. This paper presents a fine-tuning approach for adapting 7-billion-parameter instructed LLMs (Llama-3v and Mistral) to SatCom, using a proprietary corpus sourced from the European Space Agency (ESA) consisting of domain-specific PDF documents. The confidential nature of this corpus imposes constraints on both model training and evaluation, demanding a sensible text extraction pipeline capable of handling complex structures, such as tables, to preserve critical information. Our fine-tuning methodology employs a carefully configured process, followed by an automatic evaluation framework using a curated Q&A set tailored to SatCom. Models were created in both non-quantified and 8-bit quantized formats, ensuring feasibility for desktop-level inference. The fine-tuned models demonstrated a 6,6% improvement over the baseline LLM, as well as significant gains when compared to retrieval-augmented generation (RAG) methods. These results indicate a promising advancement in the development of LLMs for domain-specific applications within the SatCom field.
PB IEEE
YR 2025
FD 2025-09-02
LK https://hdl.handle.net/10630/39759
UL https://hdl.handle.net/10630/39759
LA eng
NO A. Mozo, S. Gálvez, L. T. Christou, D. Vogiatzis, T. Navarro and F. L. Valverde, "Adapting LLMs for Satellite Communications: Methodology, Challenges, and Impact," in IEEE Access, doi: 10.1109/ACCESS.2025.3605022.
NO Agencia Espacial Europea
DS RIUMA. Repositorio Institucional de la Universidad de Málaga
RD 3 mar 2026