RT Dissertation/Thesis
T1 Novel Distributional Reinforcement and Ensemble Learning Algorithms.
A1 Aziz, Vanya
K1 Robótica - Tesis doctorales
K1 Programación lineal
K1 Aprendizaje automático (Inteligencia artificial)
K1 Redes neuronales (Informática)
AB This dissertation focuses on Deep Reinforcement Learning (DRL), a neural network-based approach for solving Markov Decision Processes in high-dimensional spaces with unknown transition dynamics. The main contribution of this thesis is the development of a novel state-of-the-art distributional reinforcement learning algorithm within the maximum-entropy Actor-Critic framework. This algorithm, termed ”Cram´er-based Soft Distributional Soft Actor-critic” (C-DSAC), demonstrates superior performance to other RL algorithms, especially in environments with high-dimensional spaces and complex dynamics.Its performance is shown to be partly rooted in a phenomenon arising in Cram´er-metric-based Distributional Reinforcement Learning, referred to as confidence-driven model updates. This mechanism ensures that the value function approximator is updated more conservatively when confidence in its estimates is low. Theoretical justifications for the algorithm are provided, demonstrating its convergence in the policy evaluation setting and, under widely accepted mild assumptions, in the control setting as well. Beyond foundational algorithmic research, this thesis contributes to the practical application of RL in robotics. Given the crucial role of multi-joint roboticsystems in modern production technology, a RL meta-algorithm called ”Reinforcement Learning - Inverse Kinematics” (RL-IK) is devised. This approach enhances the applicability of reinforcement learning to robotic control tasks by significantly accelerating convergence to near-optimal policiescompared to standard RL methods. An essential prerequisite for real-world RL applications in control systems is machine perception for state identification. To address challenges in this field, this thesis explores novel Supervised Learning (SL) approaches, validated on image classification tasks,with a focus on ensemble learning strategies.
PB UMA Editorial
YR 2025
FD 2025
LK https://hdl.handle.net/10630/39287
UL https://hdl.handle.net/10630/39287
LA eng
DS RIUMA. Repositorio Institucional de la Universidad de Málaga
RD 20 ene 2026