RT Journal Article
T1 Synthetized Multilanguage OCR Using CRNN and SVTR Models for Realtime Collaborative Tools
A1 Biró, Attila
A1 Cuesta-Vargas, Antonio
A1 Martín-Martín, Jaime
A1 Szilágyi, László
A1 Miklós Szilágyi, Sándor
K1 Diagnosticos
K1 Dispositivos ópticos de reconocimiento de caracteres
AB Background: Remote diagnosis using collaborative tools have led to multilingual joint working sessions in various domains, including comprehensive health care, and resulting in more inclusive health care services. One of the main challenges is providing a real-time solution for shared documents and presentations on display to improve the efficacy of noninvasive, safe, and far-reaching collaborative models. Classic optical character recognition (OCR) solutions fail when there is a mixture of languages or dialects or in case of the participation of different technical levels and skills. Due to the risk of misunderstandings caused by mistranslations or lack of domain knowledge of the interpreters involved, the technological pipeline also needs artificial intelligence (AI)-supported improvements on the OCR side. This study examines the feasibility of machine learning-supported OCR in a multilingual environment. The novelty of our method is that it provides a solution not only for different speaking languages but also for a mixture of technological languages, using artificially created vocabulary and a custom training data generation approach. Methods: A novel hybrid language vocabulary creation method is utilized in the OCR training process in combination with convolutional recurrent neural networks (CRNNs) and a single visual model for scene text recognition within the patch-wise image tokenization framework (SVTR). Data: In the research, we used a dedicated Python-based data generator built on dedicated collaborative tool-based templates to cover and simulated the real-life variances of remote diagnosis and co-working collaborative sessions with high accuracy. The generated training datasets ranged from 66 k to 8.5 M in size. Twenty-one research results were analyzed. Instruments: Training was conducted by using tuned PaddleOCR with CRNN and SVTR modeling and a domain-specific, customized vocabulary. [...]
PB MDPI
YR 2023
FD 2023-03-30
LK https://hdl.handle.net/10630/26967
UL https://hdl.handle.net/10630/26967
LA eng
NO Biró A, Cuesta-Vargas AI, Martín-Martín J, Szilágyi L, Szilágyi SM. Synthetized Multilanguage OCR Using CRNN and SVTR Models for Realtime Collaborative Tools. Applied Sciences. 2023; 13(7):4419. https://doi.org/10.3390/app13074419
NO Partial funding for open access charge: Universidad de Málaga
DS RIUMA. Repositorio Institucional de la Universidad de Málaga
RD 20 ene 2026