TabSOM: A tabular-to-image encoding method based on self-organizing maps

TL;DR

TabSOM leverages Self-Organizing Maps to encode tabular data into images, achieving top classification performance and interpretability across multiple datasets.

cs.CV 🔴 Advanced 2026-08-14 90 views
David Chushig-Muzo María Ángeles Rodríguez de Cara Eva Milara Francisco J. Lara-Abelenda Luis Zhinin-Vera Diego H. Peluffo-Ordóñez
deep learning tabular data encoding self-organizing map interpretability image representation

Key Findings

Methodology

TabSOM employs a self-organizing map (SOM) to preserve the topological structure of feature space, extracting component planes for each feature. It assigns features to fixed positions on an image canvas via a collision-free Hungarian algorithm, ensuring meaningful spatial layout. The feature relationship graph, built from the SOM's prototype geometry using Pearson correlation, captures pairwise interactions. Multi-scale Gaussian kernels generate node channels at different bandwidths, providing both precise localization and regional coherence. The framework introduces two interpretability tools: class-separation importance scores and prototype-inspired partial dependence plots, leveraging the SOM's structure for global and local explanations. Extensive benchmarking on twelve public binary classification datasets demonstrates superior performance, stability, and interpretability compared to existing methods.

Key Results

  • On datasets like Pima Indians Diabetes and Wisconsin Breast Cancer, TabSOM achieved AUC-ROC scores of 0.8236 and 0.9911 respectively, outperforming most competitors. The overall mean AUC was 0.9024, ranking second, with the lowest standard deviation, indicating high stability across seeds.
  • Compared to twelve existing tabular-to-image methods, TabSOM consistently ranked at the top across all datasets, especially excelling in low-dimensional feature spaces such as the 8-feature Pima dataset. Its structured encoding outperformed random embedding-based techniques like t-SNE and UMAP, with significant margins.
  • Incorporating a feature relationship graph and multi-scale rendering, TabSOM effectively captures feature interactions and local-global patterns, leading to improved predictive accuracy and interpretability. The SOM-based explanations aligned well with established feature importance measures, validating their reliability.

Significance

This work addresses the longstanding challenge of balancing predictive performance and interpretability in tabular data modeling. By integrating topological preservation through SOM and explicit feature relationship encoding, it offers a robust framework that enhances model transparency without sacrificing accuracy. Such advancements are crucial for high-stakes domains like healthcare and finance, where understanding model decisions is as important as their accuracy. The approach bridges the gap between traditional structured data analysis and modern deep learning, paving the way for more trustworthy AI systems.

Technical Contribution

The core innovation lies in combining SOM-based topological mapping with a collision-free feature placement strategy via Hungarian assignment, ensuring meaningful spatial arrangements. The construction of a feature relationship graph from the SOM prototype geometry captures pairwise interactions, enriching the image representation. Multi-scale Gaussian rendering supports multi-level feature localization, while the SOM-derived interpretability tools enable comprehensive explanations. This integrated framework surpasses prior methods that rely solely on embedding-based layouts, offering both performance gains and interpretability enhancements.

Novelty

This research is the first to embed tabular features into images using SOM's topology-preserving properties, explicitly modeling feature relationships through a graph derived from prototype geometry. Unlike prior approaches that depend on t-SNE or UMAP embeddings, TabSOM leverages the interpretability and structural fidelity of SOM, providing a more meaningful spatial arrangement. The multi-scale rendering scheme further distinguishes it by capturing both fine-grained and regional information, leading to superior classification and explanation capabilities.

Limitations

  • The effectiveness of TabSOM depends heavily on the quality of SOM training; insufficient data or poor parameter tuning can lead to suboptimal topological mapping, affecting feature placement accuracy.
  • In high-dimensional feature spaces, the construction of the feature relationship graph may be sensitive to noise, potentially introducing spurious interactions that degrade model performance.
  • Multi-scale Gaussian rendering increases computational complexity, which might limit real-time applications on large datasets.
  • Currently optimized for binary classification, extending to multi-class or regression tasks requires further validation and adaptation.

Future Work

Future research will focus on adaptive SOM training strategies to improve topological fidelity, integrating dynamic graph learning to capture complex feature interactions, and exploring graph neural networks (GNNs) to enhance relational modeling. Additionally, extending the framework to multi-class classification and regression, as well as optimizing computational efficiency for large-scale data, are promising directions. Applying TabSOM to multimodal data and temporal sequences could further broaden its applicability, especially in fields like medical diagnostics and industrial monitoring.

AI Executive Summary

In the era of data-driven decision-making, structured tabular data remains the backbone of many critical applications in healthcare, finance, and industry. Despite the success of deep learning models in unstructured data like images and text, their application to tabular data has faced significant hurdles. Traditional models such as gradient boosting machines and random forests excel at handling tabular data but lack transparency. Conversely, deep neural networks often struggle to capture complex feature interactions and rely on feature engineering or embedding techniques that obscure interpretability.

Recent advances have explored converting tabular data into image representations to leverage powerful convolutional neural networks (CNNs) and vision transformers (ViTs). These methods typically employ dimensionality reduction techniques like t-SNE, UMAP, or PCA to embed features into a 2D space, then generate images where spatial proximity reflects feature similarity. While effective in some cases, these approaches mainly encode marginal feature distributions, neglecting the relationships among features that are crucial for understanding the data structure and improving model robustness.

This paper introduces TabSOM, a novel encoding framework that harnesses the topology-preserving properties of self-organizing maps (SOMs). Unlike conventional embeddings, SOMs maintain the topological relationships of the original feature space, enabling a more meaningful spatial layout. The authors develop a collision-free feature placement strategy using the Hungarian algorithm, ensuring each feature occupies a distinct position on the image canvas based on its component plane. They further construct a feature relationship graph derived from the SOM's prototype geometry, capturing pairwise interactions that are embedded as spatial connections.

To enrich the representation, TabSOM employs multi-scale Gaussian kernels to render node channels at different bandwidths, balancing local detail and regional coherence. An additional relational edge channel encodes feature interactions, providing a comprehensive multi-channel image input for CNN classifiers. Extensive experiments across twelve public binary classification datasets demonstrate that TabSOM consistently outperforms existing methods in predictive accuracy, achieving the highest or second-highest AUC-ROC scores with minimal variance, indicating high stability.

Beyond performance, TabSOM emphasizes interpretability. The framework introduces two SOM-based tools: class-separation importance scores, which quantify how features differentiate classes, and prototype-inspired partial dependence plots, which visualize the influence of features within the learned topological structure. These explanations align well with established importance measures like SHAP and feature importance from tree models, validating their reliability.

Overall, TabSOM bridges the gap between high predictive performance and interpretability in tabular data modeling. By integrating topological preservation, feature relationship encoding, and multi-scale spatial rendering, it offers a robust, explainable, and scalable solution. Its potential impact spans healthcare diagnostics, financial risk assessment, and industrial process monitoring, where understanding model decisions is as vital as their accuracy. Future work aims to extend the framework to multi-class tasks, incorporate dynamic graph learning, and optimize computational efficiency, further broadening its applicability in real-world scenarios.

Deep Dive

Abstract

Tabular-to-image methods have emerged as novel approaches to leverage the high predictive performance of convolutional neural networks and vision transformers. They convert tabular data into image representations, mapping each feature at a fixed pixel location derived from a dimensionality-reduction method (e.g., t-SNE, UMAP, PCA). However, they encode only the marginal value of each feature and discard information about feature relationships. We propose TabSOM, a tabular-to-image encoding built on the Self-Organizing Map (SOM), which provides: (i) a spatial layout in which every input feature occupies a fixed canvas position derived from its component plane via collision-free Hungarian assignment; and (ii) a graph that captures pairwise feature relationships derived from the SOM component planes. The resulting image stacks two multi-scale node channels: one encodes feature values at fixed scales, while the other encodes pairwise feature interactions as spatial connections between related features. Two SOM-derived interpretability approaches are introduced: a prototype-inspired partial dependence plot and a class--separation importance score. Benchmarked against twelve existing tabular-to-image methods across public binary-classification datasets, TabSOM ranks first or second on every dataset and achieves the lowest variance of any method evaluated. Interpretability obtained with TabSOM was validated against Random Forest, XGBoost, and SHAP, the class-separation score shows reasonable agreement with established baselines on the top-ranked features while capturing complementary structural information from input data. These results demonstrate that TabSOM provides an effective and interpretable approach for applying deep learning architectures to tabular data, bridging the performance--interpretability gap in this domain.

cs.CV cs.LG

References (20)

A comprehensive benchmark of spatial encoding methods for tabular data with deep neural networks

Jiayun Liu, M. Castillo-Cara, Raúl García-Castro

2025 5 citations ⭐ Influential

TINTO: Converting Tidy Data into image for classification with 2-Dimensional Convolutional Neural Networks

Manuel Castillo-Cara, Reewos Talla-Chumpitaz, R. García-Castro et al.

2023 13 citations ⭐ Influential

Transfer learning for a tabular-to-image approach: A case study for cardiovascular disease prediction

F. Lara-Abelenda, David Chushig-Muzo, Pablo Peiro-Corbacho et al.

2025 16 citations

A novel deep learning approach using blurring image techniques for Bluetooth-based indoor localisation

Manuel Castillo-Cara, Reewos Talla-Chumpitaz, L. Orozco-Barbosa et al.

2022 38 citations

Data-Driven Visual Characterization of Patient Health-Status Using Electronic Health Records and Self-Organizing Maps

David Chushig-Muzo, C. Soguero-Ruíz, A. Engelbrecht et al.

2020 24 citations

Converting tabular data into images for deep learning with convolutional neural networks

Yitan Zhu, T. Brettin, Fangfang Xia et al.

2021 240 citations

Tabular-to-Image Encoding Methods for Melanoma Detection: A Proof-of-Concept

Vanesa Gómez-Martínez, David Chushig-Muzo, Cristina Soguero-Ruíz

2026 2 citations

DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture

Alok Sharma, E. Vans, D. Shigemizu et al.

2019 402 citations

Topological Activation Maps for Visual Representation Learning from Tabular Data

M. Achutha, Bhaskarjyoti Das

2025 1 citations

Tab2Visual: Deep learning for limited tabular data via visual representations and augmentation

Ahmed Mamdouh, M. El-Melegy, Samia Ali et al.

2026 1 citations

Image-based vulnerability detection based on a hybrid deep learning model in the Industrial Internet of Things using convolution neural network and transformer architectures

Bilal Babayiğit, Mohammed Abubaker

2026 2 citations

Representation of features as images with neighborhood dependencies for compatibility with convolutional neural networks

Omid Bazgir, Ruibo Zhang, S. Dhruba et al.

2019 128 citations

Engineering applications of the self-organizing map

T. Kohonen, E. Oja, O. Simula et al.

1996 902 citations

Tab2Visual: Overcoming Limited Data in Tabular Data Classification Using Deep Learning with Visual Representations

Ahmed Mamdouh, M. El-Melegy, Samia Ali et al.

2025 4 citations View Analysis →

Self-Organizing Maps applied to ecological sciences

T. Chon

2011 211 citations

Towards efficient image-based representation of tabular data

Amit Damri, Mark Last, Niv Cohen

2023 20 citations

MIMO-Based Indoor Localisation With Hybrid Neural Networks: Leveraging Synthetic Images From Tidy Data for Enhanced Deep Learning

M. Castillo-Cara, J. Martínez-Gómez, Javier Ballesteros-Jerez et al.

2025 10 citations

LM-IGTD: a 2D image generator for low-dimensional and mixed-type tabular data to leverage the potential of convolutional neural networks

Vanesa G'omez-Mart'inez, F. Lara-Abelenda, Pablo Peiro-Corbacho et al.

2024 9 citations View Analysis →

SuperTML: Two-Dimensional Word Embedding for the Precognition on Structured Tabular Data

Baohua Sun, Lin Yang, Wenhan Zhang et al.

2019 81 citations

Transforming tabular data into images via enhanced spatial relationships for CNN processing

H. Alenizy, Jawad Berri

2025 24 citations