TabSOM: A tabular-to-image encoding method based on self-organizing maps
TabSOM leverages Self-Organizing Maps to encode tabular data into images, achieving top classification performance and interpretability across multiple datasets.
Key Findings
Methodology
TabSOM employs a self-organizing map (SOM) to preserve the topological structure of feature space, extracting component planes for each feature. It assigns features to fixed positions on an image canvas via a collision-free Hungarian algorithm, ensuring meaningful spatial layout. The feature relationship graph, built from the SOM's prototype geometry using Pearson correlation, captures pairwise interactions. Multi-scale Gaussian kernels generate node channels at different bandwidths, providing both precise localization and regional coherence. The framework introduces two interpretability tools: class-separation importance scores and prototype-inspired partial dependence plots, leveraging the SOM's structure for global and local explanations. Extensive benchmarking on twelve public binary classification datasets demonstrates superior performance, stability, and interpretability compared to existing methods.
Key Results
- On datasets like Pima Indians Diabetes and Wisconsin Breast Cancer, TabSOM achieved AUC-ROC scores of 0.8236 and 0.9911 respectively, outperforming most competitors. The overall mean AUC was 0.9024, ranking second, with the lowest standard deviation, indicating high stability across seeds.
- Compared to twelve existing tabular-to-image methods, TabSOM consistently ranked at the top across all datasets, especially excelling in low-dimensional feature spaces such as the 8-feature Pima dataset. Its structured encoding outperformed random embedding-based techniques like t-SNE and UMAP, with significant margins.
- Incorporating a feature relationship graph and multi-scale rendering, TabSOM effectively captures feature interactions and local-global patterns, leading to improved predictive accuracy and interpretability. The SOM-based explanations aligned well with established feature importance measures, validating their reliability.
Significance
This work addresses the longstanding challenge of balancing predictive performance and interpretability in tabular data modeling. By integrating topological preservation through SOM and explicit feature relationship encoding, it offers a robust framework that enhances model transparency without sacrificing accuracy. Such advancements are crucial for high-stakes domains like healthcare and finance, where understanding model decisions is as important as their accuracy. The approach bridges the gap between traditional structured data analysis and modern deep learning, paving the way for more trustworthy AI systems.
Technical Contribution
The core innovation lies in combining SOM-based topological mapping with a collision-free feature placement strategy via Hungarian assignment, ensuring meaningful spatial arrangements. The construction of a feature relationship graph from the SOM prototype geometry captures pairwise interactions, enriching the image representation. Multi-scale Gaussian rendering supports multi-level feature localization, while the SOM-derived interpretability tools enable comprehensive explanations. This integrated framework surpasses prior methods that rely solely on embedding-based layouts, offering both performance gains and interpretability enhancements.
Novelty
This research is the first to embed tabular features into images using SOM's topology-preserving properties, explicitly modeling feature relationships through a graph derived from prototype geometry. Unlike prior approaches that depend on t-SNE or UMAP embeddings, TabSOM leverages the interpretability and structural fidelity of SOM, providing a more meaningful spatial arrangement. The multi-scale rendering scheme further distinguishes it by capturing both fine-grained and regional information, leading to superior classification and explanation capabilities.
Limitations
- The effectiveness of TabSOM depends heavily on the quality of SOM training; insufficient data or poor parameter tuning can lead to suboptimal topological mapping, affecting feature placement accuracy.
- In high-dimensional feature spaces, the construction of the feature relationship graph may be sensitive to noise, potentially introducing spurious interactions that degrade model performance.
- Multi-scale Gaussian rendering increases computational complexity, which might limit real-time applications on large datasets.
- Currently optimized for binary classification, extending to multi-class or regression tasks requires further validation and adaptation.
Future Work
Future research will focus on adaptive SOM training strategies to improve topological fidelity, integrating dynamic graph learning to capture complex feature interactions, and exploring graph neural networks (GNNs) to enhance relational modeling. Additionally, extending the framework to multi-class classification and regression, as well as optimizing computational efficiency for large-scale data, are promising directions. Applying TabSOM to multimodal data and temporal sequences could further broaden its applicability, especially in fields like medical diagnostics and industrial monitoring.
AI Executive Summary
In the era of data-driven decision-making, structured tabular data remains the backbone of many critical applications in healthcare, finance, and industry. Despite the success of deep learning models in unstructured data like images and text, their application to tabular data has faced significant hurdles. Traditional models such as gradient boosting machines and random forests excel at handling tabular data but lack transparency. Conversely, deep neural networks often struggle to capture complex feature interactions and rely on feature engineering or embedding techniques that obscure interpretability.
Recent advances have explored converting tabular data into image representations to leverage powerful convolutional neural networks (CNNs) and vision transformers (ViTs). These methods typically employ dimensionality reduction techniques like t-SNE, UMAP, or PCA to embed features into a 2D space, then generate images where spatial proximity reflects feature similarity. While effective in some cases, these approaches mainly encode marginal feature distributions, neglecting the relationships among features that are crucial for understanding the data structure and improving model robustness.
This paper introduces TabSOM, a novel encoding framework that harnesses the topology-preserving properties of self-organizing maps (SOMs). Unlike conventional embeddings, SOMs maintain the topological relationships of the original feature space, enabling a more meaningful spatial layout. The authors develop a collision-free feature placement strategy using the Hungarian algorithm, ensuring each feature occupies a distinct position on the image canvas based on its component plane. They further construct a feature relationship graph derived from the SOM's prototype geometry, capturing pairwise interactions that are embedded as spatial connections.
To enrich the representation, TabSOM employs multi-scale Gaussian kernels to render node channels at different bandwidths, balancing local detail and regional coherence. An additional relational edge channel encodes feature interactions, providing a comprehensive multi-channel image input for CNN classifiers. Extensive experiments across twelve public binary classification datasets demonstrate that TabSOM consistently outperforms existing methods in predictive accuracy, achieving the highest or second-highest AUC-ROC scores with minimal variance, indicating high stability.
Beyond performance, TabSOM emphasizes interpretability. The framework introduces two SOM-based tools: class-separation importance scores, which quantify how features differentiate classes, and prototype-inspired partial dependence plots, which visualize the influence of features within the learned topological structure. These explanations align well with established importance measures like SHAP and feature importance from tree models, validating their reliability.
Overall, TabSOM bridges the gap between high predictive performance and interpretability in tabular data modeling. By integrating topological preservation, feature relationship encoding, and multi-scale spatial rendering, it offers a robust, explainable, and scalable solution. Its potential impact spans healthcare diagnostics, financial risk assessment, and industrial process monitoring, where understanding model decisions is as vital as their accuracy. Future work aims to extend the framework to multi-class tasks, incorporate dynamic graph learning, and optimize computational efficiency, further broadening its applicability in real-world scenarios.
Deep Dive
Abstract
Tabular-to-image methods have emerged as novel approaches to leverage the high predictive performance of convolutional neural networks and vision transformers. They convert tabular data into image representations, mapping each feature at a fixed pixel location derived from a dimensionality-reduction method (e.g., t-SNE, UMAP, PCA). However, they encode only the marginal value of each feature and discard information about feature relationships. We propose TabSOM, a tabular-to-image encoding built on the Self-Organizing Map (SOM), which provides: (i) a spatial layout in which every input feature occupies a fixed canvas position derived from its component plane via collision-free Hungarian assignment; and (ii) a graph that captures pairwise feature relationships derived from the SOM component planes. The resulting image stacks two multi-scale node channels: one encodes feature values at fixed scales, while the other encodes pairwise feature interactions as spatial connections between related features. Two SOM-derived interpretability approaches are introduced: a prototype-inspired partial dependence plot and a class--separation importance score. Benchmarked against twelve existing tabular-to-image methods across public binary-classification datasets, TabSOM ranks first or second on every dataset and achieves the lowest variance of any method evaluated. Interpretability obtained with TabSOM was validated against Random Forest, XGBoost, and SHAP, the class-separation score shows reasonable agreement with established baselines on the top-ranked features while capturing complementary structural information from input data. These results demonstrate that TabSOM provides an effective and interpretable approach for applying deep learning architectures to tabular data, bridging the performance--interpretability gap in this domain.
References (20)
A comprehensive benchmark of spatial encoding methods for tabular data with deep neural networks
Jiayun Liu, M. Castillo-Cara, Raúl García-Castro
TINTO: Converting Tidy Data into image for classification with 2-Dimensional Convolutional Neural Networks
Manuel Castillo-Cara, Reewos Talla-Chumpitaz, R. García-Castro et al.
Transfer learning for a tabular-to-image approach: A case study for cardiovascular disease prediction
F. Lara-Abelenda, David Chushig-Muzo, Pablo Peiro-Corbacho et al.
A novel deep learning approach using blurring image techniques for Bluetooth-based indoor localisation
Manuel Castillo-Cara, Reewos Talla-Chumpitaz, L. Orozco-Barbosa et al.
Data-Driven Visual Characterization of Patient Health-Status Using Electronic Health Records and Self-Organizing Maps
David Chushig-Muzo, C. Soguero-Ruíz, A. Engelbrecht et al.
Converting tabular data into images for deep learning with convolutional neural networks
Yitan Zhu, T. Brettin, Fangfang Xia et al.
Tabular-to-Image Encoding Methods for Melanoma Detection: A Proof-of-Concept
Vanesa Gómez-Martínez, David Chushig-Muzo, Cristina Soguero-Ruíz
DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture
Alok Sharma, E. Vans, D. Shigemizu et al.
Topological Activation Maps for Visual Representation Learning from Tabular Data
M. Achutha, Bhaskarjyoti Das
Tab2Visual: Deep learning for limited tabular data via visual representations and augmentation
Ahmed Mamdouh, M. El-Melegy, Samia Ali et al.
Image-based vulnerability detection based on a hybrid deep learning model in the Industrial Internet of Things using convolution neural network and transformer architectures
Bilal Babayiğit, Mohammed Abubaker
Representation of features as images with neighborhood dependencies for compatibility with convolutional neural networks
Omid Bazgir, Ruibo Zhang, S. Dhruba et al.
Engineering applications of the self-organizing map
T. Kohonen, E. Oja, O. Simula et al.
Tab2Visual: Overcoming Limited Data in Tabular Data Classification Using Deep Learning with Visual Representations
Ahmed Mamdouh, M. El-Melegy, Samia Ali et al.
Self-Organizing Maps applied to ecological sciences
T. Chon
Towards efficient image-based representation of tabular data
Amit Damri, Mark Last, Niv Cohen
MIMO-Based Indoor Localisation With Hybrid Neural Networks: Leveraging Synthetic Images From Tidy Data for Enhanced Deep Learning
M. Castillo-Cara, J. Martínez-Gómez, Javier Ballesteros-Jerez et al.
LM-IGTD: a 2D image generator for low-dimensional and mixed-type tabular data to leverage the potential of convolutional neural networks
Vanesa G'omez-Mart'inez, F. Lara-Abelenda, Pablo Peiro-Corbacho et al.
SuperTML: Two-Dimensional Word Embedding for the Precognition on Structured Tabular Data
Baohua Sun, Lin Yang, Wenhan Zhang et al.
Transforming tabular data into images via enhanced spatial relationships for CNN processing
H. Alenizy, Jawad Berri