Neural Field Thermal Tomography: A Differentiable Physics Framework for Non-Destructive Evaluation

TL;DR

NeFTY achieves high-accuracy 3D thermal diffusion reconstruction using a differentiable physics framework, significantly improving defect localization.

cs.LG 🔴 Advanced 2026-03-12 10 views
Tao Zhong Yixun Hu Dongzhe Zheng Aditya Sood Christine Allen-Blanchette
Thermography Differentiable Physics Neural Fields Nondestructive Evaluation Inverse Problems

Key Findings

Methodology

NeFTY is a framework that combines neural fields with differentiable physics to solve the 3D inverse heat conduction problem. Its core lies in parameterizing the 3D diffusivity field as a continuous neural field optimized through a rigorous numerical solver. This approach leverages a differentiable physics solver to enforce thermodynamic laws as hard constraints, ensuring the memory efficiency required for high-resolution 3D tomography. NeFTY's discretize-then-optimize paradigm effectively mitigates the spectral bias and ill-posedness inherent in inverse heat conduction, enabling the recovery of subsurface defects at arbitrary scales.

Key Results

  • Experimental validation on synthetic data demonstrates that NeFTY significantly improves the accuracy of subsurface defect localization over baselines. Specifically, NeFTY achieves superior accuracy in recovering subsurface defect geometry through unsupervised test-time optimization, enabling generalization to novel geometries and materials without the need for labeled training data.
  • Compared to traditional Physics-Informed Neural Networks (PINNs), NeFTY addresses optimization pathologies by enforcing strict thermodynamic constraints, significantly enhancing defect localization accuracy. In experiments, NeFTY's defect localization accuracy (IoU) surpasses PINN by approximately 0.45.
  • In ablation studies, NeFTY significantly improves model physical plausibility and defect boundary sharpness by incorporating techniques such as positional encoding, frequency annealing, and harmonic mean.

Significance

The introduction of NeFTY opens new possibilities in the field of nondestructive evaluation, particularly in high-resolution inspection of complex geometries and material structures. Traditional thermographic techniques often rely on 1D pixel-wise approximations that neglect lateral diffusion, but NeFTY overcomes this limitation by parameterizing the 3D diffusivity field as a neural field. Additionally, NeFTY's differentiable physics solver enforces thermodynamic laws during optimization, ensuring physical consistency of the results. This approach is significant not only academically but also provides new technological pathways for industrial nondestructive evaluation.

Technical Contribution

NeFTY's technical contributions lie in its integration of implicit neural representations with differentiable physics to solve the 3D inverse heat conduction problem. Unlike existing SOTA methods, NeFTY achieves high-resolution 3D tomography through strict thermodynamic constraints and efficient memory management. Moreover, NeFTY employs a discretize-then-optimize paradigm to effectively mitigate spectral bias and ill-posedness in inverse problems, offering new theoretical guarantees and engineering possibilities.

Novelty

NeFTY is the first to translate the success of Neural Radiance Fields (NeRF) into the diffusive regime of thermal NDE. Unlike traditional black-box deep learning methods, NeFTY relies on a differentiable physics solver to enforce thermodynamic laws as hard constraints, ensuring physical consistency during optimization. This innovation allows NeFTY to generalize to novel geometries and materials without requiring large labeled datasets.

Limitations

  • NeFTY may face limitations in handling very deep or complex defects due to memory and computational resource constraints, as it requires high-resolution parameterization and optimization of the 3D diffusivity field.
  • While NeFTY performs well on synthetic data, further validation is needed to ensure its robustness across different materials and geometries in real-world applications.
  • NeFTY's optimization process depends on the choice of initial parameters, which may affect convergence speed and result accuracy.

Future Work

Future research directions include applying NeFTY to more practical NDE scenarios to validate its robustness across different materials and geometries. Additionally, exploring further optimization of NeFTY's memory and computational efficiency to handle larger-scale 3D diffusivity fields is recommended. The authors also suggest that the research community explore combining NeFTY with other physics-informed neural networks to enhance its adaptability in complex scenarios.

AI Executive Summary

The field of nondestructive evaluation (NDE) has long faced the challenge of efficiently and accurately detecting defects in complex material structures. Traditional thermographic techniques often rely on 1D pixel-wise approximations that neglect lateral diffusion, leading to significant errors in estimating the size and depth of low-aspect-ratio defects. Additionally, existing Physics-Informed Neural Networks (PINNs) often struggle to converge in transient diffusion scenarios due to gradient stiffness issues. To address these challenges, Tao Zhong and colleagues have proposed Neural Field Thermal Tomography (NeFTY), a framework that combines neural fields with differentiable physics for quantitative 3D reconstruction of material properties. NeFTY parameterizes the 3D diffusivity field as a continuous neural field optimized through a rigorous numerical solver, enforcing thermodynamic laws as hard constraints to ensure the memory efficiency required for high-resolution 3D tomography.

The core technical principle of NeFTY lies in its discretize-then-optimize paradigm, which effectively mitigates the spectral bias and ill-posedness inherent in inverse heat conduction. By incorporating techniques such as positional encoding, frequency annealing, and harmonic mean, NeFTY significantly improves model physical plausibility and defect boundary sharpness. Experimental validation demonstrates that NeFTY significantly improves the accuracy of subsurface defect localization over baselines, achieving superior accuracy in recovering subsurface defect geometry through unsupervised test-time optimization.

The introduction of NeFTY opens new possibilities in the field of nondestructive evaluation, particularly in high-resolution inspection of complex geometries and material structures. Traditional thermographic techniques often rely on 1D pixel-wise approximations that neglect lateral diffusion, but NeFTY overcomes this limitation by parameterizing the 3D diffusivity field as a neural field. Additionally, NeFTY's differentiable physics solver enforces thermodynamic laws during optimization, ensuring physical consistency of the results. This approach is significant not only academically but also provides new technological pathways for industrial nondestructive evaluation.

However, NeFTY may face limitations in handling very deep or complex defects due to memory and computational resource constraints, as it requires high-resolution parameterization and optimization of the 3D diffusivity field. While NeFTY performs well on synthetic data, further validation is needed to ensure its robustness across different materials and geometries in real-world applications. Future research directions include applying NeFTY to more practical NDE scenarios to validate its robustness across different materials and geometries. Additionally, exploring further optimization of NeFTY's memory and computational efficiency to handle larger-scale 3D diffusivity fields is recommended.

Deep Analysis

Background

Nondestructive evaluation (NDE) technologies are crucial in industrial and engineering fields, particularly for detecting defects in complex material structures. Traditional thermographic techniques often rely on 1D pixel-wise approximations that neglect lateral diffusion, leading to significant errors in estimating the size and depth of low-aspect-ratio defects. In recent years, with the rapid development of computer vision and scientific machine learning, implicit neural representations (such as NeRF) have shown great potential in solving physical inverse problems. However, existing Physics-Informed Neural Networks (PINNs) often struggle to converge in transient diffusion scenarios due to gradient stiffness issues. Therefore, combining neural fields with differentiable physics to achieve high-resolution 3D thermal diffusion reconstruction has become a hot research topic.

Core Problem

Accurately reconstructing the 3D thermal diffusion field in complex material structures is a core problem in nondestructive evaluation. Traditional thermographic techniques often rely on 1D pixel-wise approximations that neglect lateral diffusion, leading to significant errors in estimating the size and depth of low-aspect-ratio defects. Additionally, existing Physics-Informed Neural Networks (PINNs) often struggle to converge in transient diffusion scenarios due to gradient stiffness issues. These challenges make it particularly difficult to achieve high-resolution nondestructive evaluation in complex geometries and material structures.

Innovation

NeFTY's core innovations lie in its integration of implicit neural representations with differentiable physics to solve the 3D inverse heat conduction problem. First, NeFTY parameterizes the 3D diffusivity field as a continuous neural field optimized through a rigorous numerical solver, enforcing thermodynamic laws as hard constraints. Second, NeFTY employs a discretize-then-optimize paradigm to effectively mitigate spectral bias and ill-posedness in inverse heat conduction. Additionally, NeFTY incorporates techniques such as positional encoding, frequency annealing, and harmonic mean to significantly improve model physical plausibility and defect boundary sharpness. These innovations allow NeFTY to generalize to novel geometries and materials without requiring large labeled datasets.

Methodology

  • �� NeFTY parameterizes the 3D diffusivity field as a continuous neural field optimized through a rigorous numerical solver, enforcing thermodynamic laws as hard constraints.

  • �� NeFTY employs a discretize-then-optimize paradigm to effectively mitigate spectral bias and ill-posedness in inverse heat conduction.

  • �� NeFTY incorporates techniques such as positional encoding, frequency annealing, and harmonic mean to significantly improve model physical plausibility and defect boundary sharpness.

  • �� NeFTY's differentiable physics solver enforces thermodynamic laws during optimization, ensuring physical consistency of the results.

Experiments

Experimental validation demonstrates that NeFTY significantly improves the accuracy of subsurface defect localization over baselines. Specifically, NeFTY achieves superior accuracy in recovering subsurface defect geometry through unsupervised test-time optimization, enabling generalization to novel geometries and materials without the need for labeled training data. The synthetic dataset used in the experiments includes samples with different geometries and material structures, ensuring the broad applicability of the experimental results. Ablation studies were also conducted to verify the impact of techniques such as positional encoding, frequency annealing, and harmonic mean on model performance.

Results

NeFTY significantly improves the accuracy of subsurface defect localization over baselines. Specifically, NeFTY achieves superior accuracy in recovering subsurface defect geometry through unsupervised test-time optimization, enabling generalization to novel geometries and materials without the need for labeled training data. Compared to traditional Physics-Informed Neural Networks (PINNs), NeFTY addresses optimization pathologies by enforcing strict thermodynamic constraints, significantly enhancing defect localization accuracy. In experiments, NeFTY's defect localization accuracy (IoU) surpasses PINN by approximately 0.45.

Applications

NeFTY has broad application prospects in the field of nondestructive evaluation, particularly in high-resolution inspection of complex geometries and material structures. By parameterizing the 3D diffusivity field as a neural field, NeFTY can effectively identify and locate defects in materials, suitable for industries such as aerospace and automotive manufacturing. Additionally, NeFTY's differentiable physics solver enforces thermodynamic laws during optimization, ensuring physical consistency of the results, providing new technological pathways for industrial nondestructive evaluation.

Limitations & Outlook

NeFTY may face limitations in handling very deep or complex defects due to memory and computational resource constraints, as it requires high-resolution parameterization and optimization of the 3D diffusivity field. While NeFTY performs well on synthetic data, further validation is needed to ensure its robustness across different materials and geometries in real-world applications. Additionally, NeFTY's optimization process depends on the choice of initial parameters, which may affect convergence speed and result accuracy. Future research directions include applying NeFTY to more practical NDE scenarios to validate its robustness across different materials and geometries.

Plain Language Accessible to non-experts

Imagine you're in a kitchen making soup. Traditional thermographic techniques are like stirring the soup with a spoon, only seeing changes on the surface without understanding what's happening at the bottom. NeFTY is like a new tool that can infer the materials and structure at the bottom of the soup by observing temperature changes on the surface. It uses a technique called neural fields to represent the 3D thermal diffusion process as a continuous mathematical model, optimized through strict physical laws. This is like using a high-precision thermometer that can accurately measure temperature changes at the bottom without disturbing the soup. NeFTY's innovation lies in its ability to infer the structure at the bottom with minimal experimental data, which is a huge advancement for nondestructive evaluation as it can accurately detect defects in materials without causing damage.

ELI14 Explained like you're 14

Hey there! Imagine you're playing a super cool game where the mission is to find hidden treasures underground. Traditional methods are like randomly digging holes on the ground, trying to find the treasure, but it's time-consuming and inaccurate. Now, with NeFTY, it's like having a super detector that helps you accurately locate the treasure by observing temperature changes on the ground! NeFTY uses a technique called neural fields, like magic in the game, to infer the underground structure with minimal data. It also follows strict physical laws, like the game's rules, ensuring every step is accurate. This way, you can easily find the treasure without disturbing the ground! Isn't that cool?

Glossary

Neural Field

A neural field is a neural network using continuous coordinate representation to parameterize complex 3D signals, such as density and color.

In this paper, neural fields are used to parameterize the 3D diffusivity field.

Differentiable Physics

Differentiable physics is a method that embeds physical laws into the optimization process, ensuring physical consistency during optimization.

NeFTY uses a differentiable physics solver to enforce thermodynamic laws as hard constraints.

Inverse Heat Conduction Problem

The inverse heat conduction problem involves inferring internal structures from surface temperature measurements, typically a challenging inverse problem.

NeFTY solves the inverse heat conduction problem using a discretize-then-optimize paradigm.

Physics-Informed Neural Networks

Physics-informed neural networks embed physical laws into the loss function to address data scarcity issues.

Unlike traditional PINNs, NeFTY uses a differentiable physics solver to enforce hard constraints.

Spectral Bias

Spectral bias refers to the difficulty of neural networks in learning high-frequency functions, often acting as low-pass filters.

NeFTY mitigates spectral bias using positional encoding and frequency annealing.

Thermal Tomography

Thermal tomography is a method for reconstructing internal structures of materials through temperature measurements.

NeFTY is used to achieve high-resolution 3D thermal tomography.

Harmonic Mean

The harmonic mean is a method for calculating effective diffusivity at interfaces, preserving thermal gradients at boundaries.

NeFTY uses the harmonic mean to compute diffusivity between nodes.

Total Variation Regularization

Total variation regularization is a technique for suppressing high-frequency noise, promoting piecewise-constant solutions.

NeFTY applies total variation regularization on the predicted diffusivity field.

Adjoint Method

The adjoint method is a technique for efficiently computing gradients by solving an auxiliary linear system.

NeFTY computes exact gradients for the diffusivity field using the adjoint method.

Implicit Euler Method

The implicit Euler method is an unconditionally stable time integration method, allowing larger time steps.

NeFTY uses the implicit Euler method for time integration.

Open Questions Unanswered questions from this research

  • 1 NeFTY may face limitations in handling very deep or complex defects due to memory and computational resource constraints. Future research can explore further optimization of NeFTY's memory and computational efficiency to handle larger-scale 3D diffusivity fields.
  • 2 While NeFTY performs well on synthetic data, further validation is needed to ensure its robustness across different materials and geometries in real-world applications. Future research can explore how to enhance NeFTY's adaptability in different scenarios.
  • 3 NeFTY's optimization process depends on the choice of initial parameters, which may affect convergence speed and result accuracy. Future research can explore how to automate the selection of initial parameters to improve optimization efficiency.
  • 4 NeFTY may encounter computational bottlenecks when handling complex geometries and material structures. Future research can explore how to enhance NeFTY's computational efficiency through distributed computing or other optimization techniques.
  • 5 Although NeFTY enforces thermodynamic laws as hard constraints through a differentiable physics solver, further model improvements may be needed to handle nonlinear or complex physical phenomena.

Applications

Immediate Applications

Aerospace Material Inspection

NeFTY can be used to detect hidden defects in aerospace materials, ensuring material safety and reliability. High-resolution 3D thermal tomography enables accurate localization and identification of defects.

Nondestructive Testing in Automotive Manufacturing

In automotive manufacturing, NeFTY can be used to detect defects in complex geometries, ensuring product quality. Minimal surface temperature measurements can infer internal material structures.

Quality Control of Composite Materials

NeFTY can be used for quality control of composite materials, identifying defects and inhomogeneities through high-precision thermal diffusion reconstruction, ensuring product consistency and reliability.

Long-term Vision

Real-Time Monitoring in Smart Manufacturing

In the future, NeFTY can be integrated into smart manufacturing systems for real-time monitoring and quality control of production processes, enhancing production efficiency and product quality.

Structural Health Monitoring of Buildings

NeFTY can be used for structural health monitoring of buildings, identifying potential issues through high-resolution thermal imaging, ensuring building safety and durability.

Abstract

We propose Neural Field Thermal Tomography (NeFTY), a differentiable physics framework for the quantitative 3D reconstruction of material properties from transient surface temperature measurements. While traditional thermography relies on pixel-wise 1D approximations that neglect lateral diffusion, and soft-constrained Physics-Informed Neural Networks (PINNs) often fail in transient diffusion scenarios due to gradient stiffness, NeFTY parameterizes the 3D diffusivity field as a continuous neural field optimized through a rigorous numerical solver. By leveraging a differentiable physics solver, our approach enforces thermodynamic laws as hard constraints while maintaining the memory efficiency required for high-resolution 3D tomography. Our discretize-then-optimize paradigm effectively mitigates the spectral bias and ill-posedness inherent in inverse heat conduction, enabling the recovery of subsurface defects at arbitrary scales. Experimental validation on synthetic data demonstrates that NeFTY significantly improves the accuracy of subsurface defect localization over baselines. Additional details at https://cab-lab-princeton.github.io/nefty/

cs.LG cond-mat.mtrl-sci cs.AI cs.CV physics.ins-det

References (20)

ΦFlow: Differentiable Simulations for PyTorch, TensorFlow and Jax

P. Holl, Nils Thürey

2024 23 citations ⭐ Influential

Representing Scenes as Neural Radiance Fields for View Synthesis

7782 citations ⭐ Influential

Die partiellen Differentialgleichungen der mathematischen Physik

H. Weber

1901 177 citations ⭐ Influential

GAGrasp: Geometric Algebra Diffusion for Dexterous Grasping

Tao Zhong, Christine Allen-Blanchette

2025 7 citations View Analysis →

Learning to Control PDEs with Differentiable Physics

P. Holl, V. Koltun, Nils Thürey

2020 214 citations View Analysis →

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

M. Raissi, P. Perdikaris, G. Karniadakis

2019 15171 citations

Fast-Grasp'D: Dexterous Multi-finger Grasp Generation Through Differentiable Simulation

Dylan Turpin, Tao Zhong, Shutong Zhang et al.

2023 57 citations View Analysis →

Quantitative Depth Estimation in Lock-In Thermography: Modeling and Correction of Lateral Heat Conduction Effects

Botao Ma, Shupeng Sun, Lin Zhang

2025

Photothermal defect imaging in hybrid fiber metal laminates using the virtual wave concept

L. Gahleitner, G. Thummerer, B. Blank et al.

2024 4 citations

Advances in Pulsed Phase Thermography

X. Maldaguea, F. Galmichea, A. Ziadia

2001 177 citations

Reconstruction and enhancement of thermographic sequence data

S. Shepard, D. Wang, J. Lhota et al.

2002 10 citations

Image quality assessment: from error visibility to structural similarity

Zhou Wang, A. Bovik, H. Sheikh et al.

2004 55140 citations

TomoGRAF: An X-ray physics-driven generative radiance field framework for extremely sparse view CT reconstruction

Di Xu, Yang Yang, Hengjie Liu et al.

2025 1 citations

Deep learning approaches for thermographic imaging

P. Kovács, Bernhard Lehner, G. Thummerer et al.

2020 26 citations

Automatic Detection and Identification of Defects by Deep Learning Algorithms from Pulsed Thermography Data

Q. Fang, C. Ibarra-Castanedo, I. Garrido et al.

2023 38 citations

Rectified Linear Units Improve Restricted Boltzmann Machines

Vinod Nair, Geoffrey E. Hinton

2010 18474 citations

A DIFFERENTIABLE PHYSICS ENGINE FOR DEEP LEARNING IN ROBOTICS

Jonas Degrave, Michiel Hermans, J. Dambre et al.

2016 253 citations View Analysis →

Advanced Thermal Imaging Processing and Deep Learning Integration for Enhanced Defect Detection in Carbon Fiber-Reinforced Polymer Laminates

Renan Garcia Rosa, B. P. Barella, I. Vargas et al.

2025 10 citations

Dynamic Thermal Tomography: New Nde Technique to Reconstruct Inner Solids Structure Using Multiple IR Image Processing

V. Vavilov, X. Maldague, J. Picard et al.

1992 23 citations

Conception optimale ou identification de formes, calcul rapide de la dérivée directionnelle de la fonction coût

1986 229 citations