Machine learning has become an increasingly important tool in the study of partial differential equations (PDEs). PDEs are fundamental in modeling a wide range of physical phenomena, from fluid dynamics and heat transfer to quantum mechanics and electromagnetics. However, solving PDEs can be a challenging task as they usually do not have a analytical solution. While a lot of the numerical methods have been developed to solve PDEs, they are often costly to run. This is where machine learning can help.
1.Machine learning provides a way to approximate the solution of a PDE without having to solve it explicitly. This is done by training a machine learning model on a set of data, typically generated by solving the PDE numerically or through experiment. The trained model can then be used to make predictions for new inputs, allowing us to directly estimate the solution of the PDE at locations where we don't have explicit solutions.
2. Machine learning techniques such as neural networks can be used to discover new PDEs or to learn the underlying physics of a system directly from data. This can be useful when the underlying PDE is unknown or when we have limited knowledge of the system.
3. Machine learning can be used to assist classical numerical solver. Numerical solvers are generally sensitive to the discretization and too coarse discretization will lead to large error due to the under-resolved physics. Machine learning enables running numerical simulations on coarser discretization by learning to interpolate and correct the under-resolved physics for the numerical solver and thus accelerate the calculation process.
Graph neural network discretizes the PDE domain as a graph and can flexibly adapt to a wide array of physical systems. Based on graph representation, we develop neural-network-based surrogate model for the following systems:
a) Graph neural network-accelerated Lagrangian fluid simulation
b) Graph convolutional networks applied to unstructured flow field data
Neural operators provide a data-driven approach to solving PDEs by learning and representing the non-linear solution operator. Formulating the attention as a learnable kernel integral, we propose a Transfomer-based neural operator that is flexible with respect to the discretization
a) Transformer for partial differential equations' operator learning
The symbolic representation provides a parsimonious way to describe the physical system. Leveraging machine learning, we develop following tools for discovering the governing equations from the observed data:
a) Identification of parametric dynamical systems using integer programming
b) Data-driven identification of 2D Partial Differential Equations using extracted physical features
Machine learning can be used to learn and interpolate between the scale that’s not resolved by the discretization. Inspired by the success of deep-learning based image super-resolution techniques, we develop learning-based models to restore and upsample under-resolved simulation data:
a) A physics-informed diffusion model for high-fidelity flow field reconstruction
b) TPU-GAN: Learning temporal coherence from dynamic point cloud sequences
c) Deep learning for efficient reconstruction of high-resolution turbulent dns data