return to table of content

Physics-Based Deep Learning Book

jessriedel
4 replies
19h6m

TBC, this is about deep learning for physics problems, not a general approach to deep learning from a physicist's perspective.

This document contains a practical and comprehensive introduction of everything related to deep learning in the context of physical simulations. As much as possible, all topics come with hands-on code examples in the form of Jupyter notebooks to quickly get started. Beyond standard supervised learning from data, we’ll look at physical loss constraints, more tightly coupled learning algorithms with differentiable simulations, training algorithms tailored to physics problems, as well as reinforcement learning and uncertainty modeling. We live in exciting times: these methods have a huge potential to fundamentally change what computer simulations can achieve.
esafak
1 replies
19h0m

That would have been the more interesting book. There is a lot of intuition that statistical mechanics could bring to deep learning.

I would have called this one Deep Learning for Physics.

beefok
0 replies
18h27m

I guess considering their group is called the Physics-based Simulation Group [1], I'm thinking maybe that's just the terminology they've always used? Or maybe it's a German->English translation thing?

[1] https://ge.in.tum.de/

ayhanfuat
1 replies
13h13m

I think the other one is more commonly known as “physics informed deep learning”.

jessriedel
0 replies
2h9m

I don't think so? Wikipedia suggests that "Physics-informed neural networks" is

a type of universal function approximators that can embed the knowledge of any physical laws that govern a given data-set in the learning process

https://en.wikipedia.org/wiki/Physics-informed_neural_networ...

In other words, that seems to refer to giving the model prior info (a bias) about physical laws that generated the data. What I'm talking about is more abstract: using physics-y type math ideas to understand the internal behavior of the networks. Here are a couple examples:

https://proceedings.neurips.cc/paper_files/paper/2023/hash/6...

https://cgad.ski/blog/where-is-noethers-principle-in-machine...

sriram_malhar
2 replies
13h10m

The title is misleading, no? It seems to be about how to apply deep learning to physics simulations. It is not about borrowing physics concepts and applying them to the NN landscape.

That said, it is a lovely set of topics.

77pt77
1 replies
12h41m

The title is misleading, no?

No. I got the correct meaning at first glance.

makerofthings
0 replies
9h55m

How many IBM Technical Support workers does it take to change a lightbulb? None, we have an identical model here and ours is working fine.

fragebogen
2 replies
9h1m

Maybe I'm blind, but how do I download the entire book as PDF? I only find the download button up top for individual pages?

Afaik, it's produced by Jupyter book[1], but find nothing in their docs either.

[1] https://jupyterbook.org/en/stable/intro.html

alexb24
1 replies
4h12m

In this dense overview presentation (Oct 2022), Chris Rackauckas introduced Sci ML with diverse examples from many fields: epidemics, gravitational waves, pharmacometrics, ocean simulation... and some open source and proprietary Julia libraries for SciML. Highly informative!

https://www.youtube.com/watch?v=yHiyJQdWBY8

rmbyrro
0 replies
2h5m

Does anyone know what the job market looks like for a "Physics-simulation ML engineer" (or whatever it's called)?

richard___
0 replies
17h20m

The most important question - how to apply these methods to contact dynamics?

joelthelion
0 replies
2h0m

I was wondering : does deep learning have the potential to make large-scale quantum physics simulations more tractable? How about plasma physics for fusion reactors?

danielmarkbruce
0 replies
15h45m

Hopefully this is a great book, what a great topic to write a book about. Kudos to the author.

Xeyz0r
0 replies
6h10m

Sounds like a valuable resource for both beginners and experienced