See this Github repo and the associated slides. This will guide you through applying FNO and GPs to Burger's equation, and GPs to coefficient to solution problem for an elliptic PDE.
A tutorial on how to use Bayesian optimization with Gaussian Process surrogate modeling for tuning hyper-parameters - notebook.