Benefits of Weighted Training in Machine Learning and PDE-based Inverse Problems