Skip to main content
Cornell University
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arxiv logo > cs > arXiv:2401.14580

Help | Advanced Search

Computer Science > Machine Learning

(cs)
[Submitted on 26 Jan 2024 (v1), last revised 5 Feb 2024 (this version, v2)]

Title:Design Your Own Universe: A Physics-Informed Agnostic Method for Enhancing Graph Neural Networks

Authors:Dai Shi, Andi Han, Lequan Lin, Yi Guo, Zhiyong Wang, Junbin Gao
Download a PDF of the paper titled Design Your Own Universe: A Physics-Informed Agnostic Method for Enhancing Graph Neural Networks, by Dai Shi and 5 other authors
Download PDF
Abstract:Physics-informed Graph Neural Networks have achieved remarkable performance in learning through graph-structured data by mitigating common GNN challenges such as over-smoothing, over-squashing, and heterophily adaption. Despite these advancements, the development of a simple yet effective paradigm that appropriately integrates previous methods for handling all these challenges is still underway. In this paper, we draw an analogy between the propagation of GNNs and particle systems in physics, proposing a model-agnostic enhancement framework. This framework enriches the graph structure by introducing additional nodes and rewiring connections with both positive and negative weights, guided by node labeling information. We theoretically verify that GNNs enhanced through our approach can effectively circumvent the over-smoothing issue and exhibit robustness against over-squashing. Moreover, we conduct a spectral analysis on the rewired graph to demonstrate that the corresponding GNNs can fit both homophilic and heterophilic graphs. Empirical validations on benchmarks for homophilic, heterophilic graphs, and long-term graph datasets show that GNNs enhanced by our method significantly outperform their original counterparts.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2401.14580 [cs.LG]
  (or arXiv:2401.14580v2 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2401.14580
arXiv-issued DOI via DataCite

Submission history

From: Ethan Shi [view email]
[v1] Fri, 26 Jan 2024 00:47:43 UTC (95 KB)
[v2] Mon, 5 Feb 2024 07:06:33 UTC (69 KB)
Full-text links:

Access Paper:

    Download a PDF of the paper titled Design Your Own Universe: A Physics-Informed Agnostic Method for Enhancing Graph Neural Networks, by Dai Shi and 5 other authors
  • Download PDF
  • TeX Source
  • Other Formats
license icon view license
Current browse context:
cs.LG
< prev   |   next >
new | recent | 2401
Change to browse by:
cs

References & Citations

  • NASA ADS
  • Google Scholar
  • Semantic Scholar
a export BibTeX citation Loading...

Bookmark

BibSonomy logo Reddit logo

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)
  • About
  • Help
  • contact arXivClick here to contact arXiv Contact
  • subscribe to arXiv mailingsClick here to subscribe Subscribe
  • Copyright
  • Privacy Policy
  • Web Accessibility Assistance
  • arXiv Operational Status
    Get status notifications via email or slack