Beyond Low-Pass Filtering: Graph Convolutional Networks With Automatic Filtering

IEEE Transactions on Knowledge and Data Engineering, Journal Year: 2022, Volume and Issue: 35(7), P. 6687 - 6697

Published: June 24, 2022

Graph convolutional networks are becoming indispensable for deep learning from graph-structured data. Most of the existing graph share two big shortcomings. First, they essentially low-pass filters, thus potentially useful middle and high frequency band signals ignored. Second, bandwidth filters is fixed. Parameters a filter only transform inputs without changing curvature function. In reality, we uncertain about whether should retain or cut off at certain point unless have expert domain knowledge. this paper, propose Automatic Convolutional Networks (AutoGCN) to capture full spectrum automatically update filters. While it based on spectral theory, our AutoGCN also localized in space has spatial form. Experimental results show that achieves significant improvement over baseline methods which work as

Language: Английский

---

GOODAT: Towards Test-Time Graph Out-of-Distribution Detection

Proceedings of the AAAI Conference on Artificial Intelligence, Journal Year: 2024, Volume and Issue: 38(14), P. 15537 - 15545

Published: March 24, 2024

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel scenarios where the testing shares distribution of their training counterparts (in distribution, ID), they often exhibit incorrect predictions when confronted with samples from an unfamiliar (out-of-distribution, OOD). To identify and reject OOD GNNs, recent studies explored detection, focusing on a specific model or modifying top well-trained GNN. Despite effectiveness, these methods come heavy resources costs, as need to optimize GNN-based models data. Moreover, reliance original accessing further restricts universality. this end, paper introduces method detect Out-of-Distribution At Test-time (namely GOODAT), data-centric, unsupervised, plug-and-play solution that operates independently modifications GNN architecture. With lightweight masker, GOODAT can learn informative subgraphs test samples, enabling capture distinct patterns between ID samples. we meticulously design three unsupervised objective functions based information bottleneck principle, motivating masker compact yet for detection. Comprehensive evaluations confirm our outperforms state-of-the-art benchmarks variety real-world datasets.

Language: Английский

---

Contrastive Graph Similarity Networks

ACM Transactions on the Web, Journal Year: 2023, Volume and Issue: 18(2), P. 1 - 20

Published: Jan. 30, 2023

Graph similarity learning is a significant and fundamental issue in the theory analysis of graphs, which has been applied variety fields, including object tracking, recommender systems, search, so on. Recent methods for graph that utilize deep typically share two deficiencies: (1) they leverage neural networks as backbones representations but have not well captured complex information inside data, (2) employ cross-graph attention mechanism learning, computationally expensive. Taking these limitations into consideration, method devised this study, namely, Contrastive Similarity Network (CGSim). To enhance CGSim makes use complementary input graphs captures pairwise relations contrastive framework. By developing dual module with node-graph matching graph-graph mechanism, our significantly reduces quadratic time complexity interaction modeling to linear complexity. Jointly an end-to-end framework, representation embedding well-designed can be beneficial one another. A comprehensive series experiments indicate outperforms state-of-the-art baselines on six datasets computational cost, demonstrates model’s superiority over other baselines.

Language: Английский

---

GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networks

Published: Jan. 1, 2024

Language: Английский

---

Securing Graph Neural Networks in MLaaS: A Comprehensive Realization of Query-based Integrity Verification

2022 IEEE Symposium on Security and Privacy (SP), Journal Year: 2024, Volume and Issue: 52, P. 2534 - 2552

Published: May 19, 2024

Language: Английский

---

Beyond-accuracy: a review on diversity, serendipity, and fairness in recommender systems based on graph neural networks

Frontiers in Big Data, Journal Year: 2023, Volume and Issue: 6

Published: Dec. 19, 2023

By providing personalized suggestions to users, recommender systems have become essential numerous online platforms. Collaborative filtering, particularly graph-based approaches using Graph Neural Networks (GNNs), demonstrated great results in terms of recommendation accuracy. However, accuracy may not always be the most important criterion for evaluating systems' performance, since beyond-accuracy aspects such as diversity, serendipity, and fairness can strongly influence user engagement satisfaction. This review paper focuses on addressing these dimensions GNN-based systems, going beyond conventional accuracy-centric perspective. We begin by reviewing recent developments that improve only accuracy-diversity trade-off but also promote systems. discuss different stages model development including data preprocessing, graph construction, embedding initialization, propagation layers, fusion, score computation, training methodologies. Furthermore, we present a look into practical difficulties encountered assuring fairness, while retaining high Finally, potential future research directions developing more robust go unidimensional perspective focusing solely aims provide researchers practitioners with an in-depth understanding multifaceted issues arise when designing setting our work apart offering comprehensive exploration dimensions.

Language: Английский

---

Projective Ranking-based GNN Evasion Attacks

IEEE Transactions on Knowledge and Data Engineering, Journal Year: 2022, Volume and Issue: unknown, P. 1 - 14

Published: Jan. 1, 2022

Graph neural networks (GNNs) offer promising learning methods for graph-related tasks. However, GNNs are at risk of adversarial attacks. Two primary limitations the current evasion attack highlighted: (1) The GradArgmax ignores "long-term" benefit perturbation. It is faced with zero-gradient and invalid estimates in certain situations. (2) In reinforcement learning-based methods, learned strategies might not be transferable when budget changes. To this end, we first formulate perturbation space propose an evaluation framework projective ranking method. We aim to learn a powerful strategy then adapt it as little possible generate samples under dynamic settings. our method, based on mutual information, rank assess benefits each effective strategy. By projecting strategy, method dramatically minimizes cost new comparative assessment RL-S2V, results show owns high performance transferability. visualization also reveals various patterns generation samples.

Language: Английский

---

A Survey of Graph Neural Networks for Social Recommender Systems

arXiv (Cornell University), Journal Year: 2022, Volume and Issue: unknown

Published: Jan. 1, 2022

Social recommender systems (SocialRS) simultaneously leverage the user-to-item interactions as well user-to-user social relations for task of generating item recommendations to users. Additionally exploiting is clearly effective in understanding users' tastes due effects homophily and influence. For this reason, SocialRS has increasingly attracted attention. In particular, with advance graph neural networks (GNN), many GNN-based methods have been developed recently. Therefore, we conduct a comprehensive systematic review literature on SocialRS. survey, first identify 84 papers after annotating 2151 by following PRISMA framework (preferred reporting items reviews meta-analyses). Then, comprehensively them terms their inputs architectures propose novel taxonomy: (1) input taxonomy includes 5 groups type notations 7 representation notations; (2) architecture 8 GNN encoder notations, 2 decoder 12 loss function notations. We classify into several categories per describe details. Furthermore, summarize benchmark datasets metrics widely used evaluate methods. Finally, conclude survey presenting some future research directions. GitHub repository curated list are available at https://github.com/claws-lab/awesome-GNN-social-recsys.

Language: Английский

---

Multi-Relational Graph Neural Architecture Search with Fine-grained Message Passing

2021 IEEE International Conference on Data Mining (ICDM), Journal Year: 2022, Volume and Issue: unknown, P. 783 - 792

Published: Nov. 1, 2022

Graph neural architecture search (NAS) has gained great popularity in automatically designing powerful graph networks (GNNs) with superior learning abilities, significantly relieving human effort and expertise reliance. Despite the advanced performance of automated learning, existing NAS models mainly work on single-relational graphs, while widespread multi-relational graphs real-world applications, are not well addressed. Moreover, current spaces GNNs generally coarse-grained by simply integrating typical GNN layers hyper-parameters, resulting severe limitations capacities scopes for creating innovative architectures. To tackle setting space design NAS, this paper, we propose a novel framework search, dubbed MR-GNAS, to develop excellent Specifically, enlarge improve flexibility, MR-GNAS contains fine-grained that embraces full-pipe message passing schema, enabling expressive scopes. With well-designed space, constructs relation-aware supernet tree topology, jointly learn discriminative node relation representations. By searching gradient-based strategy supernet, proposed could derive architectures analysis. Extensive experiments entity classification link prediction tasks over illustrate effectiveness superiority method.

Language: Английский

---

Unifying Graph Contrastive Learning with Flexible Contextual Scopes

2021 IEEE International Conference on Data Mining (ICDM), Journal Year: 2022, Volume and Issue: unknown, P. 793 - 802

Published: Nov. 1, 2022

Graph contrastive learning (GCL) has recently emerged as an effective paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is maximise mutual between a node and its contextual (i.e., corresponding instance with similar semantic information) summarised from scope (e.g., whole or 1-hop neighbourhood). This scheme distils valuable self-supervision signals training. However, existing methods still suffer limitations, such incapacity inconvenience in choosing suitable different datasets building biased contrastiveness. To address aforementioned problems, we present simple self-supervised method termed Unifying Contrastive Learning Flexible Contextual Scopes (UGCL short). Our algorithm builds flexible representations tunable scopes by controlling power adjacency matrix. Additionally, our ensures contrastiveness built within connected components reduce bias representations. Based both local scopes, UGCL optimises very loss function Essentially, architecture can be considered general framework unify methods. We have conducted intensive experiments achieved new state-of-the-art performance six out eight benchmark compared baselines. code been open sourced ¹ . https://github.com/zyzisastudyreallyhardguy/UGCL

Language: Английский

---