Multivariate Time Series Forecasting With Dynamic Graph Neural ODEs

IEEE Transactions on Knowledge and Data Engineering, Journal Year: 2022, Volume and Issue: 35(9), P. 9168 - 9180

Published: Nov. 14, 2022

Multivariate time series forecasting has long received significant attention in real-world applications, such as energy consumption and traffic prediction. While recent methods demonstrate good abilities, they have three fundamental limitations. (i). Discrete neural architectures: Interlacing individually parameterized spatial temporal blocks to encode rich underlying patterns leads discontinuous latent state trajectories higher numerical errors. (ii). xmlns:xlink="http://www.w3.org/1999/xlink">High complexity: Discrete approaches complicate models with dedicated designs redundant parameters, leading computational memory overheads. (iii). xmlns:xlink="http://www.w3.org/1999/xlink">Reliance on graph priors: Relying predefined static structures limits their effectiveness practicability applications. In this paper, we address all the above limitations by proposing a continuous model forecast M ultivariate xmlns:xlink="http://www.w3.org/1999/xlink">T ime dynamic xmlns:xlink="http://www.w3.org/1999/xlink">G raph xmlns:xlink="http://www.w3.org/1999/xlink">O rdinary xmlns:xlink="http://www.w3.org/1999/xlink">D ifferential xmlns:xlink="http://www.w3.org/1999/xlink">E quations ( MTGODE ). Specifically, first abstract multivariate into graphs time-evolving node features unknown structures. Then, design solve ODE complement missing topologies unify both message passing, allowing deeper propagation fine-grained information aggregation characterize stable precise spatial-temporal dynamics. Our experiments superiorities of from various perspectives five benchmark datasets.

Language: Английский

---

Unifying Large Language Models and Knowledge Graphs: A Roadmap

arXiv (Cornell University), Journal Year: 2023, Volume and Issue: unknown

Published: Jan. 1, 2023

Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the field of natural processing artificial intelligence, due to their emergent ability generalizability. However, LLMs black-box models, which often fall short capturing accessing factual knowledge. In contrast, Knowledge Graphs (KGs), Wikipedia Huapu for example, structured knowledge that explicitly store rich KGs can enhance by providing external inference interpretability. Meanwhile, difficult construct evolving nature, challenges existing methods generate facts represent unseen Therefore, it is complementary unify together simultaneously leverage advantages. this article, we present a forward-looking roadmap unification KGs. Our consists three general frameworks, namely, 1) KG-enhanced LLMs, incorporate during pre-training phases or purpose enhancing understanding learned LLMs; 2) LLM-augmented KGs, different KG tasks embedding, completion, construction, graph-to-text generation, question answering; 3) Synergized + play equal roles work mutually beneficial way both bidirectional reasoning driven data We review summarize efforts within these frameworks our pinpoint future research directions.

Language: Английский

---

Trustworthy Recommender Systems

ACM Transactions on Intelligent Systems and Technology, Journal Year: 2023, Volume and Issue: 15(4), P. 1 - 20

Published: Oct. 13, 2023

Recommender systems (RSs) aim at helping users to effectively retrieve items of their interests from a large catalogue. For quite long time, researchers and practitioners have been focusing on developing accurate RSs. Recent years witnessed an increasing number threats RSs, coming attacks, system user generated noise, various types biases. As result, it has become clear that the focus RS accuracy is too narrow, research must consider other important factors, particularly trustworthiness. A trustworthy recommender (TRS) should not only be but also transparent, unbiased, fair, robust noise attacks. These observations actually led paradigm shift RSs: accuracy-oriented RSs TRSs. However, there lack systematic overview discussion literature in this novel fast-developing field To end, article, we provide TRSs, including motivation basic concepts presentation challenges building perspective future directions area. We conceptual framework support construction

Language: Английский

---

Multimodal data integration for oncology in the era of deep neural networks: a review

Frontiers in Artificial Intelligence, Journal Year: 2024, Volume and Issue: 7

Published: July 25, 2024

Cancer research encompasses data across various scales, modalities, and resolutions, from screening diagnostic imaging to digitized histopathology slides types of molecular clinical records. The integration these diverse for personalized cancer care predictive modeling holds the promise enhancing accuracy reliability screening, diagnosis, treatment. Traditional analytical methods, which often focus on isolated or unimodal information, fall short capturing complex heterogeneous nature data. advent deep neural networks has spurred development sophisticated multimodal fusion techniques capable extracting synthesizing information disparate sources. Among these, Graph Neural Networks (GNNs) Transformers have emerged as powerful tools learning, demonstrating significant success. This review presents foundational principles learning including oncology taxonomy strategies. We delve into recent advancements in GNNs oncology, spotlighting key studies their pivotal findings. discuss unique challenges such heterogeneity complexities, alongside opportunities it a more nuanced comprehensive understanding cancer. Finally, we present some latest pan-cancer By surveying landscape our goal is underline transformative potential Transformers. Through technological methodological innovations presented this review, aim chart course future promising field. may be first that highlights current state applications using transformers, sources, sets stage evolution, encouraging further exploration care.

Language: Английский

---

Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminating

Proceedings of the AAAI Conference on Artificial Intelligence, Journal Year: 2023, Volume and Issue: 37(4), P. 4516 - 4524

Published: June 26, 2023

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth learned node representations along all edges, ignoring existence of heterophilic edges that connect nodes with distinct attributes. As a result, current are hard generalize graphs where dissimilar widely connected, also vulnerable adversarial attacks. To address this issue, we propose novel unsupervised Graph Representation method Edge hEterophily discriminaTing (GREET) which learns by discriminating leveraging homophilic edges. distinguish two types build an edge discriminator infers homophily/heterophily from feature structure information. We train way through minimizing crafted pivot-anchored ranking loss, randomly sampled pairs acting as pivots. Node contrasting dual-channel encodings obtained discriminated With effective interplaying scheme, can mutually boost each other during training phase. conducted extensive experiments 14 benchmark datasets multiple scenarios demonstrate superiority GREET.

Language: Английский

---

A survey on fairness-aware recommender systems

Information Fusion, Journal Year: 2023, Volume and Issue: 100, P. 101906 - 101906

Published: July 4, 2023

As information filtering services, recommender systems have extremely enriched our daily life by providing personalized suggestions and facilitating people in decision-making, which makes them vital indispensable to human society the era. However, as become more dependent on them, recent studies show that potentially own unintentional impacts individuals because of their unfairness (e.g., gender discrimination job recommendations). To develop trustworthy it is crucial devise fairness-aware can mitigate these bias issues. In this survey, we summarise existing methodologies practices fairness systems. Firstly, present concepts different recommendation scenarios, comprehensively categorize current advances, introduce typical methods promote stages Next, after introducing datasets evaluation metrics applied assess systems, will delve into significant influence exert real-world industrial applications. Subsequently, highlight connection between other principles aiming consider trustworthiness holistically while advocating for fairness. Finally, summarize review, spotlighting promising opportunities comprehending concepts, frameworks, balance accuracy fairness, ties with trustworthiness, ultimate goal fostering development

Language: Английский

---

Graph spatiotemporal process for multivariate time series anomaly detection with missing values

Information Fusion, Journal Year: 2024, Volume and Issue: 106, P. 102255 - 102255

Published: Jan. 14, 2024

The detection of anomalies in multivariate time series data is crucial for various practical applications, including smart power grids, traffic flow forecasting, and industrial process control. However, real-world usually not well-structured, posting significant challenges to existing approaches: (1) existence missing values along variable dimensions hinders the effective modeling interwoven spatial temporal dependencies, resulting important patterns being overlooked during model training; (2) Anomaly scoring with irregularly-sampled observations less explored, making it difficult use detectors without fully-observed values. In this work, we introduce a novel framework called GST-Pro, which utilizes graph spatiotemporal anomaly scorer tackle aforementioned detecting on series. Our approach comprises two main components. First, propose based neural controlled differential equations. This enables from both perspectives, even when contains Second, present distribution-based mechanism that alleviates reliance complete uniform observations. By analyzing predictions process, our allows be easily detected. experimental results show GST-Pro method can effectively detect outperforms state-of-the-art methods, regardless whether there are data. code available: https://github.com/huankoh/GST-Pro.

Language: Английский

---

Learning Strong Graph Neural Networks with Weak Information

Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Journal Year: 2023, Volume and Issue: unknown, P. 1559 - 1571

Published: Aug. 4, 2023

Graph Neural Networks (GNNs) have exhibited impressive performance in many graph learning tasks. Nevertheless, the of GNNs can deteriorate when input data suffer from weak information, i.e., incomplete structure, features, and insufficient labels. Most prior studies, which attempt to learn with a specific type are far effective dealing scenario where diverse deficiencies exist mutually affect each other. To fill gap, this paper, we aim develop an principled approach problem information (GLWI). Based on findings our empirical analysis, derive two design focal points for solving GLWI, enabling long-range propagation allowing those stray nodes isolated largest connected component. Accordingly, propose D$^2$PT, dual-channel GNN framework that performs not only but also global encodes semantic similarities. We further prototype contrastive alignment algorithm aligns class-level prototypes learned channels, such different processes benefit other finally model well handle GLWI problem. Extensive experiments eight real-world benchmark datasets demonstrate effectiveness efficiency proposed methods various scenarios.

Language: Английский

---

Correlation-Aware Spatial–Temporal Graph Learning for Multivariate Time-Series Anomaly Detection

IEEE Transactions on Neural Networks and Learning Systems, Journal Year: 2023, Volume and Issue: 35(9), P. 11802 - 11816

Published: Nov. 14, 2023

Multivariate time-series anomaly detection is critically important in many applications, including retail, transportation, power grid, and water treatment plants. Existing approaches for this problem mostly employ either statistical models which cannot capture the nonlinear relations well or conventional deep learning (DL) e.g., convolutional neural network (CNN) long short-term memory (LSTM) that do not explicitly learn pairwise correlations among variables. To overcome these limitations, we propose a novel method, correlation-aware spatial–temporal graph (termed ), detection. captures via correlation (MTCL) module based on (STGNN) can be developed. Then, by employing convolution (GCN) exploits one-and multihop neighbor information, our STGNN component encode rich spatial information from complex dependencies between With temporal consists of dilated functions, further long-range dependence over time. A scoring integrated into to estimate degree an purely unsupervised manner. Experimental results demonstrate detect diagnose anomalies effectively general settings as enable early across different time delays. Our code available at https://github.com/huankoh/CST-GL.

Language: Английский

---

Jointly Attacking Graph Neural Network and its Explanations

2022 IEEE 38th International Conference on Data Engineering (ICDE), Journal Year: 2023, Volume and Issue: unknown, P. 654 - 667

Published: April 1, 2023

Graph Neural Networks (GNNs) have boosted the performance for many graph-related tasks. Despite great success, recent studies shown that GNNs are still vulnerable to adversarial attacks, where adversaries can mislead GNNs' prediction by modifying graphs. On other hand, explanation of (GnnExplainer short) provides a better understanding trained GNN model generating small subgraph and features most influential its prediction. In this paper, we first perform empirical validate GnnExplainer act as an inspection tool potential detect perturbations This finding motivates us further investigate new problem: Whether graph neural network explanations be jointly attacked graphs with malicious desires? It is challenging answer question since goals attack bypassing essentially contradict each other. work, give confirmative proposing novel framework (GEAttack) graphs, which both exploiting their vulnerabilities simultaneously. To best our knowledge, very effort on graph-structured data trustworthiness GNNs. Comprehensive experiments various real-world datasets demonstrate effectiveness proposed method.

Language: Английский

---