A BERT-based Heterogeneous Graph Convolution Approach for Mining Organization-Related Topics
Haoda Qian1,2; Minjie Yuan1,2; Qiudan Li2; Daniel Zeng1,2
2022-07
会议日期2022-07
会议地点Padua, Italy
页码0
英文摘要

 

Mining organization-related topics is helpful to analyze and monitor the information dissemination situation. Existing methods based on heterogeneous graph neural networks mainly consider the association between words and documents, they ignore the semantic interactions between documents, and do not consider the heterogeneity of edges, which are difficult to solve the challenge of blurred topic boundaries in real scenarios, resulting in performance loss. This paper proposes a BERT-based Heterogeneous Graph Convolution Network (BERT-HGCN) approach for semi-supervised topic mining that comprehensively considers multi-semantic relations between words and documents. It deeply combines the advantages of transductive learning with labeled examples and pre-training models. We model documents as graph-structured data and capture the multiple semantic dependencies among word-word, word-doc, and doc-doc via neighborhood propagation. During the model learning process, a two-channel encoding mechanism is used to learn the structure and semantic representations, which fuses a hierarchical graph convolution network (HGCN) and a BERT-based DNN autoencoder. It simultaneously considers edges heterogeneity and semantics of original documents. Finally, a dual-supervised loss function is used to train a classifier based on graph nodes and semantic representations for topic mining. We empirically evaluate the performance of the proposed model on a real-world organization-related dataset, the experimental results demonstrate the efficacy of the model.

语种英语
内容类型会议论文
源URL[http://ir.ia.ac.cn/handle/173211/48609]  
专题自动化研究所_复杂系统管理与控制国家重点实验室_互联网大数据与安全信息学研究中心
作者单位1.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
2.The State Key Laboratory of Management and Control for Complex Systems Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
推荐引用方式
GB/T 7714
Haoda Qian,Minjie Yuan,Qiudan Li,et al. A BERT-based Heterogeneous Graph Convolution Approach for Mining Organization-Related Topics[C]. 见:. Padua, Italy. 2022-07.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace