[ACM Press the 15th ACM SIGKDD international conference - Paris, France (2009.06.28-2009.07.01)] Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '09 - Parallel community detection on large networks with propinquity dynamics

✍ Scribed by Zhang, Yuzhou; Wang, Jianyong; Wang, Yi; Zhou, Lizhu

• Book ID: 121387800
• Publisher: ACM Press
• Year: 2009
• Weight: 442 KB
• Category: Article
• ISBN: 1605584959
• DOI: 10.1145/1557019.1557127

✦ Synopsis

Graphs or networks can be used to model complex systems. Detecting community structures from large network data is a classic and challenging task. In this paper, we propose a novel community detection algorithm, which utilizes a dynamic process by contradicting the network topology and the topology-based propinquity, where the propinquity is a measure of the probability for a pair of nodes involved in a coherent community structure. Through several rounds of mutual reinforcement between topology and propinquity, the community structures are expected to naturally emerge. The overlapping vertices shared between communities can also be easily identified by an additional simple postprocessing. To achieve better efficiency, the propinquity is incrementally calculated. We implement the algorithm on a vertex-oriented bulk synchronous parallel(BSP) model so that the mining load can be distributed on thousands of machines. We obtained interesting experimental results on several real network data.