Design of a crawler for online social networks analysis

Chi In Wong, Kin Yeung Wong, Kuong Wai Ng, Wei Fan, Kai Hau Yeung

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)

Abstract

The growths of online Social Networks in scale and amount of information are immense in recent years. The analyses of the structure of online social networks have thus drawn much research interests. Before the analyses, the information and the characteristics of the structure have to be obtained. However, the complexity of today's web technologies imposes challenges for collecting the data. In this paper, we discuss the design and implementation of a crawler for online social networks, and propose countermeasures to the technical challenges when crawling the networks in practice. Then, the crawled data is visualized and analyzed in graphs.

Original languageEnglish
Pages (from-to)263-274
Number of pages12
JournalWSEAS Transactions on Communications
Volume13
Publication statusPublished - 2014

Keywords

  • Automated Agents
  • Crawler
  • Network Analysis
  • Network Visualization
  • Social Networks
  • Software Design

Fingerprint

Dive into the research topics of 'Design of a crawler for online social networks analysis'. Together they form a unique fingerprint.

Cite this