Document Type

Journal Article

Department/Unit

Department of Computer Science

Title

Mining local data sources for learning global cluster models via local model exchange

Language

English

Abstract

Distributed data mining has recently caught a lot of attention as there are many cases where pooling distributed data for mining is probibited, due to either huge data volume or data privacy. In this paper, we addressed the issue of learning a global cluster model, known as the latent class model, by mining distributed data sources. Most of the existing model learning algorithms (e.g., EM) require access to all the available training data. Instead, we studied a methodology based on periodic model exchange and merge, and applied it to Web structure modeling. In addition, we have tested a number of variations of the basic idea, including confining the exchange to some privacy friendly parameters and varying the number of distributed sources. Experimental results show that the proposed distributed learning scheme is effective with accuracy close to the case with all the data physically shared for the learning. Also, our results show empirically that sharing less model parameters as a further mechanism for privacy control does not result in significant performance degradation for our application.

Keywords

Distributed data mining, model-based learning, latent class model, privacy preservation

Publication Date

12-2004

Source Publication Title

IEEE Intelligent Informatics Bulletin

Volume

4

Issue

2

Start Page

16

End Page

22

Publisher

The Technical Committee on Intelligent Informatics (TCII)

ISSN (print)

17275997

ISSN (electronic)

17276004

This document is currently not available here.

Share

COinS