On generalizing the Two-Poisson Model

✍ Scribed by Srinivasan, Padmini

• Publisher: John Wiley and Sons
• Year: 1990
• Tongue: English
• Weight: 691 KB
• Volume: 41
• Category: Article
• ISSN: 0002-8231
• DOI: 10.1002/(sici)1097-4571(199001)41:1<61::aid-asi5>3.0.co;2-q

✦ Synopsis

it is well recognized that automatic indexing is one of the important functions of a modern Document Retrieval System. Numerous techniques for this function have been proposed in the literature ranging from purely statistical to linguistically complex mechanisms. Most of these techniques result from examining properties of terms. In this article term distribution is examined within the framework of the Poisson Models. Specifically the effectiveness of the Two-Poisson and the Three-Poisson Models are examined. The more general Three-Poisson model is examined to see if generalization results in increased effectiveness. The results show that the Two-Poisson model is only moderately effective in identifying index terms. In addition, generalization to the Three-Poisson does not give any additional power. The only model within the framework of Poisson models which consistently works well is the basic One-Poisson model. The article concludes with a discussion on term distribution information.