✦ LIBER ✦

Policy capturing models for multi-faceted relevance judgments

✍ Scribed by Xiaoli Huang; Ryen W. White

Publisher: Wiley (John Wiley & Sons)
Year: 2006
Tongue: English
Weight: 163 KB
Volume: 42
Category: Article
ISSN: 0044-7870
DOI: 10.1002/meet.14504201253

No coin nor oath required. For personal study only.

✦ Synopsis

Abstract

We applied policy capturing and bootstrapping methods to investigate the relevance judgment process, with a particular focus on understanding how judges summarize an overall relevance judgment from five specific aspects of relevance. Our data come from relevance judgments made in the development of the MALACH (Multilingual Access to Large Spoken ArCHives) Speech Retrieval Test Collection. We developed a linear model for each of four relevance judges by regressing his/her overall judgments on the five specific relevance aspects. According to these models, different judges tended to assign different importance weights to different aspects. One of the linear models was applied to seven new judgment sets and was highly successful at predicting accurate overall judgments for the seven judgment sets.

📜 SIMILAR VOLUMES

Fuzzy versus probabilistic models for us

Fuzzy versus probabilistic models for user relevance judgments

✍ Koll, Mathew ;Srinivasan, Padmini 📂 Article 📅 1990 🏛 John Wiley and Sons 🌐 English ⚖ 908 KB

A crucial aspect of information retrieval is the process of making relevance judgments. Although this highly complex decision making procedure still eludes researchers, it is evident that a number of mental models are involved: models of the information need, retrieval system, database, user's knowl

Automatic relevance determination for mu

Automatic relevance determination for multi-way models

✍ Morten Mørup; Lars Kai Hansen 📂 Article 📅 2009 🏛 John Wiley and Sons 🌐 English ⚖ 429 KB

## Abstract Estimating the adequate number of components is an important yet difficult problem in multi‐way modeling. We demonstrate how a Bayesian framework for model selection based on automatic relevance determination (ARD) can be adapted to the Tucker and CandeComp/PARAFAC (CP) models. By assig

Relevance weighting for combining multi-

Relevance weighting for combining multi-domain data for n-gram language modeling

✍ R. Iyer; M. Ostendorf 📂 Article 📅 1999 🏛 Elsevier Science 🌐 English ⚖ 155 KB

Standard statistical language modeling techniques suffer from sparse-data problems in tasks where large amounts of domain-specific text are not available. In this paper, we focus on improving the estimation of domain-dependent n-gram models by the selective use of out-of-domain text data. Previous a

Models for multi-item continuous review

Models for multi-item continuous review inventory policies subject to constraints

✍ D. A. Schrady; U. C. Choe 📂 Article 📅 1971 🏛 John Wiley and Sons 🌐 English ⚖ 645 KB

Models are formulated for determining continuous review (Q, r) policies for a multiitem inventory subject to constraints. The objective function is the minimization of total time-weighted shortages. The constraints apply to inventory investment and reorder workload. The formulations are thus indepen

Optimal policies for the capacitated two

Optimal policies for the capacitated two stage multi-item inventory model with joint setup costs

✍ S Viswanathan 📂 Article 📅 1993 🏛 Elsevier Science 🌐 English ⚖ 387 KB

Modeling of the primary and secondary dr

Modeling of the primary and secondary drying stages of the freeze drying of pharmaceutical products in vials: Numerical results obtained from the solution of a dynamic and spatially multi-dimensional lyophilization model for different operational policies

✍ P. Sheehan; A. I. Liapis 📂 Article 📅 1998 🏛 John Wiley and Sons 🌐 English ⚖ 510 KB

A rigorous unsteady state and spatially multidimensional model is presented and solved to describe the dynamic behavior of the primary and secondary drying stages of the lyophilization of a pharmaceutical product in vials for different operational policies. The results in this work strongly motivate