Information Needs

These information needs were used for the relevance judgments of the default scoring mechanism (see: Evaluation of Results) and for the relevance judgments of both the BM25 scoring mechanism and language modeling scoring (see: Changing the Ranking).

## **Information need 1**

### Query

```
<topic number="1" >

```

```
      <query>artikel AND "de telegraaf"</query>

```

```
      <description>I'm looking for all letters that have been written based on an article in De Telegraaf.</description>

```

```
</topic>

```

### Guidelines

* An article in De Telegraaf has to be the reason why the person decided to write the letter.
* If the letter contains the word "Telegraaf", but it was not written based on an article in that paper, it's non-relevant.
* If the letter is specifically about De Telegraaf, it's non-relevant.

## **Information need 2**

### Query

```
<topic number="2" >

```

```
<query>primair onderwijs + kosten</query>

```

```
<description>I'm looking for all letters that are about the costs of primary education.</description>

```

```
</topic>

```

### Guidelines

* The letter has to be about the costs of primary education, not about the costs of something else.
* The letter has to be about primary education; all other forms of education are considered non-relevant.
* If the letter is about multiple forms of education, but it's explicitly stated that primary education is one of these forms, the letter is considered relevant.

## **Information need 3**

### Query

```
<topic number="3" >

```

```
<query>islam* onderwijs Amsterdam</query>

```

```
<description>I'm looking for all letters that are about Islamic education in Amsterdam.</description>

```

```
</topic>

```

### Guidelines

* The letter has to be about Islamic education in general, and not just about one specific Islamic school.
* The letter has to be about Islamic education in general, and not about a specific part of education (e.g. teachers or facilities).

## **Information need 4**

### Query

```
<topic number="4" >

```

```
<query>(illegale OR gedwongen) AND prostitutie</query>

```

```
<description>I'm looking for all letters that are about forced prostitution.</description>

```

```
</topic>

```

### Guidelines

* The prostitution has to be forced by nature. When they're talking about voluntary prostitutes that are forced to work long hours (for example), the letter is not relevant.
* The majority of the letter has to be about prostitution. For example, if the letter is about human trafficking, and prostitution is only shortly mentioned, the letter is not relevant.

## **Information need 5**

### Query

```
<topic number="5" >

```

```
<query>crimin* AND (bestrijding OR aanpak OR maatregelen)</query>

```

```
<description>I want to know the actions the municipality of Amsterdam is taking to reduce crime rates.</description>

```

```
</topic>

```

### Guidelines

* If the letter is not specifically about the actions the municipality is taking (i.e. just about criminality in general), it's not relevant.
* The letter can be about any form of crime, as long as it's really a crime. Use the list of crimes on Wikipedia.
* If the letter is just about criminals, but not about their criminal activities, the letter is not relevant.
* The theme of the letter should be criminality (and the fight against crime). If these are just mentioned in one or two sentences, the letter is not relevant.