A little room to wonder

Search & Indexes

Build a small word-to-record lookup and check how its rules differ from the meaning or trustworthiness of the results.

How can a list of words help locate a record without rereading everything?

A grey IBM punched-card sorting machine with cards in a row of output compartments.
The approved punched-card equipment provides a historical data-organisation context. Its photograph does not depict the article’s word index or Horizon’s search implementation.waelder · Source · CC BY 2.5

An index is a prepared route to records

An index organises information so that a later lookup can follow a prepared structure. In a simple word index, each word points to the IDs of records containing it. This reverses a document-to-words description into a word-to-documents lookup.

An index must be built from something. Choosing titles alone, full text or manually supplied tags changes which matches are possible. Faster lookup does not automatically mean broader coverage; the prepared representation determines what can be found.

Make word rules explicit

A paper index can lower-case letters and separate words at spaces, provided those rules are stated. More complex systems may handle punctuation, language and word variants differently. “Contains these exact words” is a different rule from guessing a related topic or predicting what someone intended.

The teaching index here is fictional. It is not a description of Horizon’s internal search code or a request to upload queries or build a database. The same conceptual question can be explored with a few records and a pencil.

Worked example: intersect two lists

Use three invented titles: A, Blue Paper Boats; B, Paper Robot; C, Blue Leaf Map. The word blue points to A and C; paper points to A and B. Requiring both words leaves their intersection, A. Allowing either word produces the union, A, B, C.

There are two matches for each individual word, one for the both-words rule and three for the either-word rule. The different totals reflect a stated query rule. They do not show that A is more accurate, more useful or more trustworthy than the other records.

An index needs maintenance and judgement

If a title changes but its index entry does not, a lookup can return an outdated result or miss a new one. Recording stable IDs helps distinguish a record’s identity from its current display name. Removing a record also requires maintaining any pointers to it.

Retrieval and evaluation remain different tasks. A matching word is evidence of a text relationship, not proof that a source is correct. Open the record, read its context and check the claim rather than treating a search position as an endorsement.

Only if you feel like trying

Build a three-record paper index

  1. List the words and record IDs from the three supplied titles.
  2. Answer blue AND paper and blue OR paper using intersection and union.
  3. Rename one title and identify every index entry that would need review. No real search history or personal records are needed.

Optional. Use paper or talk through the supplied fictional example. No purchase, personal information, account, public sharing or practical experiment is needed.