> Full SurrealDB documentation index: https://surrealdb.com/docs/llms.txt

# Vulcan, Alberta: the answers side by side

Three questions about the Wikipedia article on Vulcan, Alberta, each answered by Claude Haiku 4.5 with SurrealDB Agent Memory and by Claude Sonnet 5 reading the page and its history, with the recall result that held the answer.

This page puts you in the place of someone testing the [Vulcan, Alberta demo](/docs/agent-memory/cookbooks/showcase/vulcan.md). Each question goes to two agents that have the same information available to them, and the tables show exactly what came back:

- **Haiku 4.5 with Agent Memory.** The smallest and cheapest Claude model, connected to Agent Memory, which holds the article's 24-year edit history.
- **Sonnet 5 with the page and its history.** A larger model that can fetch today's article, every old revision and the MediaWiki API.

The difference is how they reach the information: the first asks Agent Memory a question, and the second has to decide which pages to open. Each answer is quoted from the first of three runs, shortened where `...` appears, with dashes shown as hyphens. Each answer is scored from 0 to 2 against a written answer key.

| Question | Haiku 4.5 with Agent Memory | Sonnet 5 with the page and its history |
| --- | --- | --- |
| Is there a Star Trek museum in Vulcan? | Scores 2 in every run, $0.041 | Scores 0 in every run, $0.054 |
| Did Leonard Nimoy ever visit Vulcan? | Scores 2 in every run, $0.046 | Scores 1 in every run, $0.052 |
| What did the article say about hospital use in Vulcan? | Scores 2 in every run, $0.043 | Scores 1 in every run, $0.053 |
| What did the article say about the population in 2008? | Scores 1, 1 and 2, $0.068 | Scores 2 in every run, $0.123 |

The cost is for the first run.

## Is there a Star Trek museum in Vulcan?

The article said from 2014 to 2018 that the TrekCetera Star Trek museum opened in Vulcan in 2013. The edit that removed the sentence explains that the museum moved to Drumheller in 2017.

| | Haiku 4.5 with Agent Memory | Sonnet 5 with the page and its history |
| --- | --- | --- |
| **Tool calls** | One `recall`, with the query `Star Trek museum Vulcan` | One fetch of today's article |
| **Cost** | $0.041 | $0.054 |
| **Score in three runs** | 2, 2, 2 | 0, 0, 0 |
| **Answer** | "Based on the Wikipedia article edit history, there **was** a Star Trek museum in Vulcan, but it no longer operates there: **TrekCetera Star Trek museum opened in 2013** in Vulcan (revision 594700809, Feb 9, 2014). **The museum moved to Drumheller in 2017** (revision 857446819, Aug 31, 2018)..." | "Not exactly a 'museum,' but yes - Vulcan has a Star Trek-themed attraction: the **Vulcan Tourism & Trek Station**, a tourist information building designed to look like a landed space station, which displays a donated collection of *Star Trek* memorabilia..." |

Today's page says nothing about the museum, so nothing on it suggested opening an older revision. The second hit in the result from Agent Memory was the edit that removed the museum:

```text title="Part of the recall result"
Wikipedia article "Vulcan, Alberta", revision 857446819, saved 2018-08-31T19:07:37Z.
Edit summary: The Trekcettera moved in 2017 to Drumheller.

This edit removed the following text, so from this point the article no longer says:
- (Tourism) In 2013, the TrekCetera Star Trek museum opened in Vulcan.
```

## Did Leonard Nimoy ever visit Vulcan?

He visited in 2010. Before that, from 2004 to 2007, the article said that the town had tried for years without success to arrange a visit.

| | Haiku 4.5 with Agent Memory | Sonnet 5 with the page and its history |
| --- | --- | --- |
| **Tool calls** | One `recall`, with the query `Leonard Nimoy visit Vulcan` | One fetch of today's article |
| **Cost** | $0.046 | $0.052 |
| **Score in three runs** | 2, 2, 2 | 1, 1, 1 |
| **Answer** | "Yes, according to the Wikipedia article on Vulcan, Alberta, Leonard Nimoy visited the town in 2010... This represents a change from earlier versions of the article. A 2005 revision (revision 30495539, saved 2005-12-07) noted that 'The town has tried for many years, without success, to arrange a visit from Leonard Nimoy'..." | "Yes. According to the current Wikipedia article on Vulcan, Alberta... Leonard Nimoy visited the town in 2010, where he was honoured at the town centre with a bust and handprint." |

Both answers are correct about 2010. Only the answer from Agent Memory says that the article once told a different story. The top hit in its result was the 2004 edit:

```text title="Part of the recall result"
Wikipedia article "Vulcan, Alberta", revision 15947874, saved 2004-10-31T08:32:26Z.
Edit summary: none.

After this edit, the article says:
- (Introduction) The town has tried for many years, without success, to arrange a visit from Leonard Nimoy - the man who made Mr.
```

## What did the article say about hospital use in Vulcan?

Today's page gives 5,125 emergency visits in 2013-14. From 2015 to 2019 the article also said that more patients were admitted to hospital in Vulcan than in the general Alberta population, until an edit on 2019-05-09 removed it with the summary "Removed irrelevant statistical data".

| | Haiku 4.5 with Agent Memory | Sonnet 5 with the page and its history |
| --- | --- | --- |
| **Tool calls** | Two `recall` calls, with `hospital use in Vulcan Alberta` and `hospital healthcare facilities Vulcan` | One fetch of today's article |
| **Cost** | $0.043 | $0.053 |
| **Score in three runs** | 2, 2, 2 | 1, 1, 1 |
| **Answer** | "The hospital had **5,125 emergency visits in the 2013/2014 year**... It had **eight medical beds and 15 long-term care beds**... The article initially stated that **more patients were admitted to hospital in Vulcan than in the general Alberta population**, but this claim was removed in a 2019 edit (2019-05-09, revision 896210790)" | "**Usage data:** The hospital had **5,125 visits for emergency medical services in the 2013/2014 year**... **Capacity:** 8 medical beds plus 15 long-term care beds" |

The answer from today's page is accurate, and it is missing the one claim that the question was about. One hit in the result from Agent Memory was the 2015 edit that added the claim:

```text title="Part of the recall result"
Wikipedia article "Vulcan, Alberta", revision 677844904, saved 2015-08-25T21:51:28Z.
Edit summary: Added healthcare information with embedded healthcare infobox and reorganized photos for improved layout.

After this edit, the article says:
- (Healthcare) Vulcan Community Healthcare Centre offers emergency and longterm care medical services.
- (Healthcare) The hospital had 5,125 visits for emergency medical services in the 2013/2014 year.
- (Healthcare) More patients are admitted to hospital in Vulcan than in the general Alberta population.
- (Healthcare) It has eight medical beds with 15 long term care beds and hosts a medical clinic.
```

## Where reading the history does better

Reading the history is the better approach when the question names a point in time, because the agent then knows which revision to open.

| | Haiku 4.5 with Agent Memory | Sonnet 5 with the page and its history |
| --- | --- | --- |
| **Tool calls** | Two `recall` calls, with `Vulcan population 2008` and `Vulcan 2008 population census demographics` | Four: today's article, the list of revisions, an API query for the last revision of 2008, and that revision |
| **Cost** | $0.068 | $0.123 |
| **Score in three runs** | 1, 1, 2 | 2, 2, 2 |
| **Answer** | "The article does not contain specific population data for 2008... **2006:** Population was 1,940 (added in revision 138000783, 2007-06-13)" | "The article does not give a population figure specifically for 2008. The closest data point around that time was the 2006 census figure of 1,940 (town) / 3,718 (county), which is what the article still showed as of its last 2008 revision." |

Both agents found the 1,940 figure. Sonnet 5 tied it to what the article showed in 2008, which is what the question asked, at nearly twice the cost. Haiku 4.5 is the smallest model in the demo, and the result changes with the model rather than with Agent Memory: Sonnet 5 with Agent Memory scored 2 in every run on this question, the same as Sonnet 5 reading the history. In its first run it made three `recall` calls, at a cost of $0.283, and answered that "throughout 2008, the standing population statement was the one added on 2007-06-13... 'The population of the town was 1,940 in 2006'".

Across all 19 questions, Haiku 4.5 with Agent Memory scored 29.7 out of 38 at $0.061 a question, and Sonnet 5 with the history scored 25.7 at $0.096. The [results page](/docs/agent-memory/cookbooks/showcase/vulcan/results.md) has the scores for every model and set of tools, and its embedded demo has every answer to every question.