Lettsom Gardens at sunset – image of a grassy sward with blossoming trees against an orange and purple sky

Workroom PlayTime 023: LLM comparison I

Jul 2, 2025

We'll gather on Zoom / Miro, on Thursday 3 July at 4pm London time (local time for you) to play together with testing stuff. (apologies – this said 4 July for a few hours)

We'll do the following exercise, where we compare several LLM's responses to the same prompt. We pick that prompt to be something in which we are already expert, so that we have something to judge against. We compare in several ways. I hope that the exercise will help use explore judgement.

LLM comparison – local knowledge
Compare LLM output – something obscure that you know well.

These exercises are for everyone, for free. Paying Subscribers get to play together every week. This week's is open to subscribers and friends: Subscribers will see joining info below. Pop your name on the Miro board if you're coming.

In other news:

Thank you for reading!

Cheers –

James

joining info and links below

Tags

James Lyndsay

Getting better at software testing. Singing in Bulgarian. Staying in. Going out. Listening. Talking. Writing. Making.