When adding or editing a calendar item, use Related contacts to tick one or more people from your Address Book. Notes can still be linked to one Related contact.
The contact page then shows linked upcoming items, recent past items, related tasks and related notes. This gives each contact a small Filofax-style history without automatically guessing which events belong to them.