True. But all it takes to reopen the address book is a push on that blue plus sign.
I suppose letting you tick contacts, to add a group of contacts quickly would be more convenient. We'll see what iOS 5 brings. The mail app definitely could use an update, especially in regards to attachments.