You must enable Bard history for these features to work, and you must go to the extensions page and make sure they’re turned on. Arguing with a model that doesn’t have access to the extensions won’t make it suddenly use the extensions.

Summarizing my last 5 emails worked just fine with bard using that query.