Thanks Twerppoet, but nothing seems to help, and in fact is getting worse :)
I deleted both my gmail and exchange account, and checked that there were no contacts remain. Then i rebooted, and added the two accounts back, and rebooted
Now, I still get the outlook contacts being used in the...