I have noticed that this behavior improves to some extent when starting Adium in debug mode (hold option key when launching)
It does not work always though.