Airplay speak volume levels interferance

My volume controls will automatically adjust when the Airplay speak plugin is enabled. If I disable the plugin they will behave as expected. The behaviour is a little erratic. Sometimes the volume will stay put when adjusting through hstouch then I will adjust another speaker and the volume of the speaker that was originally adjusted will move.
Is this by design? Am I now supposed to adjust the volume in ItunesDAAP?