Yes, very often it's the AU/VST plugins for the very simple reason that the plugin specifications are not well written enough. A lot of plugin authors just test in the popular hosts and whatever works in there should work elsewhere. Often this leads into problems on alternative hosts and many of them can never get it to fully stabilise since there's often no way to know what's going on. Randy, Camel Audio actually confirmed that Alchemy bug and should have fixed it in the latest version, it's not because other hosts work that there are no bugs.
bhinton, Bidule is a known problematic plugin since it increases the compatibility problems by adding another layer of hosting. I've had Bidule crash Logic, Reaper and Cubase many times.
So in the end, we did the best to make the plug in hosting as reliable as possible but it's an endless stream of new strange behaviour that takes an eternity to track down, with often not a real solution that can be found.
Note that we use Juce (http://juce.com) for the plugin hosting, which is the most popular open source solution for this. We've contributed back a large series of work arounds, but even in the smallest Juce-only host some problems still remain with certain AUs/VSTs. In the end we put the accent on making sure that the live-performance which using the plugins is as reliable as possible and did our best to make the shutdown as good as possible.