I think the difference with speakers is that a good amateur, armed with the correct tools and some reasonable background knowledge, can do very well. Whether they can compete with the very top of the market is up for debate, but it's well established that in the mid-price bracket, it can be very worthwhile so long as you don't mind taking the time to do it. If you're worried about the time involved, don't do it.
The high-end is where it gets complicated, and it depends on who the person doing this is. DIY equipment, both loudspeakers and electronics, can perform with the best of the best... but keep in mind, that it depends on who designed it. There are a good number of people on the diyaudio.com forum who are extremely smart. Many are physicists and engineers who build audio equipment as a hobby, others have worked in the pro-audio industry for decades.
Generally speaking, however, people who are into DIY audio projects are usually just as interested in the design and build process as they are in the usage of their gear. If you don't have an interest in either the construction or the engineering side of it, then I don't see as big an advantage.
Amir has only measured a few DIY speakers, and as far as I know they have all measured well for what they are. Two have gotten his recommendation, and the one that didn't (The Zaph ZA5) is a 5" 2-way optimized for midrange, and the measurements show that it performs well in that regard.