This just builds the "what-did-you-plugin" test application, but it's
good enough to catch the worst failures.