mainloop-test: Fix race conditions

• Wait for adder threads before deallocating crawler_array and context_array to avoid use after-free and data race.
• Handle spurious wakeups around g_cond_wait.
• Avoid starting recurser_idle without context.

Fixes issue #1530 (closed).