We should disconnect the signal handlers in all cases when the sink and source disappears or is replaced.