Keep a separate flag for notify handlers
We currently keep a flag for whether an object has ever had any signal handlers. But even if it had signal handlers, it may not have any notify handlers. Keep that information separately, so we can speed up property setting.