bottom-sheet: Allow swipes mid-animation if there's a bottom sheet

We don't allow it otherwise as then it might prevent programmatic closing. Here though it's fine.