Resampler flush raises a bug when resampling from different original sample rates

When trying to resample an `AudioData` that has items of different sample frequencies, I have the following error:

```py
IndexError: index 0 is out of bounds for axis 0 with size 0
```