Matplotlib lags with the qt5 backend

[impact27]

To reproduce:

%matplotlib qt5
import matplotlib.pyplot as plt
plt.plot([1, 2, 5])

Then select the pan button and move the plot continuously. It will stop for 1000ms from time to time.

Fixed by #573

[impact27]

Closing as #573 is merged