Lots of dropped buffers & choppy audio/video

Steps to reproduce

Open cheese

Expected outcome

Video capture goes on smoothly

Actual outcome

Video is really choppy. These errors are shown in the journal

cheese[7205]: A lot of buffers are being dropped.: ../libs/gst/base/gstbasesink.c(3136): gst_base_sink_is_too_late (): /GstCameraBin:camerabin/GstViewfinderBin:vf-bin/ClutterGstVideoSink:cluttergstvideosink0: There may be a timestamping problem, or this computer is too slow.

Apart from that if I try gst-launch-1.0 v4l2src ! videoconvert ! autovideosink everything works seamlessly so it does not seem a GStreamer issue but something on top.