Keep Your Eye on the (Moving) Ball!