Downing College has begun work to demolish former restaurant and bar, Cuba Libre, to make way for new student accommodation.