Olivier never wanted to get back on to the big boat