Although you are doing the correct thing yourself that is actually not correct about the legal aspect. The Highway Code says that they must be restrained and not be a distraction or, in case of an accident, become a danger to you or themselves. Where and how they are restrained isn't specified...