The prime minister says restrictions on what workers can do after leaving roles have "gone too far".