Nah the actual limitation is that providing people a way to transfer the token without paying a royalty is essential if you want to give people the option to freely transfer it between their wallets without selling it and paying a royalty. You could write a smart contract that does enforce this but then you would lose the ability to have that free transfer.