Docker on USB fails with symlink hostname when processing tar file after pulling image

I am running docker within a Linux Live system on a bootable USB stick. When I want to pull a docker image, it downloads files and then I get the following error:

docker: failed to register layer: Error processing tar file(exit
status 1): symlink hostname /bin/dnsdomainname: operation not
permitted

How can I fix this?

Source: StackOverflow