Why can't i wear du rags?

what is the big deal about white people wearing du rags its the same thing as a biker one or the one hankercuff kind. I like them and I'm white and there are some people out there that say I have to be black why whats the big deal.