How To Follow Buddhism Without Offending

I am wondering how to go about starting on the path of Buddhism without offending or appropriating the culture. As a white male I am well aware that I am privileged with the ability to overlook the repercussions of my actions when adopting a new practice/lifestyle what have you. I have spent nearly four years with a great interest in buddhism, reading books, texts, and listening to others talk about it - but I've always felt uneasy declaring myself buddhist. I don't want to be seen as "some white guy with an obsession with asian culture" and I also don't want to offend those who's cultures were shaped by it. I guess what I'm asking is - how can I start myself on the path respectfully in a manner that shows my true reverence for the teachings of the Buddha? I have privately tried my best to follow the path for some time now, but I've realized I can never truly embrace it until I find the courage to be open about it. Advice?