Can someone steal your Bitcoin with your wallet address?

Could you please explain in detail if it's possible for someone to steal my Bitcoin simply by knowing my wallet address? I've heard conflicting information and I'm a bit concerned about the security of my funds. Is there any way that they could access my wallet or transfer my Bitcoin without my permission if they just have this information? I'd greatly appreciate your insight on this matter.