Nintendo of America is used to fans stopping by. You can go into the lobby, take photos with the statues, and grab pics of the sign outside. You just can’t go past the lobby or wander the building, but that’s clearly marked.
Staff won’t be annoyed as long as you’re respectful, don’t block entrances, and don’t try to push beyond the public area. People do this all the time. It’s very much a “look, take a couple photos, head out” situation.
If you’re worried, just be quick and polite. You won’t be the first or the last fan to do it.