I think with the exception of yakuza Japanese people probably wouldn't get in your face about it. At least it's never happened to me (but then again, I've been careful never to shoot yakuza. Call me superstitious, but it's not worth it). But I also have gotten some nasty looks. If anyone ever had a problem I would be more than happy to delete the shot, but hasn't happened yet.
I think with the exception of yakuza Japanese people probably wouldn't get in your face about it. At least it's never happened to me (but then again, I've been careful never to shoot yakuza. Call me superstitious, but it's not worth it). But I also have gotten some nasty looks. If anyone ever had a problem I would be more than happy to delete the shot, but hasn't happened yet.