In most cases, you want an ATM at a major airport, or one branded as 7&ibank (7-11) or JPBank. (post office)
Other ATMs generally won't take overseas cards, though some are starting to.
The post office ATMs are now charging ~200yen to process an overseas transaction.