(but the majority of your life was with Japanese people so it would have been replaced with their accent.)
(In the accent argument, Sal's point is valid. If Tom was raised by japanese people, unless he was often surrounded by English natives as well, he'd adopt the Japanese-English accent.)