I visited Beitou hotsprings about 45 minutes train ride from Taipei. It kind of makes you feel like you are in Japan, but it's just a little bit different.
In the video below you can see a trip I made to Chichibu Onsen in Chichibu city of Saitama, Japan (about 2 hours from Tokyo).