I finally found the problem and it's a big surprise. The battery is good, but the size of the battery is slightly off. It is slightly shorter than the original one. So, when inserted, the three metal pins of the battery are not all tightly locked with the tablet. Seems, the tablet knows the battery which is why the splash screen shows up but feels something is wrong then shutoff. I actually used a multimeter to measure the voltage between the three metal pins and they are different. They are all required to be in good contact with the tablet. I put some tape and firmly push the battery, the tablet powers up normally.

This is a surprise! It's neither totally off contact nor tightly locked, I called it half contact. Hope this can give some one additional clue if the 3rd party battery has problem.
Thanks for all who gives the suggestions!
Cheers!