My findings:
After fastboot flash recovery 'xxxx.img', the phone gets CWM recovery.
Any operation performed to reboot or shutdown via fastboot, or using power button, will overwrite the CWM back to MiRecovery. That's why have to pull the battery after flashing recovery.
Then put the battery...