What would be the consequence if I remove the battery while it is still On?  Or if I did, what do I need to do to ensure everything is alright?

The majority of times nothing will happen but arcing on the power connector  could lead to contact issues down the road and in some cases the surge/brownout can lead to damage to electronic components.

good one - fly it around and let us know what happens