So I unplugged the battery for the controller and reset everything and it seems to be working. It's night so I haven't put the props on and flown yet but I'm a little relieved.
Now let me tell you why first and most important thing to try is always REMOVE the battery.
The switch on the controller is not a physical switch, I call it SOFTWARE switch. A real physical POWER OFF switch is when a a true battery total disconnect occured...hence remove the battery is the way to go.
Its the same as a GoPro or any smartphone ( where battery is removeable ) or any laptop, we need to remove battery at least for a while to totally able to boot the unit from zero. Some design has good capacitors and may hold charge longer than others. So unplug the battery for say 10 minutes and try to power ON, to really deplete everything on the unit motherboard.
In this age of advance electronic, battery unplugging seems a must do , as many device do not anymore use physical POWER OFF/ON switch.