Please do a compass plus level calibration first thing before next flight. This is not normal, not in any altitude controlled flight mode like FLYManual.I have updated to 2.4 and use iphone 6. I turn on the controller, turn on the solo, launch the solo app on my iphone and wait for gps. But of course gps is slow and sometimes never so I put it in manual mode and take off. Maybe go up quickly to 50 feet or so to wait for gps. But at this time there is no altitude info and when I release the left (throttle) stick solo just keeps racing towards the sky. Same thing happens if I use down throttle, upon release of the stick it just keeps coming down until I put in some up on the throttle to stop it. Once it has gps lock (I'm still in manual mode) altitude info returns and throttle performs normally.
Was it this way before the update?
And I can assume that you were not in Sport or Acro mode, otherwise yr Solo would be toast now

In stabilize it may slightly move up or sink downwards with center throttle stick, but certainly easy for you to handle.
Please report if the calibration fixed it.