I have noticed similar behavior when I have used the watch when flying in a pressurized cabin. After switching the watch to the altimeter mode it takes a few seconds for the watch to update the altitude.
I suspect that the watch does not keep continuous altitude records unless you are recording altitude or have the mode set to altitude. Perhaps this is a way of saving power.
