I have observed this on chrome for android as well. It seems to happen when I have no alerts, then use the back button to go back to a view from when I had alerts, then click a link to go to a fresh view. When I get to the fresh page view it will display the red zero for maybe a second before it updates.
Not a big issue I'd say.