The location service arrow is always visible when tracking is enabled. This is completely normal. Moves uses different kinds of location services to track your moves. In particular, it uses low power location services when you stand still, and more accurate and battery-expensive location services, such as GPS, once you start moving.
You can find more information about iPhone location services here.