When scrolling on map, location change (or moving phone) takes me back to my location on map

When I am scrolling on the map if I move my phone or if location is detected it takes me back to my original position. I have tried saving a “zoom” variable but it didn’t work. Any thoughts?