Object will not return to previous position

Whenever i move something using vr, when i replay the simulation, the object will not return to its previous location. Instead, it goes to the center of the map.