You'll get an objective to go to this location so unless you just want to get it out of the way right at the start, you may as well wait til you go there anyway.
In the Northwest corner of Sandswept is a set of ruins (North of the Solar Station). You have to follow a ravine to get there, traversing some water hazards along the way. You'll know you're in the right place s there'll be a big opening in the cliff face with a giant stone arch over it. To the left of the opening (between some pillars) are 3 black and red vases. Run them over and the achievement will pop.