Caves. Diamond miners mine them. Most gemstones form in the Earth's crust, approximately 3 to 25 miles beneath the Earth's surface. Two gemstones, diamonds and peridot, are found much deeper in the Earth. Diamond forms in “kimberlite pipes” that originate in the Earth's mantle and end at the surface.