@Law:
It does not matter when they went to the surface of the new world they were right next to the island however Nami said they could have gone to one of the 3 island's but Luffy picked PH because the thing on Nami's arm said it was the more dangerous than the other three choices.
The Strawhat's had 4 islands to pick from when they went to the surface of the world and they picked the hardest one out of the 4 which normal pirates don't go to because fishman island does not point to it or its the most dangerous choice also the samurai seems to know the way back to his home island so the island does not even need to point to another island.
Read the chapter again. They technically had a choice of 3 islands, and Punk Hazard wasn't one of them. They only went there because Luffy said "it looks fun", none of the needles were pointing to it.