So is this a retcon/ inconsistency/ plothole, or was Rayleigh lying, or did Oden have a relationship with the Roger and his crew such that he wasn't considered "one of them"?
! http://i3.mangareader.net/one-piece/507/one-piece-64854.jpg
Rayleigh's reply is in regards to Skypiea. Oden was most likely not with Roger at that moment since Wano is in the New World. A better answer with facts would be because Rayleigh states how Roger did what he did. Still, how would hearing the "Voice of All Things" allow Roger to carve on indestructible stone.