Yeah that makes sense. But I don't think Moria is a toy maker that Doffy bought with him 10 years ago. Their discussion at the end of Marineford may have had some connection in it and Moria was surprised Doffy was attacking him (random guess). Unless Moria switched from TB to Dressrosa frequently. His where abouts is unknown, including Kaido incident which may have been part of it since Doflamingo is dealing with Kaido
This might have been replied to already but you all seem to forget that the humans would still have to be around somewhere. And after Moriah's power they burst into flames when being exposed to sunlight so this is very unlikely.