well judging by luffys strength alone, a significant improvment over the old luffy (being able to beat up a legendary pirate) strong world happened after the reunion of the SHs
(im not sure of this but it makes sense)
if they have reunified and theyve continued with their journey and the other 3 havent tagged along then that shows that they didnt join