Couldn't they use one the unknown brokers as a villain for this arc? I'm sure Oda isn't planning on using each and every one of those in the manga, so…
You were right. The guy 'breed' in the filler seems to be related to underworld since he knows the alias 'Joker' and has intended to use Caesar for his own nefarious purposes, knowing his field of work.