That's the joke, yeah, but like we said, it would be funnier if Penelope got angry, instead the constant look on her face is horror. There's also the fact that Pepe is always kissing her face, which as a woman I can say is just cringe-worthy, not funny. It probably would be funnier if he were kissing her hand (which isn't that what flirty Frenchmen do?).