When you have told the joke, move on. Don't try to explain it. Give the audience credit for enough intelligence to connect your story to what you have said so far, and to recall it as you progress.
If you have kept it relevant and structured your speech so that the humour is linked to your message, then this won't be a problem.
