While the study’s findings are intriguing, they come with several caveats. For example, the humor tasks were text-based and did not involve delivery, which is a critical component of humor. AI-generated jokes might not perform as well in formats that require timing and presentation, such as stand-up comedy or sketch shows.
This contrasts with a study by Google DeepMind that says, “most participants felt the LLMs did not succeed as a creativity support tool, by producing bland and biased comedy tropes, akin to “cruise ship comedy material from the 1950s, but a bit less racist”.” in this paper.