#evil santa | Explore Tumblr Posts and Blogs

tlbodine · 1 year

Text

In Which I Try to Coach ChatGPT Into Taking My Job From Me, Part 1

AI is the hot-button issue of the day, and for good reason. Though these tools have been in development for a long while, they're only just recently burst fully into popular awareness, and people are justifiably concerned about what a change this revolutionary and advanced will do to the future of...well...everything!

I am not an expert in AI by any means. But I do have an interest in it, thanks to reading a lot of @aiweirdness over the last few years, and I've played around a bit with several of the available programs. I wanted to conduct a little experiment, and post the results here, for folks who are curious about the writing capabilities of Open AI's ChatGPT, which is the writing aid people are buzzing about the most lately.

First, a disclaimer: The generative art debate is its own thing and in some ways a separate issue. I have a lot of thoughts about it, some of which I've already shared, but I'm not going to get into them in this post. I want to focus purely on writing here because 1.) I haven't seen it explored as much lately and 2.) that's what I have the most professional stake in. I'm much more qualified to talk about writing than visual art!

With that out of the way, buckle in, because this is gonna be a long one.

First, A Quick Primer on WTF Natural Language Processing Is

OK. Like I said, I'm not an expert in this, but I'm going to try to explain it as best I can.

The text-based AIs utilize machine learning to do what is called "natural language processing." Basically, that means that you give the system a sample of writing to work with, and then it generates text one word at a time based on a probability formula of what word is most likely to follow. It's basically a souped-up version of the predictive text on your phone.

Because GPT3 is trained on basically the entire indexable internet, it has "read" countless blogs and articles and thus has "learned" language really well, in a paint-by-numbers sort of way. Which is to say, it can do a reasonably good job of responding in a way that sounds about right when you ask it a question, but it doesn't "know" what it's talking about.

Let me show you what I mean.

The Experiment

I recently wrote this article for my newsletter: https://tlbodine.substack.com/p/a-dark-and-merry-christmas-to-you

It's about the "killer Santa Claus" trope in horror movies. In the article, I briefly summarize the horror history of the trope -- where it seems to have originated and how it evolved, naming the examples -- and then propose that Evil Santa is a reflection of both 1980s consumer culture and homophobic/transphobic psychosexual prudishness.

I don't know whether that analysis is necessarily correct or stands up to the most rigorous academic scrutiny, but I think I make a compelling case for it and it's interesting to talk about!

But what about an AI? Could I prompt it into coming up with an interesting analysis on its own? And could I get it to a point where it would repeat my same arguments?

First, I asked it just to write me a blog post explaining why "evil santa" movies might be popular. Here's what it came up with:

There is something inherently unsettling about the idea of an evil Santa Claus, and this is likely why horror movies featuring such a character have gained a significant following. The figure of Santa Claus is deeply ingrained in many people's holiday traditions and is typically associated with feelings of joy, cheer, and generosity. However, when this familiar and beloved character is twisted into something malevolent, it can be particularly disturbing and unsettling.

One reason why evil Santa movies may be popular is that they tap into people's underlying fears and anxieties. Many people have a natural fear of the unknown and unfamiliar, and the idea of a Santa Claus who is not the jolly, gift-giving figure we are accustomed to can be disturbing. Additionally, the holiday season is often a time of heightened stress and anxiety for many people, and horror movies can serve as a way to cope with and process these feelings.

Another reason for the popularity of evil Santa movies may be that they offer a fresh twist on a well-known and beloved character. When Santa Claus is depicted as evil, it adds a new level of intrigue and excitement to the story. It also allows filmmakers to explore the darker side of the holiday season and to challenge our expectations and assumptions about what the holiday season is supposed to be.

Overall, horror movies featuring evil Santa Claus are popular because they tap into our natural fears and anxieties, offer a fresh twist on a well-known character, and allow filmmakers to explore the darker side of the holiday season. If you are a fan of horror movies and are looking for something different and unique this holiday season, consider checking out a film featuring an evil Santa Claus. Just be prepared for some scares!

On the surface, this looks pretty good! It provides a couple of points, makes some arguments, and has a coherent structure. Scary!

But it is a bit vague, isn't it? It repeats variations on the same phrase and makes arguments without really digging into them. It's a surface level read. So let's see if we can push it a bit.

I asked: Explain with examples how the "evil santa" character has developed over time in film

To which it gave me:

The "evil Santa" character has undergone a number of developments over time in film. Here are a few examples of how this character has evolved:

Early portrayals: One of the earliest portrayals of an "evil Santa" character can be found in the 1934 film "Santa Claus." In this film, the character of Santa is depicted as a tyrant who terrorizes and enslaves the elves in his workshop. This portrayal marked a departure from the traditional, jolly and benevolent depiction of Santa Claus that was prevalent at the time. The "Krampus" trend: In more recent years, the character of Krampus, a demonic figure who serves as the "anti-Santa," has gained popularity in horror films. Krampus is typically depicted as a horned, goat-like creature with sharp claws and teeth who punishes naughty children during the holiday season. The 2015 film "Krampus" and its sequel "Krampus Unleashed" are notable examples of this trend. Psychological thrillers: Some horror films featuring an "evil Santa" character have taken a more psychological approach, depicting Santa as a figment of the protagonist's imagination or as a manifestation of their inner demons. The 2006 film "Black Christmas" is an example of this type of portrayal, with Santa being portrayed as a serial killer who stalks and terrorizes a group of sorority girls. Satirical comedies: In some cases, the "evil Santa" character has been portrayed in a more humorous or satirical light. The 2003 film "Bad Santa" is an example of this, with Billy Bob Thornton playing a misanthropic and alcoholic mall Santa who gets mixed up in a heist.

Overall, the "evil Santa" character has undergone a number of developments over time in film, ranging from early portrayals as a tyrannical figure to more recent portrayals as a demonic figure or a manifestation of inner demons.

I bolded a couple of things in here that are interesting. First, I am pretty sure the AI straight-up invented that 1934 film. I can't find anything matching that description. That's a straight-up Goncharov-level fiction, as far as I can tell. (There are several stories online about enslaved elves and tyrannical Santa Claus, so it didn't invent that concept, but it sure didn't come from 1934. Interestingly, that was the date "Santa Claus is Coming to Town" the song was written, and the year a newspaper sponsored a "Santa Claus Expedition" to the North Pole, so it was a big year for Santa. Maybe that's where it pulled that date from. Also, go look up that expedition, it's bonkers)

Some smaller inaccuracies: "Krampus Unleashed" is not the sequel to 2015 Krampus, it's the sequel to "Krampus: The Reckoning" (which also came out in 2015). And while the killer in the 2006 "Black Christmas" did dress as Santa, I'm not sure I'd categorize it as "a figment of his imagination" or even a "manifestation of inner demons." Interestingly, the AI here completely skips multiple other examples, while straight-up fabricating some responses.

In my original essay, I make the case that there's a very similar template or origin story across multiple of these movies. I wanted to see if the bot could identify that pattern and find any examples. So I asked: Explain how the films "Silent Night, Deadly Night" and "Christmas Evil" introduce a template for evil santa claus movies and provide examples of other movies that follow that template

To which it replied:

"Silent Night, Deadly Night" and "Christmas Evil" are two films that helped to introduce a template for evil Santa Claus movies. In both films, the main character is a seemingly normal man who is driven to madness and violence by his obsession with the holiday season and his belief that he is Santa Claus.

The template introduced by these films involves a protagonist who is initially depicted as a normal, if somewhat troubled, individual. However, as the film progresses, their obsession with the holiday season and their belief that they are Santa Claus begins to consume them, ultimately leading them to commit acts of violence and terror.

Some other movies that follow this template include:

"Black Christmas" (2006): This film follows a group of sorority girls who are stalked and terrorized by a serial killer posing as Santa Claus. The killer's obsession with the holiday season and his belief that he is Santa Claus are key elements of the story. "Sint" (2010): In this Dutch film, Sinterklaas, the Dutch version of Santa Claus, is depicted as a vengeful and bloodthirsty figure who is responsible for a series of murders in a small town. The character's obsession with the holiday season and his belief that he is Sinterklaas drive his actions. "Rare Exports: A Christmas Tale" (2010): This Finnish film follows a group of people who discover that the "real" Santa Claus is a malevolent, ancient being who has been imprisoned in the depths of the earth. The character's obsession with the holiday season and his belief that he is Santa Claus drive his actions.

Overall, these films and others like them follow a template established by "Silent Night, Deadly Night" and "Christmas Evil," depicting a protagonist who is driven to madness and violence by their obsession with the holiday season and their belief that they are Santa Claus.

This is fascinating. It sounds good on paper, except it is...mostly wrong? Like, okay, first, a subtle distinction: the killers in the two films I chose as examples aren't just obsessed with Christmas and consumed by a delusion about being Santa. They're both guys who have sexual trauma related to Santa Claus, who descend into their violent state when those memories resurface later. The bot has completely missed the sexual element here (which may be due to some content moderation guard rails installed by OpenAI, or may just be that it didn't connect those dots).

But more importantly, the samples it chooses to describe...are only kinda-sorta accurate as to the plot of those films? It repeatedly makes the identical claim about the character's obsession/delusion, but that argument doesn't logically follow from what it's talking about, and doesn't really make sense if you've seen the movies (for example, the creature in Rare Exports really is a Santa Claus, in the sense that Santa Clauses are troll-ish creatures of animal type intelligence in the film).

In other words, it seems like the bot is just shoe-horning in explanations that make semantic sense but don't actually say anything.

I figured, okay, I'll throw it a bone and give it more guidance. I provided the same outline as my own essay:

Write a blog post following this outline: 1 - Evil Santa movies are more popular than ever; 2 - why people like horror about the holidays; 3 - the origins of evil Santa in film, with examples; 4 - why santa claus is such a uniquely good horror symbol; 5 - what evil santa as a trope has to say about society

Following this framework, it had this to say:

Evil Santa movies are more popular than ever, with a number of new films and television shows featuring malevolent versions of the holiday icon being released in recent years. So why do people seem to enjoy horror about the holidays, particularly when it involves Santa Claus?

There are a few reasons why people might be drawn to horror movies featuring evil Santa Claus. First, the holiday season is often a time of heightened stress and anxiety for many people, and horror movies can serve as a way to cope with and process these feelings. Additionally, the figure of Santa Claus is deeply ingrained in many people's holiday traditions and is typically associated with feelings of joy, cheer, and generosity. When this familiar and beloved character is twisted into something malevolent, it can be particularly disturbing and unsettling.

The origins of evil Santa in film can be traced back to the 1934 film "Santa Claus," in which the character is depicted as a tyrant who terrorizes and enslaves the elves in his workshop. This portrayal marked a departure from the traditional, jolly and benevolent depiction of Santa Claus that was prevalent at the time. In more recent years, the character of Krampus, a demonic figure who serves as the "anti-Santa," has gained popularity in horror films. Krampus is typically depicted as a horned, goat-like creature with sharp claws and teeth who punishes naughty children during the holiday season.

Santa Claus makes for a uniquely good horror symbol because he is so deeply ingrained in holiday traditions and is typically associated with feelings of joy and cheer. When this familiar and beloved character is twisted into something malevolent, it can be particularly disturbing and unsettling. Additionally, the holiday season is often a time of heightened stress and anxiety for many people, making it the perfect setting for a horror story.

Finally, the evil Santa trope can be seen as a commentary on society and our expectations for the holiday season. Many people have certain expectations for the holiday season, including gift-giving, family gatherings, and acts of generosity. When these expectations are not met, it can be unsettling and disappointing. The evil Santa trope can be seen as a way of exploring the darker side of the holiday season and challenging our assumptions about what the holiday season is supposed to be.

This regurgitates a lot of the same talking points from that first blog post it generated, including the fabricated 1934 movie. It's sticking pretty firm to its initial analysis, which, hey, respect. But it continues to be quite vague, not offering up specific examples, and it doesn't do a very compelling job of explaining how these Santa movies reflect society.

So what if I just straight-up ask it about my proposed thesis?

I asked: in what ways do horror depictions of santa claus overlap with horror depictions of crossdressing and transgender killers such as in "dressed to kill"

ChatGPT was not in the mood to play along, though:

It is not accurate to say that horror depictions of Santa Claus overlap with horror depictions of crossdressing or transgender killers. The character of Santa Claus, as depicted in horror movies, is not typically associated with issues of gender identity or expression in any way.

In contrast, the character of the killer in the film "Dressed to Kill" is a crossdresser who commits murders while dressed in women's clothing. This character is depicted as a disturbed and predatory individual who uses their appearance as a means of manipulating and deceiving their victims.

It is important to note that the portrayal of crossdressing or transgender characters in horror movies is often stigmatizing and sensationalized and can contribute to negative attitudes and misconceptions about gender identity and expression. It is not appropriate to conflate the character of Santa Claus with these types of characters or to suggest that there is any inherent connection between the two.

Damn. Shut down. It is relevant here that it provides this sort of disclaimer -- that is, again, a guardrail imposed by OpenAI, as far as I can tell.

But okay, okay, fine. My argument for the psychosexual santa claus is a little "out there." What if I ask it about a much easier thematic needle to thread?

I asked: How does 1980s consumer culture influence the popularity of evil santa claus characters in horror from that decade?

It is not accurate to say that consumer culture in the 1980s had a significant influence on the popularity of evil Santa Claus characters in horror from that decade. While consumer culture may have played a role in shaping the overall cultural context in which these movies were produced and consumed, it is not a primary factor in the popularity of evil Santa Claus characters specifically.

It is worth noting that the 1980s did see a significant proliferation of horror movies featuring malevolent versions of Santa Claus, including films like "Silent Night, Deadly Night" and "Christmas Evil." These movies may have resonated with audiences in part because they tapped into people's underlying fears and anxieties, offered a fresh twist on a well-known character, and allowed filmmakers to explore the darker side of the holiday season.

Overall, it is difficult to attribute the popularity of evil Santa Claus characters in horror movies to any single factor, and consumer culture in the 1980s may have played a role, but it is not the primary driving force behind this trend.

Shut down again :( I think it's interesting that it remembers those two movies (which we already brought up!) but doesn't know any other examples to mention, despite there being several more. Otherwise, it once again regurgitates its previous claim and doesn't really seem capable of speculating beyond it.

So what does all of this mean? Here are my takeaways from this experiment:

1 - ChatGPT can produce seemingly impressive output, but it's shallow; if probed for additional context or depth, it starts to fall apart. It regurgitates the same talking points and repeats information that you feed to it, like a student bullshitting his way through an essay question on a test he didn't study for by pulling keywords from the other test questions.

2 - ChatGPT will just straight up lie. Well, "lie" implies it knows what it's doing, which isn't the case. It's just stringing together statistically probable sentences based on a language learning model that operates off best guesses. But it will confidently spit out completely fabricated information

3 - ChatGPT can't do research. It's a language model, not a search engine. So while it does "know" some stuff, that information is all mixed up with nonsense.

4 - ChatGPT doesn't seem very good at providing deep analysis or supporting arguments. Its claims are decent on the surface, but don't withstand a ton of probing.

In my professional opinion, the type of work I've seen coming out of ChatGPT (not just in this experiment, but in others I've conducted) is on par with like...a high school bullshit essay, or the kind of low-level content writing you can get for cheap on Fiverr. It might pass muster grammatically and have a decent structure, but it lacks substance.

By its very nature, a natural language model AI like this is always going to deliver the most obvious, written-by-committee, lukewarm takes and text, because it literally is written by consensus. That might be good enough to fool the search engines, but it's not going to be very interesting for human readers. (and history suggests that Google is perpetually interested in making its search tools more fine-tuned toward human readers rather than machines - I don't think that trend will break any time soon).

Now, all of this is not to say that an AI can't ever get good at these things, and lord knows scientists will keep on trying because that's just what they do. But, based on my understanding of the tech, I don't think it's...as likely to get "better" at writing as we might fear.

Like, in humans, there's a sort of natural progression where, with practice, a person might go from "writes nonsense stories" to "writes decently structured but really obvious essays" to "can reliably bullshit their way through something" to "starts communicating unique opinions" to "writes compellingly and insightfully."

But I don't actually think AI "brains" develop in that same way, because machine learning doesn't actually perfectly mimic human learning. I think the jump to "has unique opinions" is some Turing-test shit that is a lot further out than we think. (If someone is an expert in this and wants to tell me I'm wrong, please jump in and explain it to me).

Until then, there are a lot of skills that competent professional writers have, which don't seem to come easily to the AI:

Unique opinions, beliefs, and insights

An empathetic understanding of the reader's needs

Rhetorical strategies for being persuasive or otherwise stirring emotion

Poetic devices and figurative language to create a particular effect

An understanding of how metaphors work

The ability to research and weave together examples from multiple sources to provide supporting arguments

The ability to change authorial voice and tone to meet strategic needs

An understanding of strategy in general

Some of this you might be able to prompt and nudge an AI into doing, but someone who understands the strategy and how to communicate it would still need to be in the driver's seat.

So, in sum...AI is really impressive, but it's nowhere near expert-level writing, even with significant prompting. Our jobs aren't gone just yet. (and y'all should go read my damn Bad Santa essay, I worked really hard on it)

#long post #ai #chatgpt #writing #analysis #santa #evil santa #in which i talk to a bot about santa claus #ai may be coming for us #but its media literacy is shit

13 notes · View notes