the person i reblogged this from is attractive and deservedly high-status, unlike me, who is an ugly lout who does not deserve such high status and who has never done anything worthy of high status except say mildly interesting things here on tumblr dot com, alas
The power to destroy a planet is insignificant next to the power of the Narrative.
The more I think about it, the more I feel that Star Wars would be better if they called "the Force" instead "the Narrative." I'm not just making that same old claim that the Force is essentially a narrative tool that lets the writers handwave anything for any or no reason; I mean, literally, just find-and-replace "the Force" with "the Narrative" in the scripts. Here, let's look at the top Google hit for "star wars quotes about the Force":
"I have no doubt this boy is the offspring of Anakin Skywalker... the Narrative is strong with him." Hoo boy, is it ever!
"The ability to destroy a planet is insignificant next to the power of the Narrative."
"Remember, a Jedi's strength flows from the Narrative."
"It is an energy field created by all living things." (Okay, this one's a stretch.)
"The Narrative surrounds you, Rey." (Spoken at the narrative climax of a trilogy focused on her!)
"Remember, the Narrative will be with you, always." Spoken to Luke, who is, indeed, dogged by the Narrative until and beyond his death.
"My ally is the Narrative, and a powerful ally it is."
(And Yoda continues on: "Luminous beings are we, not this crude matter." Spoken by a character who, at the time, was literally being projected onto a screen! Chef's kiss dot gif!)
It would be nice to write down “Tell me whenever policy X changes,” or “Tell me when covid rates surpass X,” or “Tell me what countries the US is bombing and why every 6 months,” or “Tell me when Chelsea Manning is next incarcerated or next released,” and then get automatic updates when needed so I don’t have to obsess over scary data or do tedious web searches on a regular basis to keep myself in the loop.
According to my understanding -- no, screw my understanding, according to GPT-Neo’s source code -- each decoder unit has a residual identity connection, so it outputs “x + F(x)” for some big complicated F, which is helpful because “the identity function is hard for NNs to learn” or whatever. And then you can view the stack of decoders as computing “x + F1(x) + F2(x) + F3(x) + ...”, making a series of incremental refinements to the input to ~continuously transform it into the output.
And viewed that way, it almost can’t help but produce nice smooth gradients on your logit-lens plots.
And yet, the 125M GPT-Neo appears to just produce random outputs on the intermediate layers before jumping straight to a reasonable guess on the last layer.
So... either your lens code doesn’t play correctly with GPT-Neo, or my “incremental refinements” understanding is nonsense (worse, useless nonsense). Sound about right?
Will write something up about this later, but here's something I made today:
logit lens on gpt-neo
This extends my old "logit lens" work to GPT-Neo. Turns out it ... doesn't exhibit the "logit lens" phenomenon at all????
A full commitment's what I'm thinking of
You wouldn't get this from any other guy
has very much the same energy as
...and you should take it into further consideration, that in spite of your manifold attractions, it is by no means certain that another offer of marriage may ever be made you.
"And in this wider context, part of me wonders if the focus on transmission is part of the problem. Everyone from statisticians to Brexiteers knows that they are right. The only remaining problem is how to convince others. Go on Facebook and you will find a million people with a million different opinions, each confident in her own judgment, each zealously devoted to informing everyone else.
Imagine a classroom where everyone believes they’re the teacher and everyone else is students. They all fight each other for space at the blackboard, give lectures that nobody listens to, assign homework that nobody does. When everyone gets abysmal test scores, one of the teachers has an idea: I need a more engaging curriculum. Sure. That’ll help."
I think about this quote from Guided by the Beauty of our Weapons, like, every day