skip to main bit
a man slumped on his desk, from 'The Sleep of Reason Produces
      Monsters'

Oblomovka

Currently:

Archive for 2022

2022-12-12

On Stable Diffusion

A good friend made a Facebook post saying

“Sadly it turns out that the latest AI photo app y’awl using to look hot and sexy is built off the back of a training set full of work stolen from artists without payment.

How disappointing.

We sorted this shit years ago with Creative Commons licensing. It’s not hard to get right. #paytheartists”

It led to a heated debate! Here’s (with some few modifications) how I replied, which was sufficiently long that I felt I should pluck it out of the Facebookosphere, and settle it here:

I understand that people worry that large models built on publicly-available data are basically corporations reselling the Web back to us, but out of all the examples to draw upon to make that point, Stable Diffusion isn’t the best. It’s one of the first examples of a model whose weights are open, and free to reproduce, modify and share: https://github.com/Stability-AI/stablediffusion . Like many people here in the comments, you can download it, inspect it, run it locally, and share it. You need a GPU to run it at a reasonable speed, which makes it a little pricey to run. The cost of building these models is very pricey — around $600,000 or so, which means that there’s currently a power differential between large corporations who can afford to speculatively build and experiment with these models, and the rest of us. But the knowledge of how to do it is built on open science, and a number of orgs are doing it truly in the open — for example, https://www.eleuther.ai/ . All of these things, as ever, will get cheaper, and spread in use and experimentation.

Most importantly, the tool itself is just data; SD 1.0 was about 4.2GiB of floating-point numbers, I believe (taken from https://simonwillison.net/2022/Aug/29/stable-diffusion/ ). I’m currently using (literally, right now!) another open model, Whisper, which is 3GiB, and allows me to convert most spoken audio into text, and even translate it. I use it to, securely and privately, transcribe what I’m saying to myself through the day. I expect it will be encoded into hardware at some point very soon, so we will have open hardware that can do the kind of voice to text that you otherwise have to hand over to Google, Amazon, and co.

The ability to learn, condense knowledge, come to new conclusions, and empower people with that new knowledge, is what we do with the shared commonwealth of our creations every day. Copyright has not always been a feature of that process, but in many ways, it’s been an efficient adjunct to it: a way to compensate creators by taking a chunk from the costly act of copying itself. It’s a terrible fit to the modern digital world, though, just because that act of making a copy is now practically zero. Attempts to update it, have unfortunately revolved around trying to recreate the physical limits of previous copying equipment, and bolt it onto a system where that’s not where the revenue comes from.

It’s always been hard to stop these temporary monopolies from impeding the open commons that they all draw from, especially after we built a automatic copyright system post the Berne Convention, where everything was maximally locked down by default. That’s why Creative Commons was invented — because without that work, it was costly and near impossible to grant back to the commons, with legal certainty, the way that the commons could exist by default before the 1970s.

Again, I understand if people are worried that, say, Google is going to build tools that only they use to extract money from our shared heritage. But the problem isn’t that those tools should be illegal, and that anyone building or using them (like me, like EleutherAI, like any one following the instructions spelled out by the increasing, accelerating field of machine learning, and drawing on the things around them). It’s that the tools should be free, and open, and usable by everyone. Artists should get paid; and they shouldn’t have to pay for the privilege of building on our common heritage. They should be empowered to create amazing works from new tools, just as they did with the camera, the television, the sampler and the VHS recorder, the printer, the photocopier, Photoshop, and the Internet. A 4.2GiB file isn’t a heist of every single artwork on the Internet, and those who think it is are the ones undervaluing their own contributions and creativity. It’s an amazing summary of what we know about art, and everyone should be able to use it to learn, grow, and create.

2022-08-18

no words

I’ve been having a bit of a rollercoaster time at work; nothing you need to bother your giant head about, but this week has been a mix of incredible highs, and also some really hard introspection.

One of them, which will seem silly to regular readers of this blog (who are the only ones left right now, and I’m not even sure what “regular” means in this context), is having to admit to a co-worker that I have terrible writer’s block and have had for… ooh, thirty years or so? I remember reading somewhere that “writer’s block didn’t exist” and I think that added another couple of decades to my refusal to really take it seriously. That and at least two book deals, careers in scriptwriting and journalism, and a perpetual sense that I was failing at the one thing people expected me to do.

Well, you know, I have taken it seriously — lots of therapy where we’d eventually get around to it as a topic, that whole “lifehacks” side-tour, endless agonising and bending the ear and wetting the shoulder of my closest confidants. But I’ve never really said it in a work context as a thing that people need to watch out for.

Mostly, I just say I will try to do better. But I really don’t; this is who I am. To give you an example: these days I’m practically a walking Oral Tradition — I don’t write memos at work, I give hour long internal talks, and fill up meetings with these improvisational marvels of ad-libbed wisdom that amaze me, even as they probably bore or annoy a sizeable chunk of my co-workers (though they are all really nice about it).

Of course, I’ve had that thought where I just go, hey, maybe I could just speak to a microphone, and transcribe all of this genius and magically turn it from mid-brow hand-waving into high-status prose. Somehow it doesn’t work that way.

Anyway, usually this kind of post ends with me dedicating myself to you, regular reader, and promising to blog more, or what have you. Followed by another six months or more of silence. I know enough to know not to say that now, and bring down the curse. But I guess what I am feeling is a sense that even if I don’t write it’s time to saddle up again and try and push the ideas out there, with a keyboard, or a prosc arch or livestream or something. It’s never too late to start, and it’s always too early to end.

2022-04-13

o’brain worms

I guess it’s appropriate that we can’t agree on what the brain worms metaphor’s original vehicle actually is. In his description of the Internet culture term, Max Read claims, reasonably, that the originals are maybe like tapeworms or toxoplasma. But I always think about the Ceti Eel in Wrath of Khan (but then, I’m always thinking of Wrath of Khan, especially, these days, the imminent off-Broadway musical).

To be infested with a brain worm is to have become a one-note (or a cacophony of discordant notes) speaker. To have all your behaviors, at least online, collapse into one strident position. To shore up every exit from that position with every mental barricade. A mind trap.

I will insist that I’m right about the best analogy. Like the Ceti eel, the modern brain worm usually gets in via your ear (or Twitter feed). It “render[s] the victim extremely susceptible to suggestion,” as Khan notes: Chekov later confirms that “the creatures in our bodies… control our minds …made us say lies …do things”. Madness, then death follows. Metaphorical brain worms, with COVID and measles, can kill you nowadays. In happier times, you could get away with just agyria.

Brain worms certainly seemed to have grown more virulent, more vicious, recently. I worry about my proximity to them. As I’m hinting, I’m considering slinking into punditry again, and woah nelly, do brain worms seem to be an occupational hazard in those dark woods. I think I’ve lost more friends and acquaintances to brain worms than the pandemic. From 9/11 truthing, to whatever it is that’s slamming around Glenn’s cortex these days, from election-disbelievers to Russia-runs-it-allism.

Since I was a young man clutching the Loompanics catalog for the first time, I’ve actively explored strange new views; sought out new lies and new inclinations. But watching good people all around me just be consumed by an idea, possessed and ridden by these loa, trapped by an illusion that if they just moved one foot to the left or right, would dissolve away, has given me serious pause. If I open my mouth and speak my mind again, will the brain worms get in that way? Start polishing up my prejudices until they’re clean, consistent, and shiny, and one day find myself unable to drag my eyes away from their distorted mirror image?

Or you know, maybe the brain worms have already got me? Like most people who read books or say long words, I have a few brain worms that I keep as pets. They’re fun, they’re conversation pieces, and you can bring them out for people to coo at during parties. 

I’m still confident that if they turned rabid and started attacking my friends, I’d have the sense to put them down — the worms, not my friends, of course (oh no maybe they have already got me)?

My pet brain worms: the Internet (still with its capital letter); anarchism of a harmless, de-fanged kind; a litter of related ones bred from the same pedigree. These days, decentralization would be the obvious one, I guess. My friends and relatives, watching me wading in booty-shorts through the cryptocurrency swamp, worry, but I think that’s a little too obvious to snag me.

But, of course, nobody with a brain worm thinks they have brain worms. So how do you protect yourself? Alan Moore’s old trick was to tell his closest that they should retrieve him from whatever mindfuck he was pursuing, but only if he started becoming less productive. I’m not sure I want to take advice from Alan Moore on this matter, however, especially as I suspect a brain worm would make far more prolific, not less. I mean, this is why pundits have them — they’re superspreaders. A brain worm that doesn’t target pundits would not be a successful brain worm. Just ask Richard Dawkins: a man who, on some deep level, must know that the memes are now defining him, not the other way around.

Making hard-to-wriggle-out-of testable predictions — make your beliefs pay rent, as the origin of so many geek brain worms whispers to me from his wicked lair — would, I would hope, help ground me. But I need to avoid pattern-matching as I seek out those beliefs! Or else there’s a mountain of evidence awaiting me that supports my position! You just need to let me devote more time to finding it!

Ultimately, all I can assume is that the best practical guard against monsters is to make sure you’re not hurting anyone — or inspiring others to hurt themselves or others. No one deserves it, no matter what the worms say. It may make you a quieter, weaker source of thought: but tell the voices in your head that worms who prosper long term will be the ones who don’t kill their hosts.

2022-04-03

Unwanted thoughts

You can hear in the background of this blog, like a creek at the end of a field, a constant wash of attitudes changing. Not much, to be honest, or not as much as I’d hope. At the end of college, a friend of mine was terrified of backing into just one role, ending up stuck in just one life. I, optimistic and insufferable, told her that I was looking forward to transforming into many different people, bouncing around the mental state-space as the world changed around me. The truth seems to be that you can steer between these two camps, and thank god. How we change is under some of our control, or it feels that way.

There’s certainly a lot of character pinballing around, with those slow Ron Paul->Bernie arcs being overtaken by Mises->Nazi, SomethingAwful->Tankie, PostModern->Mencius, KPop->Antifa, slam tilts. One constant that I see people in their forties and above refer to is the old pseudo-Churchillian (maybe Batbie? Maybe Burke? Probably anonymous Tory.) line: “If you are not a democrat/liberal/socialist at 25, you have no heart. If you are not a conservative at 35 you have no brain”, followed generally by a humblebrag that they’ve switched from being a liberal as a youth to being, in these present times, a flaming communist by thirty-five.

This one lands weirdly for me because, in some ways, being a Labor-left, unionizing, nationalizing, we’ll see the Red Flag flying here, type, is, within my messed-up internal political compass, actually pretty old school. I was raised on the Left. At that time, it felt like less of a political stance and more like a refugee movement. In the UK and US, that branch of the Left was summarily ejected from the electoral power it needed to execute its plans, and nobody seemed to have good ideas on how to get it back. Chernobyl and the collapse of the Soviet Union were, to that whole ideological space, what the 2008 recession was to free-market, free-trade fans — an undeniable, universally damaging unwinding of the best arguments for its dominance. Something like, “In the Nineties at twenty-five, if you weren’t seriously questioning socialism, you had no friends; if you were not spending some time considering the benefits of neoliberalism at 35, you probably had no job.” (Don’t write in, I know you met a lot of cool people at Red Wedge, I’m just trying to bend the quote to fit, dammit.)

Anyway, when I hang out these days with the youngsters quoting theory at each other, I am thrown backward, not forward in time. I got into Benjamin Franklin when I first came to America — a very 2000s thing to do, but also, obviously, pretty 1770s of me too. Eventually, I snapped out of it by thinking: I’m pretty sure Peak Nation-Building did not end in the late 18th century, and there may have been more advancements in political science by non-bewigged professionals since then.

On the other hand, I definitely would not have considered upgrading to Marx as much improvement. Partly because it would only have been a jump forward from the founding fathers by fifty years or so, but mostly because it would have felt like a shift backward for me personally, to 1979. It would have been an act of internal conservatism. 

I guess now, faced with new information, I should thrash ahead to a new neo-Marxist vision. Alas! I am not changing as quickly as I did. The lightcone of my character has been narrowing since my thirties. Back then, I would amuse myself by wondering what it would be like to be an aging hippy of the future. And here I am, as 90s as they were 60s: Eyes blurring with tears, I will, unprompted, relate how you can almost see, with the right eyes, the high-water mark on the Internet, where the decentralization revolution washed over the world, and then broke and fell back. Re-litigating long-dead arguments about SMTP and NNTP as much as I heard warmed-over fights about the SWP or SDS in my youth; thinking myself a radical who avoided the Churchill rails, but actually a conservative sitting athwart any progress.

But! There is a twist here, and I clutch onto it. The weird thing about the Left in the eighties was that it kept its beat, even if that wasn’t the main rhythm of the time. It is hard now to describe how sidelined it was and how it held itself together, even when everything– at least in the anglosphere — was working against its success. I remember thinking: how odd and inspiring to keep on believing in something when everything conspires (maybe through class war, maybe through your own movement’s recent fuck-ups) to undermine your conclusions.

Grudging respect! I thought unpopular thoughts at the time (“information wants to be free!”, “fast, cheap and out of control!”, “we reject: kings, presidents, and voting. We believe in: rough consensus and running code”), but they weren’t actively being rejected – they just weren’t very well known at the time. While they were obscure, they had the advantage of fitting the current setting; they made predictions, and then the predictions came true. So when more people came to believe them, it wasn’t a surprise. It was barely a validation. Like those old school (with a slave-owning asterisk) heroes would say, we held those truths to be self-evident.

So brave to think new thoughts: but holding onto your beliefs when they’re well-known and yet disregarded is another matter entirely. I ignored the Left in the eighties because it was both well-explored and curiously mismatched to the world I saw around me. You can put that down to insidious capitalist propaganda: but, again, the fecundity of thought at the time came, for me, from imagining a world outside stagflation and the 70s, plotting an escape from a utopian vision whose roof had fallen in. 

And yet, some people stuck around to carefully rebuild the roof: tedious thankless work.

So, ironically — conservatively? — the lesson I’ve learned is that there is some value to being an aging hippy, to be a person who squats on creaking knees with the tired ideas of the last decade and learns the lessons, and stitches on patches, in a quiet corner. The fact that the Left managed to roar back into relevance the moment the last age wobbled is perhaps why leftist thinking has evolved the way it has. It’s designed to pop back up. And if that’s so, maybe it’s resilient to be unwanted for a while. Sometimes we make a wrong turn and need to back up a little to go forward again.

2022-03-11

style project

I’m halfway through a memo for work. I’m struggling a bit with the style, because it’s stuck between being broadly informative and terse, and rah-rah-inspiring, and I’m not sure which way to go with it.

It’s also the first bit of writing I’ve done for a while (and certainly the first since my heavy flirtation with Covid, which of course means I spend some of my time going “wait, is my inability to choose the right noun here due to novel holes in my brain?”).

The last year or so, since I left EFF, have been ingesting a huge amount of new information, hobnobbing with lovely new people, and, in terms of communicative output on my behalf, providing a great deal of hand-waving and anecdotalising in Zoom calls. (If you want the flavor of that last category, here’s a recorded version of said hand-waving that I gave at Protocol Labs’ Funding the Commons event last week. Don’t know if it’s interesting, can’t bear to watch me or my hair in it.)

Honestly, the change of career flavor been pretty nice. I’m delighted to be learning new tricks , and it’s charming to have a new audience for what transpires to be a near endless supply of slightly too long tales of the early Internet. I guess looking at my long line of irish uncles, I should have assumed I’d slowly transform into a barracking raconteur, but from the viewpoint of someone who was a awkward, shy teenager, it’s still a shocking development. I still have a constant refrain in my head of “perhaps it’s time to shut up now”, but my internal hearing appears to be going. This is how you become what you — well, not hate, but certainly eye-rolled at — in your own past. Would awkward teenager have hated me? Nah, I’d have been terrified of me, but with a sort of grudging respect. Like, huh, seems like a bit of an ass, but maybe an aspirational ass, too?

Time-travel paradoxes aside: But but, but, the writing. And worse, the public writing.

I have started to realise that I have now processed verbally so much new information that I really have some kind of obligation to blurt it out to a wider audience. Yes, this may also have come with the barracking, and possible the long covid dementia.

Does forcing myself on the body politic mean writing? Well, it does if I don’t want to change my t-shirt or comb my hair. I could do some more Youtube Videos, I guess, and have previously enjoyed my forays into livestreaming. (The podcasting, too, has been effective I think, though that’s not really been down to me, I’m just a cog there in a much smarter pod mechanism.)

Anyway, the challenge in all of these environments is less the creative act of writing, and more the orchestration of the personal brand. The last seven years at EFF, has involved in increasing subsumption of my voice into managing and guiding the EFF voice. This was something I found a bit frustrating when I first joined the org, because I HAD MORE THINGS TO SAY AS A HUMAN DAMMIT. But come the 2010s, and the replacement of the joie-de-vivre of blogging punditry with the dodging-velociraptors-while-escaping-over-a-lava-field-in-mid-meteor-strike that is the modern Internet landscape, my enforced personal radio silence gradually turned into constant background sigh of relief. Speaking as EFF was a regular terror, but at least people mostly didn’t judge me on that basis, and on a million different mutually contradictory axis, most of which I had no control over. I enjoyed to sinking into well-deserved obscurity, while watching my friends ascend into micro-celebrityhood, with all the pain and cancelling and damnation that now involves.

But now: god, do I have to gear up again? And if so, what is my personal punditry outfit going to be?

I still see the Internet, unavoidably, as a meta-medium. To my mind, it reamins a protoplasm that you can shape into different media, as different from each other as a book is from a newspaper, or a newspaper from a radio show. And I do feel very at odds with the current, limited menu of media that we are given from on high. Part of it is aging inflexibility, of course (no I do not think I am a born TikToker), but part of it is because I think to engage, is to try and construct your own format. And I’m still in mid-mull about what that format could be.