Comments on “Artificial neurons considered harmful”

Self-driving

Mike Travers 2023-02-27

I’m mildly surprised you don’t say much about self-driving car tech; this seems like an obvious area where ML is killing people right now by being connected to heavy machinery (your footnote 7 explains some acceptable variants of this but doesn’t really address self-driving, I initially misread it).

I haven’t quite reached your level of opposition to AI yet, but this particular use I find quite maddening – nobody asked me if I feel OK sharing the road with death machines under the control of an unverified and unregulated ML system. It has good propaganda value as a very visceral risk.

Cars

David Chapman 2023-02-27

Yes… it’s something I don’t know much about at a technical level. I could have read up on it (if the state of the art isn’t all proprietary? I don’t know), but I was reading arXiv AI papers full-time for three months and had to draw the line somewhere! (It was fun, though, I haven’t done anything like that since I was a grad student.)

Tbh, I have been somewhat surprised that it’s as difficult as apparently it turns out to be. Generally, robotics is always much more difficult than anyone expects, and it’s sort of robotics, and in an uncontrolled environment, but still it’s something I wouldn’t want to bet can’t be solved.

Control theory

Ian Stewart 2023-03-07

I have a suspicion that the rising arguments about the outright impossibility of “AGI alignment” might be much more readily applicable, and more long-term durable, if they were restated in terms of boring old control theory. I’d take a stab at it myself, but I feel like I’m grasping for the terminology. Something about it being a bad idea to operate a poorly-instrumented, self-reinforcing open-loop mechanism…

Forbes article link broken

Mutual 2023-03-10

The URL to the startup hype article is broken. I had to get rid of the quotation marks at the end to get to the article

Link fixed

David Chapman 2023-03-11

Thank you very much! Fixed now.

LLMs as Artificial Left Hemispheres?

Simon Mundy 2023-06-05

Hi David,
One of the things that’s struck me is that, in the evolution of biologically based intelligence, world sensing and acting in the world eventually gave rise to language.

In our development of AI we’ve started with language. So we’ve started with symbols sans referents, for the LLM anyhow.

It’s also been interesting to see how some of the deficiencies of LLMs parallel the distorted behaviour of humans with right hemisphere affecting strokes and other injuries. The tendency to confabulation is particularly interesting. See McGilchrist, particularly part 1 of The Matter with Things and The Master and his Emissary.

To be or not to be

Danyl Strype 2024-04-01

the output of a particular sort of statistical analysis will meaningful in a particular way.

Again, I like this as a poetic turn of phrase, but I think you left out a “be” there.