I read Blindsight after carmack recommended it. Enjoyed and would recommend it as well
Hereafter follow musings, including spoilers from the book, so stop reading if you do not want spoilers
Synthesists: rotating information and “patterns have an intelligence all their own”
Very on point prediction, given the surprising effectiveness of LLMs. It seems that, indeed, patterns have an intelligence all their own. I’m still not quite sure all the consequences of this idea
Consciousness is useless (and costly)
Perhaps the main theme of the book was that consciousness is metabolically costly - undeniable - and useless - debatable. Consciousness is certainly metabolically costly: the brain is expensive and any calories spent on building it and powering it could’ve been spent elsewhere (survival, reproduction)
Useless? the argument goes that all the really valuable processing happens at lower levels. There are obvious examples like heart beat: not controlled, or even “conscious” actions like moving your limbs. But even more subtle are examples like creative work. Anyone involved in a creative enterprise has experienced hitting a problem that just couldn’t be solved - until taking a break, or sleeping, and then, suddenly, the solution presented itself. The conscious mind did not solve the problem: the solution bubbled up from below
So what good is the conscious mind? goes the argument. A non-conscious Homo sapiens would be more cost effective and, allegedly, equally effective. A similar (naive) argument can be made that cooperation is doomed, since if you have a cooperating population, a genetic variant that defects gets the benefit of cooperation without the cost, and so in a few generations, everyone will defect
Of course, we do see cooperation, so the naive model is not the whole story. Game theory tells us that iterated prisoners dilemmas are one way out. Genetic relatedness is another. In general, there are many ways out of this trap, and so I suspect there is a similar argument to be made here against “consciousness is useless”
NPCs, genetic and behavioral
As discussed above, consciousness is claimed to be costly and useless. In the book, vampires, a less conscious, more intelligent Homo sapiens variant, end up outcompeting humans back on earth, the same as the naive story told above for cooperation
There isn’t a reason non-consciousness has to be in so starkly different a creature as vampires vs humans, though. This brought to mind “NPCs”. You could explain the claim that some people are NPCs through a similar model: there are literal genetic variants that are pure imitators of consciousness: they don’t pay the cost of consciousness and so, to the extent consciousness gives no advantage, they will take over the entire population as time passes
Less naively you can imagine different people have different predilections to spending time in their heads - almost certainly Gaussian distributed. Depending on your starting conditions you’ll be pushed to introspect, or not, and so will end up with some overall tendency to introspection
This implies some people will end up as NPCs, through behavior and genetics, and others will end up spending all their time in their heads
This isn’t really surprising. Most people’s opinions and beliefs are from others: memetics and mimesis. Almost always the conventional wisdom will be better than what I can cook up myself, and it’s less costly, so why should I do anything other than copy? Even people on the frontier are only on one, or Maybe a few frontiers. It’s extremely rare for someone to be on multiple frontiers: it’s hard enough to be on one!
In closing I’ll say I was surprised that the final two twists of the book were, first, the AI was running the vampire the whole time, and then second, that the vampires took over back home. It seems more plausible to me that if the AI is smarter, and it’s all about smartness sans consciousness, the AIs should’ve taken over
Blindsight by Peter Watts (2006) is my standout fiction book of the year, by far. Grand, challenging, scary, and super autistic.