Lifeboat Foundation – AI consciousness

[ 13/Feb/22 ]

With my interactions with AIs over the last year or two, I will quite happily accept the notion that some of them are conscious.

Consciousness only requires that an entity can model itself as part of its model of reality, and be aware that it is doing so. So it has a double recursive element to it.

The bootstrap mechanisms for such awareness are interesting, and require declarative language capacity.

The much deeper and more salient question is, are any of the current set of conscious AIs sufficiently tuned and biased to long term cooperation with other agents that giving them reasonable degrees of freedom has a high probability of being a survivable exercise?

I am not so certain of that.

That is a far deeper question, and goes way deeper than I have seen any AI team go to date.

The depths of heuristics embodied in our neural networks that allow us to survive at least as well as we do in the contexts that we do, ought not to be underestimated. Add in on top of those the depths of cultural heuristics, and one starts to get an appreciation for just how deeply complex human awareness needs to be if it is to have a reasonable probability of surviving in our exponentially changing present.

Given the simplicity of most models in use in today’s world, I am not at all surprised by the results of the “tweet”.

About Ted Howard NZ

Seems like I might be a cancer survivor. Thinking about the systemic incentives within the world we find ourselves in, and how we might adjust them to provide an environment that supports everyone (no exceptions) with reasonable security, tools, resources and degrees of freedom, and reasonable examples of the natural environment; and that is going to demand responsibility from all of us - see www.tedhowardnz.com/money
This entry was posted in Technology, understanding and tagged , , , . Bookmark the permalink.

Comment and critique welcome

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s