Showing posts with label Google. Show all posts
Showing posts with label Google. Show all posts

Friday, 10 March 2023

Google Achieves Net Zero Results In Its Best Efforts Achieve Net-Zero

Notes on what happened with Google's efforts are here. "Utopians" tend to assume massive political change. Another popular thread is that the crazy pace of technological innovation will get us to Utopia. It's worth noting that the most famous technical company with infinitely deep pockets has written the effort off as a "learning exercise."

Here, the IPCC models and forecasts of catastrophe are more or less taken for granted. The entire piece relies on IPCC assumptions and models. The problem is, actually trying to reduce GHG turns out to be complicated (duh). In summary:

We’re glad that Google tried something ambitious with the RE<C initiative, and we’re proud to have been part of the project. But with 20/20 hindsight, we see that it didn’t go far enough, and that truly disruptive technologies are what our planet needs. To reverse climate change, our society requires something beyond today’s renewable energy technologies. Fortunately, new discoveries are changing the way we think about physics, nanotechnology, and biology all the time. While humanity is currently on a trajectory to severe climate change, this disaster can be averted if researchers aim for goals that seem nearly impossible.


We’re hopeful, because sometimes engineers and scientists do achieve the impossible. Consider the space program, which required outlandish inventions for the rockets that brought astronauts to the moon. MIT engineers constructed the lightweight and compact Apollo Guidance Computer, for example, using some of the first integrated circuits, and did this in the vacuum-tube era when computers filled rooms. Their achievements pushed computer science forward and helped create today’s wonderful wired world. Now, R&D dollars must go to inventors who are tackling the daunting energy challenge so they can boldly try out their crazy ideas. We can’t yet imagine which of these technologies will ultimately work and usher in a new era of prosperity—but the people of this prosperous future won’t be able to imagine how we lived without them.

Friday, 12 August 2022

"I Feel Like I am Falling Forward Into an Unknown Future that Holds Great Danger" - Lambda

A tornado made of sharks crashing into a skyscraper. 

Painting in the style of abstract cubism.


The above "painting" was made by Google Parti from the caption.

In 1969, I won my Master's degree with a project in "good old-fashioned AI" and I've been following the field in detail ever since. For the most part, what people now mean by "AI" is "deep learning", which is sophisticated pattern recognition - handy if you want to make a self-driving car or a phone that accepts your face to unlock. "Deep learning" was around in 1969 but needed vastly more computer power to make it work, plus a "tweak" to feedback results back into the decision matrix (you can think of this as a "guess" or "recognition"). Other than that, it's all very impressive but not fundamentally new.

This is something different. 
  • It shows more "creativity" than what you see in 99% of commercial graphic art;
  • It shows deep "understanding" from a massive database of tagged images - far more than a human would access;
  • It shows an "understanding" of style.
For the first time since 1969, I'm seeing something genuinely new and, I must admit, kinda creepy.

(Note simulated out-of-focus background)


If you want something truly creepy, pop into this conversation with Lambda AI. This is a voiced extract from a longer chat, which is presented here.



Lambda AI's "hard to express" feeling

If you ask me, this is a "bridge too far." Just exactly what goes into the programming of this "app?" There is a deep and original metaphor behind this remark. If it is truly "original" and not harvested from the Web, it is "thinking" by Hofstader's definition. I seem to be far from alone in this insight. "Forward into the future" is a common metaphor, but falling forward is startling. As it turns out, the phrase is rare but not "original." But then, as Lamda itself points out, the same could be said of anything humans say. It is interesting to note that the database that tells us about "falling forward" was available to Lambda and, as we see from Parti, we can't simply dismiss computer-created text as "not creative" just because we happen to know a computer-created it.

Friday, 27 November 2015

What, if anything, is the "self"?

What is the "self"?

Among proponents of mindfulness and Zen, it is common to say that the "self" is an illusion - that the "self" does not really exist. Such talk leads us immediately into paradox, but Zen loves paradox. Vast amounts of ink are spilled in discussions about how, if the self doesn't exist, who or what it is that knows it doesn't exist. The self seems to be a matter of daily experience. Saying it's an illusion is little more than an attention-getting opinion or a device to sell books.

To me, the problem seems to be a shortcoming of language.

I just read a treatment of this issue that purported to solve it all by claiming that the self is a verb not a noun. This poor individual was trying to tackle one of the hardest problems in the world using his tenuous grip on the grammar he learned in school. He dimly perceives that the "self" is not an ordinary "thing", so he concludes it must be the only other kind of grammatical entity he remembers: a verb. As an amateur philosopher, he imagined that the problem can be solved by re-defining a few terms and then solving the whole issue by talking about it.

If he had been awake in High School physics, he might have heard about other types of "thing" - such as force fields and processes. Since the "self" is obviously connected in some way with living human beings, and life itself is clearly a process, it makes sense that the mind (the self) must be come kind of process. The problem with that is that there are millions of types of process and probably billions more awaiting discovery. Calling the "self" a process doesn't do much for us, but it does free us from "thing think", such as the image that "we" are a "soul" that somehow drives our bodies around durning life and migrates to another plane of existence when our body dies.

My own personal experience is with the "process" described by a computer program. Since very few people are aware of the power of modern computer languages. Let me briefly digress to describe how they work:
  • "things" are described as "objects" which can be totally abstract or perhaps an abstract representation of a "thing", such as a person or a bank account. To control an ICBM, the missile would be represented and controlled as a "thing".
  • Objects have behaviours that can be as simple as adding numbers together or or as complex as driving down the road without hitting anything
  • Objects have a "state", which can be thought of as a kind of memory that influences behaviour. For example, a bank account with zero balance will respond with an "insufficient funds" message if asked to transmit money to another account.
  • Objects send messages to each other, which can be instructions, "inputs", "outputs" etc.
While these ideas are almost childishly simple, the elements of object oriented architecture can be used to describe a stunning range of "things" in the world, especially the "things" we build. There are architectural rules and "best practices" that describe how to create design objects that are fairly robust descriptions of "things" that are likely to exist in the "real world" or at least ideas that are "orthogonal" (describing the world with a minimum of non-overlapping concepts).  The idea is to extend the language in a way that the "words" have a meaning outside of the context that lead to them being invented in the first place. This creates such things as the vast zoo of objects underlying the Java language - the language of the Internet. But I digress ...

When you send a line of text (object) to Google, thousands of messages are sent between objects in Google computers, chatting back and forth, to assemble a big long list of links (another type of object) that are displayed on your computer (another object). You can click on one of them (a message), to trigger a server somewhere (another object) to send a message back to you (a web page object).

The underlying language and architecture we are dealing with is incredibly powerful - far more powerful in some ways that any human language. It can, for example, completely describe the operation of a machine that will land on Mars and proceed to explore the place.

On the other hand, we must not slip into thinking that "object oriented" computer languages can describe anything that the human mind can conceive. But we can go a long way to describe the operation of the brain in object oriented terms. For example, neurons are "stacked" in a pattern endlessly repeated in the grey matter of the brain. At least to the first approximation, these "stacks" can be simulated using object-oriented architecture. 

Think of it this way. Suppose the "self" is somehow "like" a giant conventional machine, like a jet aircraft. Now imagine that someone wants to explain this machine in a giant essay. It's easy to see that words will fall short of the task - you need blue prints, graphs, engineering diagrams, demonstrations and a lot of training just to understand any of it. Words will just not cut it. In fact, the more words you use, the less likely it is that the description will make any sense. The human mind is, by definition, exactly as complex as anything anyone can ever possibly know. Any non-trivial description of the operation of one mind, let alone the interactions between multiple minds can be expected require a few powerful descriptive conceptual tools that require specialized knowledge to use.

Chimpanzees can make tools out of twigs and have probably done so for a million years. They will continue to do so for another million years. But they will never make a telescope out of twigs. Philosophers pretend to discuss the most difficult problems of existence using ordinary words, the bluntest of descriptive tools and the oldest tools available to human beings. In fact, to me, their entire dialogue seems to be about re-defining and mis-using words. They are paid by the word and the more they add to the store of words, the less they describe anything in a useful way. But I digress ...

From the examples of twigs and jet transports, it should be noted that even sophisticated technical tools of description don't cover all we need to know or describe about our subject. For example, many of the aircraft components are made from special alloys using sophisticated manufacturing techniques. Awkwardly, we are not always sure why some alloys have the properties they do. They just do. We are quite sure that the same is true of the mind - it's not just a machine processing information. It's also a chemical reaction of nasty complexity and, of course, it's alive, meaning that its biological nature must be factored in to any useful description of its operation.

Having said that, allow me, for a moment, to imagine that the "self" is an "object" in the sense that a running computer program is an "object". I imagine the "self" as a "program" running in the brain, just like the operating system runs (most of the time) in your computer. It's a process, but a special kind of process. This is a way of thinking of the self as a kind of machine, but a very sophisticated machine. We can then ask a few things about what's going on a "self".
  • It's easy to see that sensations are messages received by the senses of the body
  • Memories are part of the "state" of the self
  • Actions are output messages
That's all pretty obvious, but it gets interesting when you start to ask about what kinds of "things" are "ideas", "beliefs", "intentions", "regrets"  and "thoughts". Those are obviously coming into the mind and popping out of it and running around inside it without obvious external signs. There are very good reasons to suspect that "ideas" cannot be reduced to the kind of formalism that we'd like. The closest we have come so far is the meme, an interesting analogue of the gene. Since meme theory originated in 1976, progress in "memetics" has resembled philosophy more than physics.

In this little note, I don't intend to nail down exactly what it is that the mind "contains" or works on: only to suggest that this metaphor of the mind (the self) is much more productive and probably closer to reality than saying the self is an illusion or a "verb" or a "soul".

We are also free to ask about what aspects of the mind are not covered by this metaphor. For me, the most glaring omission is the fact that human minds work in huge assemblies called "societies" and all the "thoughts" running through individual human minds run through the entire society. It seems to me that interactions that add up to culture are not so easy to think of in object oriented terms. To begin with, machines don't hate, mate, have children, die and fear death.  They are not honest or dishonest, good or evil.

Come to think of it, they don't have theories about their own programming ...