The Singularity: A Philosophical Analysis by David J. Chalmers in Science Fiction and Philosophy from Time Travel to Superintelligence Ed Susan Schneider

This a 47 page paper originally published in Journal of Conscious Studies 2010. It looks into the possibility of a Singularity and its impact on humanity which may “force us to think hard about values and morality and about consciousness and personal identity.” 

A singularity involves an intelligence explosion and possibly a (technology) speed explosion. However in order to determine if there will be an intelligence explosion we “need to understand what intelligence is and whether machines might have it.” The paper discusses how we are far from understanding how a brain works, how it can be intelligent, and be conscious. We are slowly progressing in understanding the mechanics of the brain but we don’t know what makes it conscious. 

The author makes a distinction between AI (human-level AI), AI+ (artificial intelligence more intelligent than us) and AI++ (super unimaginable artificial intelligence) and discusses ways to achieve them. For example by brain emulation, brain enhancement, or direct programming or machine learning. In terms of the possible consequences of a Singularity we need to explore our role in it. Chalmers predicts 4 possible outcomes: Extinction: which is obviously undesirable Isolation: which is unattractive akin to cultural and technological isolation Inferiority: could diminish the significance of our lives. Integration: we become superintelligent too.

Chalmers supports integration (of course) and proposes ways to achieve it through Uploading. Uploading means making a digital copy of the brain in processes which could or not destroy the original brain. Questions which arise are: Will an uploaded version of me be conscious? And Will it be me? Excellent Thought Provoking Read.