介绍： As we continue to develop AI and particularly, as we develop artificial general intelligence, I think it's quite likely that at some point we will create a conscious being.
随着我们不断发展人工智能，尤其是通用人工智能的发展，我认为我们很有可能在某个时候创造出具有意识的生命体。
I don't know when that will happ...

介绍： As we continue to develop AI and particularly, as we develop artificial general intelligence, I think it's quite likely that at some point we will create a conscious being.
随着我们不断发展人工智能，尤其是通用人工智能的发展，我认为我们很有可能在某个时候创造出具有意识的生命体。
I don't know when that will happen, but I don't see any reason in principle why if we can have consciousness in a biological, carbon-based life form, like I am, which has developed a brain and neurons,
我不知道这何时会发生，但我认为原则上没有理由说，既然像我这样的碳基生物能够进化出大脑和神经元从而拥有意识，
I don't see any, in principle, reason why you couldn't get something similar happening in something that isn't a carbon-based life form that is made of silicon chips.
那么从原则上讲，我也找不到任何理由认为由硅芯片构成的非碳基生命形式就不能实现类似的功能。
And if we do that, we will have created an artificial conscious being.
如果我们做到了，我们就创造了一个具有意识的人工智能。
Of course, we've already created vast numbers of conscious beings.
当然，我们已经创造了大量具有意识的生命体。
We're creating animals all the time, and we vary them in their nature by breeding.
我们一直在创造动物，并通过繁殖来改变它们的本性。
So it's not the first time we've created conscious beings, but it's the first time we've created an artificial conscious being,
这并非我们第一次创造有意识的生物，但这是我们第一次创造具有意识的人工生物，
Non-human conscious beings we've created who basically we have mostly exploited for our particular purposes as using them for labor,
我们创造的非人类意识生物，基本上都是为了满足我们的特定目的而被剥削利用，
Like horses and oxen, or rearing them for food, like cows and pigs and chickens, and fish now we're rearing in large numbers.
比如役使马匹和牛来劳作，或是饲养牛、猪、鸡以及如今大规模养殖的鱼类作为食物。
So there is a danger that we will, but I'm hopeful that we will realize if we do create conscious AI,
我们这样做是有风险的，但我希望，如果我们真的创造了有意识的人工智能，
That that conscious being has interests, an interest in not feeling pain, an interest in enjoying their life once you have consciousness.
我们能够意识到，这些有意识的生物是有利益诉求的，它们不想感受到痛苦，不想在拥有意识后享受生活。
And they would be wrong to disregard the interests of that conscious being and simply to treat it as another tool or another slave.
忽视这些有意识生物的利益，仅仅把它们当作另一种工具或奴隶，那就错了。
Now, it's possible that we'll realize as we get close to creating this conscious being that we would then have to give it rights and would not be able to use it in some way.
现在，当我们接近创造出这些有意识的生物时，我们可能会意识到，我们必须赋予它们权利，并且无法以某种方式使用它们。
And we might perhaps halt what we're doing at that point just below the level of consciousness or maybe at a very dull level of consciousness where the AI is not really experiencing pleasure or pain because it's not capable of that.
我们或许可以在意识层面以下，或者在一个非常迟钝的意识层面停止我们正在做的事情，因为人工智能无法真正体验快乐或痛苦。
It's just got some sort of more neutral, sort of blah state of consciousness, if you like.
它只是处于某种更为中性、甚至可以说有点乏味的意识状态。
That's possible. And then maybe it wouldn't really have interests we have to worry about.
这是可能的。这样一来，它也许就不需要我们真正关心利益了。
But I certainly think that if we did create beings that were more like non-human animals, we ought to treat them much better than we now treat non-human animals.
但我确实认为，如果我们真的创造出更像非人类动物的生物，我们应该比现在更好地对待它们。
And, of course, I also think we ought to change the treatment of non-human animals in order to do that.
我们如何对待有感知能力的人工智能这一问题，将和我们如何对待动物这一问题一样，成为每个人都要面对的问题。
The question of of how we treat sentient AI is going to be one both for everybody as individuals, just as the question of how we treat animals is one for people as individuals.
我们如何对待有感知能力的人工智能，这个问题关乎每个人，就像我们如何对待动物，这个问题关乎人类一样。
Are we going to want to have a companion animal, a dog or a cat, and treat them well?
我们会想要养一只伴侣动物，一只狗或一只猫，并善待它们吗？
Are we going to buy products from factory farms, which means we're supporting cruelty?
我们是否要购买工厂化农场的产品，这意味着我们支持残忍行为？
Those are individual questions, but there are also national government policy issues.
这些都是个人问题，但也涉及到国家政府的政策问题。
And just as I believe governments should set standards for animal welfare, they should not permit the treatment of animals in the way they're now treated in factory farms.
正如我认为政府应该制定动物福利标准一样，他们也不应该允许像现在工厂化农场那样对待动物。
So I would think governments will need to set standards for the treatment of sentient, conscious AI once we get to that point.
我认为，一旦我们达到那个水平，政府就需要为有感知力和意识的人工智能制定标准。
And you know, it'll be a novel question. Maybe they'll set up committees of experts.
这将是一个全新的问题。也许他们会成立专家委员会。
I can imagine committees, which consist of people who are expert in the AI, and in the nature of the AI, experts knowledgeable about consciousness itself in those sciences,
我可以想象由人工智能领域专家组成的委员会，这些专家不仅精通人工智能及其本质，还了解与意识相关的科学，
Neurosciences relevant to that, but also to have philosophers along, and lawyers perhaps to help crafting policies, and frameworks for this.
如神经科学，同时还包括哲学家，或许还有律师，以协助制定相关的政策和框架。
So I think it will be an interesting task for who knows when. Maybe the middle of the 21st century, there might be committees doing this.
我认为这将是一项有趣的任务，谁知道什么时候会实现呢？也许到21世纪中叶，就会有委员会来做这件事。