What Kind of Trust Do Technical Systems Need

dāng当zìdòng自动huà化xìtǒng系统cānyù参与fēnpèi分配zīyuán资源huò或chǔlǐ处理shēnqǐng申请shí时，rénmen人们cháng常bèi被yāoqiú要求xiāngxìn相信jìshù技术nénggòu能够tígāo提高xiàolǜ效率。

When automated systems allocate resources or process applications, people are often asked to trust that technology can improve efficiency.

xiàolǜ效率quèshí确实kěnéng可能tígāo提高，dàn但xìnrèn信任bù不néng能jǐn仅yóu由yùnxíng运行sùdù速度huò或jìshù技术fùzá复杂chéngdù程度lái来zhèngmíng证明。

Efficiency may indeed improve, but speed and technical complexity alone cannot justify trust.

duì对shǐyòng使用zhě者ér而yán言，gèng更zhíjiē直接de的wèntí问题shì是，jiēguǒ结果wèishénme为什么rúcǐ如此，yǐjí以及chūxiàn出现cuòwù错误hòu后néng能zuò做shénme什么。

For users, the more immediate questions are why a result occurred and what they can do if it is wrong.

yī一gè个píngshí平时biǎoxiàn表现wěndìng稳定、què却wúfǎ无法shēn申sù诉de的xìtǒng系统，réng仍kěnéng可能ràng让shòudào受到bùlì不利yǐngxiǎng影响de的rén人quēfá缺乏ānquán安全gǎn感。

A system that usually performs consistently but offers no appeal may still leave adversely affected people feeling insecure.

yīncǐ因此，xìnrèn信任yīngdāng应当jiànlì建立zài在kěyǐ可以guānchá观察de的zhìdù制度ānpái安排shàng上，ér而bù不shì是lǒngtǒng笼统de的bǎozhèng保证shàng上。

Trust should therefore rest on observable institutional arrangements, rather than general assurances.

zhèxiē这些ānpái安排bāokuò包括qīngchu清楚shuōmíng说明shǐyòng使用fànwéi范围、bǎoliú保留bìyào必要jìlù记录，yǐjí以及tígōng提供kě可cāozuò操作de的jiū纠cuò错qúdào渠道。

These include explaining the scope of use, retaining necessary records and providing workable correction channels.

jiěshì解释yě也xūyào需要yǔ与jùtǐ具体qíng情jìng境xiāng相pǐpèi匹配，duī堆jī积zhuānyè专业shù术yǔ语bìng并bù不děngyú等于ràng让rén人lǐjiě理解。

Explanations must also fit the context; piling up technical terminology does not make a system understandable.

shēnqǐng申请zhě者wèibì未必xūyào需要zhīdao知道měi每gè个jìsuàn计算bùzhòu步骤，què却xūyào需要zhīdao知道nǎxiē哪些xìnxī信息yǐngxiǎng影响liǎojié了结guǒ果。

Applicants may not need every computational step, but they do need to know which information affected the outcome.

tóngshí同时，réngōng人工fù复hé核bù不néng能zhǐshì只是xíngshì形式shàng上de的àn按niǔ钮，fùzérén负责人yuán员bìxū必须yǒu有nénglì能力hé和quán权xiàn限gǎibiàn改变cuòwù错误juédìng决定。

Human review must be more than a nominal button: reviewers need both the ability and the authority to change incorrect decisions.

rúguǒ如果zérèn责任zài在kāifa开发zhě者、yùnyíng运营zhě者hé和shǐyòng使用jīgòu机构zhījiān之间bùduàn不断zhuǎnyí转移，shēn申sù诉qúdào渠道yě也huì会shīqù失去shíjì实际yìyì意义。

If responsibility keeps shifting among developers, operators and deploying organisations, appeal channels lose their practical meaning.

chéngrèn承认xìtǒng系统cúnzài存在júxiàn局限，bìng并bùyīdìng不一定xuēruò削弱xìnrèn信任，fǎnér反而néng能bāngzhù帮助rénmen人们xíngchéng形成hélǐ合理yùqī预期。

Acknowledging limitations need not weaken trust; it can help people develop reasonable expectations.

zhè这zhǒng种yùqī预期ràng让shǐyòng使用zhě者zhīdao知道héshí何时kěyǐ可以yīlài依赖zìdòng自动huà化，héshí何时yīngdāng应当yāoqiú要求jìnyībù进一步shěnchá审查。

Such expectations help users know when to rely on automation and when to request further review.

zhíde值得jiànlì建立de的xìnrèn信任，bìngfēi并非duì对suǒyǒu所有jiēguǒ结果wútiáojiàn无条件jiēshòu接受，érshì而是duì对cuòwù错误nénggòu能够bèi被fāxiàn发现hé和jiūzhèng纠正de的xìnxīn信心。

Trust worth building is not unconditional acceptance of every result, but confidence that errors can be identified and corrected.

jìshù技术yuè越shēnrù深入gōnggòng公共shēnghuó生活，zhè这zhǒng种kě可zhuīwèn追问、kě可jiū纠cuò错de的jīchǔ基础jiù就yuè越bù不néng能shěnglüè省略。

The more deeply technology enters public life, the more indispensable these foundations of accountability and correction become.