AI 诈骗通常利用了以下技术手段：
产生的原因包括：
其影响主要有：
为了防范 AI 诈骗，需要建立相关的标准和最佳实践来检测 AI 生成的内容，并对官方内容进行认证和标记，例如商务部可以开发内容认证和水印的指导方针，联邦机构可以利用这些工具让公众更容易识别真实的官方通信。
Require that developers of the most powerful AI systems share their safety test results and other critical information with the U.S.government.In accordance with the Defense Production Act,the Order will require that companies developing any foundation model that poses a serious risk to national security,national economic security,or national public health and safety must notify the federal government when training the model,and must share the results of all red-team safety tests.These measures will ensure AI systems are safe,secure,and trustworthy before companies make them public.Develop standards,tools,and tests to help ensure that AI systems are safe,secure,and trustworthy.The National Institute of Standards and Technology will set the rigorous standards for extensive red-team testing to ensure safety before public release.The Department of Homeland Security will apply those standards to critical infrastructure sectors and establish the AI Safety and Security Board.The Departments of Energy and Homeland Security will also address AI systems’ threats to critical infrastructure,as well as chemical,biological,radiological,nuclear,and cybersecurity risks.Together,these are the most significant actions ever taken by any government to advance the field of AI safety.Protect against the risks of using AI to engineer dangerous biological materials by developing strong new standards for biological synthesis screening.Agencies that fund life-science projects will establish these standards as a condition of federal funding,creating powerful incentives to ensure appropriate screening and manage risks potentially made worse by AI.Protect Americans from AI-enabled fraud and deception by establishing standards and best practices for detecting AI-generated content and authenticating official content.The Department of Commerce will develop guidance for content authentication and watermarking to clearly label AI-generated content.Federal agencies will use these tools to make it easy for Americans to know that the communications they receive from their government are authentic—and set an example for the private sector and governments around the world.
|本质|对信息的扭曲|人类认知偏差_大脑在处理信息时，为了节省认知资源而采取的“捷径”，这些捷径虽然可以提高效率，但也容易导致对信息的扭曲和误判|AI幻觉_模型对训练数据中统计模式的过度依赖，导致其在面对新情况时，无法准确地理解和生成信息，最终输出与现实世界不符的内容||-|-|-|-||表现形式|多种多样且难以察觉|确认偏误（只关注支持自己观点的信息）、可得性偏差（更容易回忆起最近或印象深刻的信息）、锚定效应（过分依赖最初获得的信息）|生成不存在的人物、地点、事件，或者对已知事实进行错误的描述。||产生原因|都与经验和知识有关|与个人的成长经历、文化背景、知识结构等等有关。不同的经验和知识会塑造不同的认知模式，导致人们对相同的信息做出不同的解读|与训练数据的质量、模型的结构和训练策略有关。如果训练数据存在偏差或错误，模型就会学习到这些偏差和错误，并将其体现在生成的内容中||影响|可能导致错误的决策|可能导致我们在生活中做出错误的判断和选择。例如，一个投资者如果受到可得性偏差的影响，可能会高估近期股市上涨的趋势，从而做出错误的投资决策|可能会误导用户、传播虚假信息、甚至引发安全事故。例如，一个用于医疗诊断的AI系统，如果出现幻觉，可能会给出错误的诊断结果，从而延误患者的治疗|