内容来源：https://www.engadget.com/moderators-call-for-ai-controls-after-reddit-answers-suggests-heroin-for-pain-relief-230749515.html?src=rss

内容总结：

近日，Reddit论坛的AI功能"Reddit Answers"因向用户提供危险医疗建议引发广泛争议。多名版主反映，该AI工具不仅建议慢性疼痛患者停用处方药、大剂量服用在部分州属违禁的卡痛叶，甚至推荐海洛因作为镇痛方案，还曾对新生儿发烧等医疗问题给出存在安全隐患的答复。

值得注意的是，论坛版主发现这些危险内容后无法关闭或隐藏AI生成版块，也无法对错误信息进行标记。尽管Reddit官方回应称已更新系统，停止在"敏感话题"的讨论页面显示"相关答案"，但平台尚未明确界定敏感话题范围，也未承诺为版主提供管理AI内容展示权限的工具。

当前AI工具显然缺乏处理专业医疗信息的能力，更难以识别网络常见的反讽或恶意建议。在缺乏有效监管机制的情况下，内容审核工作正面临前所未有的挑战。

中文翻译：

Reddit平台版主呼吁加强对AI功能的管控，因其推荐海洛因作为止痛方案。即便人工智能生成的内容存在危险或错误信息，目前也无法关闭该功能。随着聊天机器人日益普及，我们目睹过人工智能对查询给出各种匪夷所思的答复。近日，Reddit平台的“问答助手”功能因提供危险医疗建议而引发关注，版主发现他们既无法禁用也无法隐藏这些AI生成内容。

有版主反映，该AI工具建议慢性疼痛患者停用现有处方药，转而服用高剂量卡痛叶——这种未受监管的物质在多个州属违禁品。该用户随后继续咨询其他医疗问题，除获得部分正确建议外，AI不仅给出治疗新生儿发烧的潜在危险方案，还推荐使用海洛因缓解慢性疼痛。多位来自健康类版块的版主在原帖下回应，对其管辖社区中出现错误或危险AI信息时缺乏关闭或举报机制表示担忧。

Reddit发言人向404媒体确认已更新问答助手功能以解决部分顾虑。“本次更新确保涉及敏感话题的‘相关答案’——这些内容此前可能显示在帖子详情页——将停止展示。”但关于具体哪些话题被列入屏蔽范围，截至发稿时平台未予进一步说明。

尽管官方声称该AI系统“已排除私密社区、受限内容及成人版块的资料，并过滤部分成人话题”，但显然当前工具仍不具备提供专业医疗信息的能力，更无力应对其他用户可能给出的讥讽言论或错误建议。除停止在敏感话题下显示外，Reddit似乎未打算提供控制AI在子版块展示方式或时长的管理工具，这或将使本就艰巨的版主管理工作难上加难。

英文来源：

Moderators call for AI controls after Reddit Answers suggests heroin for pain relief
There's no way to turn off the AI-generated sections, even when they have dangerous or inaccurate information.
We've seen artificial intelligence give some pretty bizarre responses to queries as chatbots become more common. Today, Reddit Answers is in the spotlight after a moderator flagged the AI tool for providing dangerous medical advice that they were unable to disable or hide from view.
The mod saw Reddit Answers suggest that people experiencing chronic pain stop taking their current prescriptions and take high-dose kratom, which is an unregulated substance that is illegal in some states. The user said they then asked Reddit Answers about other medical questions. They received potentially dangerous advice for treating neo-natal fever alongside some accurate actions as well as suggestions that heroin could be used for chronic pain relief. Several other mods, particularly from health-focused subreddits, replied to the original post adding their concerns that they have no way to turn off or flag a problem when Reddit Answers has provided inaccurate or dangerous information in their communities.
A representative from Reddit told 404 Media that Reddit Answers had been updated to address some of the mods' concerns. "This update ensures that ‘Related Answers’ to sensitive topics, which may have been previously visible on the post detail page (also known as the conversation page), will no longer be displayed," the spokesperson told the publication. "This change has been implemented to enhance user experience and maintain appropriate content visibility within the platform." We've reached out to Reddit for additional comment about what topics are being excluded but have not received a reply at this time.
While the rep told 404 Media that Reddit Answers "excludes content from private, quarantined and NSFW communities, as well as some mature topics," the AI tool clearly doesn't seem equipped to properly deliver medical information, much less to handle the snark, sarcasm or potential bad advice that may be given by other Redditors. Aside from the latest move to not appear on “sensitive topics,” it doesn't seem like Reddit plans to provide any tools to control how or when AI is being shown in subreddits, which could make the already-challenging task of moderation nearly impossible.