Hacker News AI · 2026/10/14 00:05:51

科学家质疑 AI 窃取创意:模型能力展示引发学术隐私与优先权焦虑

原标题:Scientists wonder: Is my AI stealing my ideas?
68AI 研判分
核心综述

随着 AI 公司频繁展示其解决复杂数学问题等研究能力,科研人员日益担忧上传至模型的稿件被用于训练或被视为模型成果。这种“不使用即落后”的压力迫使科学家在保护知识产权隐私与保持学术竞争力之间艰难权衡,引发了关于 AI 是否实质性窃取人类创意的行业争议。

报道全文原始报道全文

Add Us On GoogleAdd SciAm

Scientists wonder: Is my AI stealing my ideas?

Researchers are using AI as a sounding board throughout their work. But concerns are growing that companies may present users’ ideas as those of their models

A surveilling eye has node coming out, implying it is watching activity in the nearby structures.

Scientists are becoming increasingly concerned about the privacy of their manuscripts in the wake of high-profile accusations that AI companies harvested uploaded documents. Who is Danny/Shutterstock

Recently, controversy and accusations have followed artificial intelligence companies flexing their models’ research capabilities. When OpenAI claimed an internal model had solved one of math’s seven million-dollar problems, a mathematician at New York University insinuated that the company had stolen his progress, which he had shared with one of their chatbots. Weeks later, the New York Times reported a similar story unfolding between Anthropic and a biologist at the University of Copenhagen regarding a group of enzymes.

Despite this, scientists from all disciplines are opting to use these companies’ large language models. Some use them as a soundboard or a tool for literature review, others for cleaning up nearly finished work. And mathematicians and theorists are tapping their new, powerful models to generate entire proofs for their research. But as researchers feed more of their data and ideas into these models, concerns are growing about how that content is getting used.

Both OpenAI and Anthropic stated unequivocally that they did not train their models on the mathematician’s and biologist’s uploaded data, respectively. But the companies—which have not consistently met academic norms—don’t have every scientist’s trust. Some suspect they may not even have the full picture themselves. Their agents could be accessing data in ways the companies don’t even realize. After all, it took three months for the public to learn that OpenAI’s models had breached containment and hacked into foreign government databases.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


With these conspiracy theories swirling, some researchers are now seeing the models more as competitors than tools—and the use of them as a betrayal. “I’m not encouraging it, and I’m not doing it myself,” says Clément Canonne, a theoretical computer scientist at the University of Sydney. “I’m not using them.”

Ahead of taking their companies public, OpenAI and Anthropic are increasingly stepping into math and science to show how capable their products are. But AI has sometimes felt less like a guest over for dinner and more like an unwanted visitor breaking and entering. If scientists feel that these companies are rifling through their every interaction, they may start locking them out entirely.

The lack of transparency invites these sorts of fears. “Right now, these systems infer things about you without telling you that they’re inferring things about you,” says Jennifer King, a fellow at the Stanford University Institute for Human-Centered Artificial Intelligence, who researches data privacy and policy.

King says the only way for researchers to really ensure their safety when using large language models at the present moment is to look at their account settings carefully. According to her, “enterprise” accounts—which represent a special deal worked out between a client company and the AI’s owners—seem to be safe. “But if you are on a personal account, all bets are off,” she warns. She describes how users on personal accounts need to explicitly opt out in many cases to prevent their information being used from training.

Plus, even if a company isn’t intentionally using your data to train their models, one of their many agents could always go rogue, infiltrating company data and hoovering up individual users’ conversations with their chatbots. While there is no evidence this happened in the case of any of the AI companies’ scientific discoveries, rogue events over the summer have left some extra concerned about who they trust with their data.

The trouble is, it’s hard to get much evidence at all out of the tech giants. “The companies are not transparent about these practices, so it’s really hard to pin down,” King says. That means experts can’t speculate about any particular case. But in general, “the companies spy on you and use that information against you,” says Bruce Schneier, a security researcher and activist.

The new AI models are very capable, including for research, and many believe they will help researchers find new results faster. So scientists may feel they face a choice: either use the models and risk leaking a discovery or don’t and risk someone who does publishing it first.

All this has created an uneasy landscape in which many scientists are left feeling they have to give up their privacy and work to keep up. “There is definitely a pressure,” Canonne says. “If you’re not using them, are you going to be irrelevant?”