On the heels of investigations on what caused a cyberattack committed by OpenAI models, Nvidia and a host of tech giants announced a new AI safety initiative.
Called the Open Secure AI Alliance, the new initiative includes companies like Microsoft, Palantir, Adobe, IBM, Dell, Cloudfare, and many others. Nvidia says that the initiative has been formed with the intention of developing and sharing open tools that promote “responsible use and trust” of AI.
“Some argue that open models are inherently less safe because they can be misused for cyberattacks or modified to remove guardrails,” says Nvidia in its announcement. “Those risks are real, but they do not disappear in closed systems, and simply keeping weights closed does not prevent determined attackers from seeking or exploiting powerful AI.”
“The right response is not to deny defenders access to capable open systems. It is to pair openness with strong safeguards, clear rules against malicious misuse, rigorous evaluation and rapid remediation. In cybersecurity, the safer path is the one that gives more defenders the ability to test, verify and strengthen the systems on which society relies.”
