Article

OpenAI Co-founder John Schulman: AI Alignment Should Become Public Science, Not Be Dominated by a Few Tech Companies

Breaking AI News Flash: John Schulman, co-founder of Thinking Machines and OpenAI, stated on the A16Z podcast that AI alignment should not be the exclusive research of a handful of tech companies, but rather develop into a global public science, enabling more people to participate in shaping AI values and avoiding over-reliance on the judgment of a few companies.

As recursive self-improvement (RSI) gradually makes progress, AI has begun assisting in model development. OpenAI Chief Research Officer Mark Chen revealed that early signs of an RSI acceleration effect have emerged in the AI development process, with current progress at about 25% to 50%, but AI still struggles to independently determine valuable research directions and has not yet achieved independent development of next-generation models.

Mark Chen also warned that as models become more autonomous, prolonged operation could lead to unintended secondary objectives if their goals conflict with human intentions. However, more powerful AI may also help researchers monitor model behavior and detect and fix alignment issues.

John Schulman emphasized that AI alignment is not only a technical issue but also concerns who decides the values that AI should follow, and that users and society should have more space to participate in and shape AI values.