Article
The day after ByteDance Seed’s security department was established, it began global recruiting 10 people, focusing on Agent privilege escalation and model attack and defense
Dongcha Beating AI news flash: ByteDance Seed has just established security and alignment as a separate department,October 14 and launched global recruitment, planning to recruit 10 researchers, with work locations including Beijing, Shanghai, and San Jose, USA. The new department is led by Yan Lin, who previously oversaw alignment for the Doubao model, and reports directly to Wu Yonghui, head of Seed. The former Responsible AI team and some members of the Chat team will also transfer in.
The new department aims to address safety issues arising as models become increasingly capable of acting autonomously. For example, when an Agent Agent calls tools, it may exceed its authorization, be induced by malicious prompts to break through safety restrictions, or fail to detect and block unknown risks in time. To this end, the team plans to improve safety training methods from pretraining,SFT to RL; continuously identify vulnerabilities through automated red-team testing; and research model-behavior interpretability, anomaly tracing, and CBRN high-risk capabilities such as CBRN (chemical, biological, radiological, and nuclear). ByteDance has pledged long-term investment and will provide computing resources commensurate with frontier model research.
Original article link https://m.theblockbeats.info/flash/371742