Article
PUBG developer open-sources 30B model: Bug fixing approaches Meta, with Kimi and DeepSeek technology under the hood
Dongcha Beating AI breaking news, the South Korean gaming giant KRAFTON has released Raon-1 mini Preview. This is a MoE language model trained from scratch, with approximately 28800000000 total parameters, activating only 4300000000 per inference, with a focus on optimizing Korean dialogue, programming, and Agent capabilities, and supporting 260000 Token context.
Although it was trained from scratch, its underlying technology also shows the influence of Chinese companies. It uses a hybrid attention architecture, and in its 25-layer network, 18 layers use a linear attention mechanism improved from Kimi Delta Attention. In addition, the team simplified DeepSeek's mHC hyperconnection technology to reduce training computational costs.KRAFTON tests released by Raon-1 show that SWE mini achieved 70.8%on the -Verified code-fixing test, surpassing Qwen3.6-35B-A3B's 63.2%and approaching 72.0%for Meta Muse Glimmer. However, in the Terminal-Bench Lite terminal-operation test, it scored only 47.0%, significantly behind Qwen3.6-35B-A3B's 63.3%and Muse Glimmer's 70.7%. In the IFBench instruction-following test, it reached 84.2%, higher than the two models mentioned above.
The model weights have been released under the Apache 2.0 license, with versions including GGUF、MLX available and support for local operation on Mac. The NVFP4 quantized version can be deployed on a single RTX 5090. The team also provides a DFlash2 speculative decoding model; in tests on a single NVIDIA B300, it achieved a maximum 2.18-fold increase in output throughput compared with standard decoding.
Original link https://m.theblockbeats.info/flash/373005