AI Aunt: Asked AI to migrate the entire codebase, 94.6% failed to pass the review.
2026-08-26 16:39:27
According to CoinMeta, as reported by AI, tests conducted by AI and agent on the einsia company's swe refactor showed that the success rate of migrating the entire codebase was only 5.4%. Out of 20 tasks, 13 were not completed at all. During the evaluation, AI and agent were given a time frame of 6 to 30 hours to complete their tasks, which included converting C code to rust, modifying maven to gradle, and migrating sqlite to wasi, among others. In the end, only 28 tasks were successfully completed out of 340 attempts, while 60 cases were found to have hidden bug. Among them, the configuration with claude and opus performed the best, successfully completing 5 tasks.
Source:Internet
This content is for market information only and does not constitute investment advice.
Follow WalletJYS official accounts to stay updated

Hot Articles
Refresh

'No longer a distant place': F2Pool Co-founder Chun Wang joins SpaceX's 2-year mission to Mars
05-22 18:25

Polymarket Targets Japan Approval Despite Gambling Laws
05-22 18:00

ZachXBT flags suspected exploit involving Polymarket's UMA adapter contract on Polygon
05-22 17:57

ZachXBT flags $520K Polymarket exploit on Polygon, team says funds are safe
05-22 17:24

Verus bridge exploiter returns 4,052 ETH, retains $2.8 million bounty: onchain analyst
05-22 17:24



