回复 3楼 zhangfei123 的帖子 OpenAI研究人员做过测试了，较大的freelance的项目，现在最先进的大模型能解决的很少。 SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering? https://arxiv.org/pdf/2502.12115 We introduce SWE-Lancer, a benchmark of over 1,400 freelance software engineering tasks from Upwork, valued at $1 million USD total in realworld payouts. SWE-Lancer encompasses both independent engineering tasks — ranging from $50 bug fixes to $32,000 feature implementations — and managerial tasks, where models choose between technical implementation proposals. Independent tasks are graded with end to end tests triple-verified by experienced software engineers, while managerial decisions are assessed against the choices of the original hired engineering managers. We evaluate model performance and find that frontier models are still unable to solve the majority of tasks.
我从不质疑这些人的愚昧。 never. 尽管我不知道他们处于什么样的目的。
guess we will see 还有那个stability AI ceo说的三年内没有programmer 再写代码。还有一年。
我敢打赌， 再过 5年也没戏。 我从不迷信 CEO, ceo 里的蠢货多了去了。 要不个个公司都是 trillion market cap.
3 到6个月也敢喊估计是最近要融救命钱
什么类型的程序？
OpenAI研究人员做过测试了，较大的freelance的项目，现在最先进的大模型能解决的很少。
SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering? https://arxiv.org/pdf/2502.12115
We introduce SWE-Lancer, a benchmark of over 1,400 freelance software engineering tasks from Upwork, valued at $1 million USD total in realworld payouts. SWE-Lancer encompasses both independent engineering tasks — ranging from $50 bug fixes to $32,000 feature implementations — and managerial tasks, where models choose between technical implementation proposals. Independent tasks are graded with end to end tests triple-verified by experienced software engineers, while managerial decisions are assessed against the choices of the original hired engineering managers. We evaluate model performance and find that frontier models are still unable to solve the majority of tasks.