completion rates

AppWizard
September 19, 2026
Google has launched Android Bench 2.0, an upgraded benchmark for evaluating AI coding agents, which now includes 30 long-horizon tasks that can take human engineers days or weeks to complete. The best pass rate for these tasks is around 28%, down from approximately 91% in the previous version. The benchmark measures both pass rates and completion rates, acknowledging partial progress rather than just failures. It assesses various challenges, including app creation and feature integration, using a comprehensive scoring methodology that evaluates functionality, regression checks, and visual fidelity. AI models perform better with new code than with modifications to existing systems, facing challenges in runtime validation and cross-platform conversions. The current leaderboard shows OpenAI’s GPT-6 Astra leading with a 28% pass rate, while Gemini 3.8 Flash has an 8% pass rate. Developers using AI agents should be aware that while AI can generate significant portions of applications, further refinements will require human input. The benchmark is available on Google’s Android Bench leaderboard.
AppWizard
September 18, 2026
Google has released version 2.0 of Android Bench, which focuses on managing complex development tasks rather than minor adjustments. The new version evaluates tasks that may take engineers days or weeks to complete, such as adding features and building applications. A continuous scoring method has replaced the previous pass or fail system, assessing completion rates based on functionality, visual fidelity, and adherence to instructions. Various AI models have been tested, with GPT-6 Astra achieving a 28% pass rate, significantly lower than the previous scores around 90%. No model has achieved a 100% pass rate in porting cross-platform applications, with the best reaching 80%. AI performs better in writing new code than in refactoring existing code, facing challenges with architectural complexity and runtime validation. Android Bench utilized agents from model providers for evaluations and plans to incorporate various model combinations in future updates.
AppWizard
March 25, 2026
Hideo Kojima set a benchmark for player engagement in Death Stranding 2, aiming for a fulfilling experience that encourages completion. Feedback from playtesters led Kojima to enhance the game's playability while avoiding conventional gaming tropes. In the original Death Stranding, completion rates were low, with about 40% of PS4 players, 34% of PS5 players, and 20% of Steam players finishing the game. Initial data for Death Stranding 2 shows over 62% of players completing the final chapter, attributed to easier navigation with vehicles and tools. To address concerns about reduced challenge, a difficulty setting called To the Wilder was introduced in the PC release. Kojima Productions aims to balance enjoyment and accessibility with depth and complexity in the game.
Search