5.18× on one autocomplete field
Inkling 2 Mini completed the same browser task in 3.84 seconds with two output rows swapped, down from 19.86 seconds. Both runs passed on M5 Max MacBook Pro.
M5 Max MacBook Pro repeat · 15.46 s to 3.36 s · 12.11 seconds saved. Hardware record
Same case on RTX 5090 · 3.90 s to 2.48 s · 1.57×. Both passed.
| Two-row edit in Brave | Time ratio |
|---|---|
| Autocomplete · both passed 2 of 4 initial seeds | 5.08× |
| Email reply · 1 selected passing pair | 4.35× |
| Form submission · 6 pairs in the repeat | 2.81× |
Work in progress. Across the original 20 MiniWoB++ cases the original passed 11 and the edit passed 6. All timings and pass counts
Form and browser recordings
Autocomplete at 1× · Email reply at 1× · Form submit at 1× · Repeated form and cart at 1× · Original form and cart at 1× · WebArena forum post at 1×
Form and cart, repeated
In the original six pairs, the first edit was 2.56× faster. In the repeat, it was 2.39× faster across four joint completions. The edit passed 6/6 and the original passed 4/6.
Watch the four-row edit on the same dress · All 24 Mac runs and the two 5090 checks
WebArena coverage
25 WebArena IDs have native grades, and 23 have grades for stock and at least one edit. The latest checkpoint was evaluated on shopping search in Brave. Every search-submit grade, time and weight change · Earlier coverage
WebArena search
The four-row edit opened USB Wi-Fi search results in 3.49 seconds versus 5.31 on RTX 5090. Repeat pairs measured 3.43 versus 5.29 seconds and 3.45 versus 5.33 seconds. An additional pair measured 5.31 s original and 3.55 s edited (1.49×). Both checkpoints passed every pair.
Watch the search at 1× · All search experiments · Download the four-row model
Ten WebArena tasks on RTX 5090
The original passed 8/30 attempts. The edit passed 5/30. Both earned full credit in 3 matched pairs.
Watch Search for a USB Wi-Fi adapter at 1× · All ten scores and trace replay · Download the click and end-of-generation edit
Five BrowserGym environments
The original passed 11/20 cases and the edit passed 6/20. Both passed 5. The original alone passed 6, the edit alone passed 1, and both failed 8. Across the 5 joint successes, median completion time was 19.86 s original and 3.84 s edited.
| MiniWoB++ task | Original | Edited |
|---|---|---|
| Email inbox | 3/4 | 3/4 |
| Autocomplete | 2/4 | 3/4 |
| Social feed | 3/4 | 0/4 |
| Date picker | 3/4 | 0/4 |
| Flight booking | 0/4 | 0/4 |
Four paired seeds per environment. The models saw rendered DOM text. BrowserGym scored the outcomes. Reproduce · Scores · 40 run receipts
Verify the edit
The output rows for the answer and thinking markers exchanged places. Exactly 4,596 BF16 values changed. On one loaded model, restoring the rows reproduced all 120 original form-response tokens.
Prefilling the original model’s answer channel also worked. On a separate development case it took 7.57 seconds, compared with 6.94 seconds for the edited model using the shared prompt.