Inkling 2 Mini / Browser useGitHub ↗

5.18× on one autocomplete field

Inkling 2 Mini completed the same browser task in 3.84 seconds with two output rows swapped, down from 19.86 seconds. Both runs passed on M5 Max MacBook Pro.

M5 Max MacBook Pro repeat · 15.46 s to 3.36 s · 12.11 seconds saved. Hardware record

Same case on RTX 5090 · 3.90 s to 2.48 s · 1.57×. Both passed.

Two-row edit in BraveTime ratio
Autocomplete · both passed 2 of 4 initial seeds5.08×
Email reply · 1 selected passing pair4.35×
Form submission · 6 pairs in the repeat2.81×

Work in progress. Across the original 20 MiniWoB++ cases the original passed 11 and the edit passed 6. All timings and pass counts

32 tasks in order · 1× excerpts · 2:03. Save the film · Chapter times and grades.

Form and browser recordings

Autocomplete at 1× · Email reply at 1× · Form submit at 1× · Repeated form and cart at 1× · Original form and cart at 1× · WebArena forum post at 1×

Form and cart, repeated

In the original six pairs, the first edit was 2.56× faster. In the repeat, it was 2.39× faster across four joint completions. The edit passed 6/6 and the original passed 4/6.

Watch the four-row edit on the same dress · All 24 Mac runs and the two 5090 checks

WebArena coverage

25 WebArena IDs have native grades, and 23 have grades for stock and at least one edit. The latest checkpoint was evaluated on shopping search in Brave. Every search-submit grade, time and weight change · Earlier coverage

Ten WebArena tasks on RTX 5090

The original passed 8/30 attempts. The edit passed 5/30. Both earned full credit in 3 matched pairs.

Watch Search for a USB Wi-Fi adapter at 1× · All ten scores and trace replay · Download the click and end-of-generation edit

Five BrowserGym environments

The original passed 11/20 cases and the edit passed 6/20. Both passed 5. The original alone passed 6, the edit alone passed 1, and both failed 8. Across the 5 joint successes, median completion time was 19.86 s original and 3.84 s edited.

MiniWoB++ taskOriginalEdited
Email inbox3/43/4
Autocomplete2/43/4
Social feed3/40/4
Date picker3/40/4
Flight booking0/40/4

Four paired seeds per environment. The models saw rendered DOM text. BrowserGym scored the outcomes. Reproduce · Scores · 40 run receipts

Verify the edit

The output rows for the answer and thinking markers exchanged places. Exactly 4,596 BF16 values changed. On one loaded model, restoring the rows reproduced all 120 original form-response tokens.

Prefilling the original model’s answer channel also worked. On a separate development case it took 7.57 seconds, compared with 6.94 seconds for the edited model using the shared prompt.

Byte comparison · Reversal test · Run data