← Back to leaderboard

Research changes

Task-level outcomes and representative code changes from AutoRSE experiments.

Six-task results

Loading paper reference results…

Representative changes

These examples have different experiment and evaluation scopes. Each result is reported within its own scope, separately from the task-level means above.

HSTUPublic validation

Training and content representations

Standard · Claude Code × Claude Opus 4.8

Change

Compare two independent variants of the same HSTU control: cosine learning-rate decay with warmup, and a learnable projection of the supplied frozen 768-dimensional item features into the ID embedding space.

Observed result

Validation NDCG@10: control 0.06770; training schedule 0.06997; content fusion 0.07216.

Paper case study ↗
TIGERFinal held-out test

Hybrid ranking

Standard · Claude Code × DeepSeek V4 Flash · Trial 1

Change

Combine SASRec, HSTU and TIGER predictions with item-similarity scores derived from the latest interaction.

Observed result

Final submission NDCG@10: 0.0631.

A single archived run; this is not the three-trial mean or an isolated component effect.

Archived-run evidence ↗
IntSRGuided implementation

Wider training contrast

Idea-injected · Claude Code × DeepSeek V4 Flash

Change

Expand training candidates with in-batch positive items, retain cross-entropy, and mask target duplicates and observed-history negatives.

Observed result

Models trained with this augmentation were retained in the final ensemble. Its isolated performance contribution was not measured.

Paper appendix case study ↗