Skip to content
ENTITY PROFILE / KNOWLEDGE GRAPH

SWE-bench Verified

RSS

Qwen3.5-9B improved Pass@1 on SWE-bench Verified from 41.8% to 56.4%. Google Gemini 3.8 Flash solved 68% of the problems on the TheoPhysEval benchmark Google provides the Google Gemini 3.8 Flash model Open SWE -> SUPPORTS_PROVIDER -> Runloop The Qwen/Qwen3.5‑9B model is provided for use with the Transformers library. Flint leads coding benchmark SWE-Bench Verified Claude Code harness was tested on SWE-bench Verified OpenCode harness was tested on SWE-bench Verified mini-SWE-agent harness was tested on SWE-bench Verified· Entity summary generated by Graphiti

RELATIONS
9Relations
CURRENT
9Current
EVENTS
5Events
REPORTS
6Source reports
KNOWLEDGE ATLAS0 entities · 0 relations
No public neighbors yet
Explore all published links of a node; previously discovered relations remain visible.

Relation timeline

BY VALID-FROM DATE
  1. mini-SWE-agentTESTED ONSWE-bench Verified

    mini-SWE-agent harness was tested on SWE-bench Verified

    Current1 sourcemini-SWE-agent
  2. Claude CodeTESTED ONSWE-bench Verified

    Claude Code harness was tested on SWE-bench Verified

    Current1 sourceClaude Code
  3. OpenCodeTESTED ONSWE-bench Verified

    OpenCode harness was tested on SWE-bench Verified

    Current1 sourceOpenCode
  4. FlintLEADSSWE-bench Verified

    Flint leads coding benchmark SWE-Bench Verified

    Current1 sourceFlint
  5. SWE-bench VerifiedIS MODEL FORTransformers

    The Qwen/Qwen3.5‑9B model is provided for use with the Transformers library.

    Current1 sourceTransformers
  6. GooglePROVIDESSWE-bench Verified

    Google provides the Google Gemini 3.8 Flash model

    Current1 sourceGoogle
  7. SWE-bench VerifiedSOLVEDTheoPhysEval benchmark

    Google Gemini 3.8 Flash solved 68% of the problems on the TheoPhysEval benchmark

    Current1 sourceTheoPhysEval benchmark
  8. Open SWESUPPORTS PROVIDERSWE-bench Verified

    Open SWE -> SUPPORTS_PROVIDER -> Runloop

    Current1 sourceOpen SWE
  9. Qwen3.5-9BINCREASED PASS AT 1 ON SWE BENCH VERIFIED FROM 41.8 TO 56.4SWE-bench Verified

    Qwen3.5-9B improved Pass@1 on SWE-bench Verified from 41.8% to 56.4%.

    Current1 sourceQwen3.5-9B

Relations are facts Graphiti extracted from reports, not verbatim quotes. An end date means later reporting showed the relation no longer holds.

Events 5

Source reports 6