os-world.github.io - OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

home > domains > os-world.github.io

Description: OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

human computer interaction (156) general-purpose agent (1)

Example domain paragraphs

Key statistics of OSWorld . The “Supp. tasks” refers to the Windows-based tasks, that could only be used after activation due to copyright restrictions.

Distribution of task instructions in OSWorld based on the app domains and operation types to showcase the content intuitively.

t=1.0, top-p=0.9

Links to os-world.github.io (8)

• taoyds.github.io Tao Yu (余涛) | Home
• xlang.ai XLANG Lab
• ds1000-code-gen.github.io DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation
• shuyanzhou.github.io Shuyan Zhou
• yitaoliu17.com Yitao Liu
• zdy023.github.io Danayng Zhang - Homepage
• taogoddd.github.io Yitao Liu
• chenjix.github.io Jixuan Chen