Collect first agent research and market sources

2026-07-08 12:08:24 +08:00
parent 36c2499d3c
commit 1cbc98e432
34 changed files with 3417 additions and 58 deletions
@@ -0,0 +1,71 @@
+# Industry: Microsoft - STATE-Bench
+
+---
+type: industry
+company: Microsoft
+team: Microsoft Open Source
+title: "Introducing STATE-Bench: a benchmark for AI agent memory"
+url: https://opensource.microsoft.com/blog/2026/05/19/introducing-state-bench-a-benchmark-for-ai-agent-memory/
+source_name: Microsoft Open Source Blog
+source_type: benchmark
+source_quality: official
+published_at: 2026-05-19
+collected_at: 2026-07-08
+status: analyzed
+topics:
+  - memory
+  - agent-evaluation
+  - enterprise-ai
+implementation_signals:
+  - stateful-environment
+  - user-simulator
+  - deterministic-assertions
+  - bring-your-own-memory
+product_area:
+  - customer-support
+  - travel
+  - shopping
+models:
+  -
+tools:
+  - STATE-Bench
+benchmarks:
+  - STATE-Bench
+related_papers:
+  - 2026-memory-agent-survey
+  - 2026-wang-evomembench
+related_jobs:
+  - 2026-07-08-baidu-aidu-agent-algorithm-engineer-beijing
+related_experiments:
+  -
+related_projects:
+  -
+evidence_level: high
+relevance: high
+---
+
+## One-line Takeaway
+
+Memory 评估应衡量 Agent 是否因经验而更会执行流程，而不是只测试远距离事实召回。
+
+## What They Built or Claimed
+
+Microsoft 发布 STATE-Bench，一个开源、memory-agnostic benchmark，用现实企业任务评估 Agent 是否能通过经验改进。
+
+## Technical Signals
+
+- architecture: 多轮对话 loop + stateful environment + deterministic assertions。
+- tool use: 任务涉及查询、校验策略、计算费用、确认并执行。
+- memory: bring-your-own-memory 接口。
+- evaluation: 450 个任务，覆盖 travel、customer support、shopping。
+- safety: 状态改变任务会带来真实成本，强调流程合规。
+- deployment: open-source benchmark。
+- data: 预填充数据库和用户模拟器。
+
+## Evidence Quality
+
+官方开源博客，包含任务数、领域、评估 loop 和 GitHub 入口，证据强。
+
+## Gaps for Us
+
+- 可以基于 STATE-Bench 思路做一个小型企业流程 Agent eval。