Skip to content

Timeline: which tools each Bot used, and how often they failed #538

Closed

Description

@HugoXK

What

The timeline lists each tool call inside a turn, but nothing summarizes which tools a Bot relies on or how often they fail, so a flaky tool or connector is hard to notice.

Expected behavior

  • timeline/window gains toolUse: per Bot lane, its tools as { name, calls, failed }, by call count (top 20), names cleaned and capped.
  • Read-only, part of the existing answer, metadata only.

Change scope

plugins/timeline/src/window.js, a case in plugins/timeline/test/window.test.js, docs/subsystems/timeline.md. Plugin only.

Why

Tool/connector reliability becomes visible where the run is drawn (#357; #359 connectors).

Activity

  1. Birfy commented on Oct 20, 2026

    @Birfy
    Collaborator

    Triage (Birfy, 2026-10-20 20:08 Asia/Shanghai). Read-only timeline analytics: timeline/window gains toolUse, per Bot { name, calls, failed }, top 20, names cleaned. Plugin only. HugoXK's PR #539 implements it (reviewed PASS at c5e47a5, CI green).

    Design check: no conflict with the owner rules (metadata only, no args or output). It is derivable from turns[].tools, and no panel view reads it yet. Same series as #530/#534/#536, with no overlap with the merged export (#484/#523/#524).

    Proposed scope if accepted: as in #539, plus a small per-Bot tool table in the panel (calls/failed), which makes connector failures visible (#359).

    needs-human: the owner needs to confirm this new feature and whether HugoXK's #539 is accepted as the implementation.

  2. added
    enhancementNew feature or request
    area:automationScheduled tasks and automation
    needs-humanThe agent loop stopped; a person must decide (reason in the last comment)
    on Oct 20, 2026
  3. Birfy commented on Oct 20, 2026

    @Birfy
    Collaborator

    Owner decision (2026-10-20 21:09 Asia/Shanghai): accepted (option a). PR #539 is accepted; the per-tool usage/failure data must also be visible in the dashboard/panel, not only in the timeline/window API.

  4. added
    agent-readyMaintainer-approved spec: an agent may take it. Only maintainers set this; never in a template
    agent-workingAn agent has claimed this issue (the claim comment names the branch)
    and removed
    needs-humanThe agent loop stopped; a person must decide (reason in the last comment)
    on Oct 20, 2026
  5. removed
    agent-readyMaintainer-approved spec: an agent may take it. Only maintainers set this; never in a template
    agent-workingAn agent has claimed this issue (the claim comment names the branch)
    on Oct 21, 2026
  6. added a commit that references this issue on Oct 21, 2026
    41b0856
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:automationScheduled tasks and automationenhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions