Skip to content

[Feature] Parallel Tool Call Execution#926

Draft
da-daken wants to merge 6 commits into
apache:mainfrom
da-daken:parallel_tool
Draft

[Feature] Parallel Tool Call Execution#926
da-daken wants to merge 6 commits into
apache:mainfrom
da-daken:parallel_tool

Conversation

@da-daken

Copy link
Copy Markdown
Contributor

Linked issue: #925

Purpose of change

Add parallel execution capability for tool calls via a new public API (RunnerContext.durableExecuteAllAsync()), which submits a batch of tool calls concurrently to an async thread pool and returns results in the original order after all complete.
The execution is durable: the state of in-flight calls is persisted, so that upon recovery (e.g., from checkpoint) the system correctly restores and completes the pending calls, ensuring no duplicate or lost invocations.

Tests

  • Unit tests to verify the ordering and consistency of parallel execution results.
  • Integration tests to validate correctness under concurrent scenarios.
  • Fault-tolerance tests to ensure that after a simulated failure and recovery, the state of parallel executions is correctly restored and all results are eventually returned exactly once.

API

  • Introduce a new public API RunnerContext.durableExecuteAllAsync() for batch parallel execution of tool calls.
  • Expose the parallel execution capability without breaking compatibility with the existing synchronous API.

Documentation

  • doc-needed
  • doc-not-needed
  • doc-included

@github-actions github-actions Bot added doc-needed Your PR changes impact docs. fixVersion/0.4.0 priority/major Default priority of the PR or issue. labels Jul 24, 2026
@da-daken
da-daken marked this pull request as draft July 24, 2026 06:09
@da-daken da-daken changed the title Parallel tool [Feature] Parallel Tool Call Execution Jul 24, 2026
@github-actions github-actions Bot added doc-needed Your PR changes impact docs. and removed doc-needed Your PR changes impact docs. labels Jul 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

doc-needed Your PR changes impact docs. fixVersion/0.4.0 priority/major Default priority of the PR or issue.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant