Amplifier Streaming Loop Orchestrator Module

Token-level streaming orchestration for real-time response delivery.

Prerequisites

• Python 3.11+
• UV - Fast Python package manager

Installing UV

# macOS/Linux/WSL
curl -LsSf https://astral.sh/uv/install.sh | sh

# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"

Purpose

Provides streaming orchestration that delivers LLM responses token-by-token for improved perceived performance and user experience.

Contract

Module Type: Orchestrator Mount Point: orchestrators Entry Point: amplifier_module_loop_streaming:mount

Behavior

• Token-level streaming from provider
• Real-time response delivery
• Parallel tool execution: Multiple tool calls execute concurrently
• Deterministic context updates: Results added in original order
• Progressive rendering
• Interruptible generation

Configuration

[[orchestrators]]
module = "loop-streaming"
name = "streaming"
config = {
    buffer_size = 10,           # Tokens to buffer before flush
    max_iterations = -1,        # Maximum iterations (-1 = unlimited, default)
    timeout = 300               # Timeout in seconds
}

Usage

# In amplifier configuration
[session]
orchestrator = "loop-streaming"

Perfect for:

• Interactive CLI applications
• Web UIs with progressive rendering
• Long-form content generation

Dependencies

• amplifier-core>=1.0.0

Contributing

Note

This project is not currently accepting external contributions, but we're actively working toward opening this up. We value community input and look forward to collaborating in the future. For now, feel free to fork and experiment!

Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit Contributor License Agreements.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.