Documentation

Get started with IOWarp's context engineering platform. Guides, API references, deployment instructions.

Quick Start

Get IOWarp running in minutes with Docker Compose. Perfect for local development and testing.

# Clone the repository
git clone https://github.com/iowarp/iowarp.git
cd iowarp

# Start with Docker Compose
pip install iowarp-clio
clio deploy --mode docker

# Verify installation
clio status

For native installation or Spack-based builds, see the Getting Started guide.

Data Model

Context = data + metadata + provenance + quality metrics. Hierarchical tiers: Critical (GPU HBM), Working (NVMe), Reference (PFS), Archive (tape/cloud).

Context Structure

  • β€’ Data: Actual content (files, datasets, streams)
  • β€’ Metadata: Schema, attributes, annotations
  • β€’ Provenance: Origin, transformations, lineage
  • β€’ Quality Metrics: Completeness, accuracy, freshness

Storage Tiers

  • β€’ Critical: GPU HBM (fastest, smallest)
  • β€’ Working: NVMe SSDs (high-speed cache)
  • β€’ Reference: Parallel File System (persistent)
  • β€’ Archive: Tape/Cloud (long-term storage)

IOWarp automatically manages data placement across tiers based on access patterns, cost, and performance requirements. Agents request context, and the system intelligently moves data to the optimal tier for each operation.