๐ AgentGr.id
A modular, LLM-powered system for reasoning, planning, delegating, and executing complex tasks using autonomous agents, tools, DSLs, and real-time coordination infrastructure. Scalable, pluggable, and built for modern, decentralized AI workloads.
Project Status ๐ง
- Alpha: This project is in active development and subject to rapid change. โ ๏ธ
- Testing Phase: Features are experimental; expect bugs, incomplete functionality, and breaking changes. ๐งช
- Not Production-Ready: We do not recommend using this in production (or relying on it) right now. โ
- Compatibility: APIs, schemas, and configuration may change without notice. ๐
- Feedback Welcome: Early feedback helps us stabilize future releases. ๐ฌ
๐ Contents
-
Getting Started
- Creating an Agent
- Using LLMs and other AI models
- Using Memory
- Managing and calling DSL Workflows
- Generating runtime code using Code Generator SDK
- Calling Functions and Tools
- Using Embedding Models
- Accessing Graph Databases
- Accessing Vector Databases
- Chat and P2P Communication with other agents
-
Advanced
- Association with other Agents
- Configuration Store
-
Architecture & Concepts
- Agent LLM Interaction
- Agent Planning System
- Agent Task Delegation
- Agent Verification System
- Agent Workflow Execution
- Behavior Controller
- Communication System
๐ Highlights
๐ง Multi-Stage Agent Planning & Reasoning
- Two-phase planning system using LLMs: task decomposition โ action selection
- Dynamically creates structured, executable task graphs (
PlannerTask
s) - Supports context-aware, memory-driven planning with FrameDB integration
- Uses prompt planners to guide selection across DSLs, tools, agents, and LLMs
๐ Delegation & Verification Workflows
- Assigns tasks to agents using bidding, voting, or DSL-planned routing
- Tracks assignment lifecycles and updates via WebSockets and DB watchers
- Supports automated and human-in-the-loop verification with real-time response handling
- Integrates constraint validation and deadline expiry logic for robust fault handling
โ๏ธ Modular Execution Engine
- Executes validated task DAGs with support for parallelism and recursion
- Dynamically dispatches to tool executors, LLMs, DSL workflows, or agent APIs
- Sandboxed code execution for runtime-generated Python logic
- Retry, fallback, and dry-run estimation modes supported
๐งฐ Registry-Driven Tool & DSL Ecosystem
- Unified registry for tools, functions, and DSL workflows
- Supports remote REST/gRPC-based tools and local logic executors
- Provides searchable metadata for LLM-based discoverability and selection
- Allows versioning, validation, and dynamic schema inspection
๐ง LLM & Optimizer Abstraction
- Backend-agnostic support for OpenAI, gRPC-based inference services, and org-hosted models
- Supports optimizer selection, capability estimation, and structured prompt generation
- Seamless integration with the behavior planner for intelligent flow construction
๐ Real-Time State, Messaging, and Streaming
- Rate-limited, DSL-aware message ingestion using NATS and WebSocket
- Namespace-aware context caching with Redis and TTL-based auto-expiry
- Real-time streaming of task updates, agent status, and delegation events
โจ Features
Feature | Description |
---|---|
LLM-Aided Multi-Stage Planning | Decompose job goals into structured, executable planner tasks |
Flexible DAG Execution | Dependency-aware task DAG runner with retry, fallback, and dry-run support |
Delegation Strategies | Bidding, voting, or direct DSL delegation to runtime agents |
Live Verification System | Agent and human verification workflows with WebSocket-based updates |
Tool/Function Management | Register, validate, and run local/remote execution assets |
DSL-Driven Orchestration | Compose and execute reusable, schema-validated DSL workflows |
Code Generation Sandbox | Securely generate and execute LLM-produced Python logic at runtime |
Metadata-First Registries | Rich metadata support for planner selection, versioning, and schema lookup |
Agent Context Cache | In-memory + Redis key-value store with NATS broadcasting |
Real-Time Messaging Layer | Queue-backed messaging for task execution, delegation, and coordination |
Persistent Task DB | MongoDB-backed storage for full task lifecycle across meta/sub/behavior |
Dynamic Subject Registry | Stores and queries agent subjects and runtime-subject metadata |
๐ Supported Libraries & Technologies
Category | Technologies & Tools |
---|---|
LLM Integration | OpenAI APIs, gRPC inference backends, organizational LLMs |
Task Orchestration | Async Python, DAG engines, dependency tracking, multiprocessing |
Messaging & Events | NATS, WebSockets, Redis Pub/Sub, real-time status tracking |
Workflow & DSLs | Custom DSL interpreters, planner schemas, node-based flow composition |
Storage & Context | MongoDB, Redis, FrameDB (Redis-backed distributed memory), S3-compatible stores |
Embeddings & Search | FAISS, Milvus, Weaviate, Qdrant, LanceDB for vector-based retrieval |
Execution & Infra | Kubernetes-native, microservice-compatible, sandboxed Python execution |
๐ฆ Use Cases
Use Case | What It Solves |
---|---|
LLM-Driven Workflow Execution | Auto-generates execution plans and executes structured graphs |
Multi-Agent Delegation | Routes sub-tasks to agents via policy-driven delegation logic |
Human/Agent Verification | Tracks and verifies responses from external systems or users |
Tool and DSL Integration | Enables reusable, discoverable, versioned execution assets |
Code Generation in Production | Safely executes dynamic logic from LLMs with import extraction |
Real-Time Observability | Streams task, delegation, and agent updates to dashboards |
๐ง Subsystems Overview
Subsystem | Role |
---|---|
behavior_controller |
Phase 1 (plan) + Phase 2 (select) LLM-powered task orchestration |
executor |
Runs validated task graphs, manages parallelism and recursion |
functions_tools_registry |
Registers tools/functions, validates schemas, supports remote/local |
dsl_manager |
Manages DSL workflows, schema description, and planner formatting |
delegation_system |
Delegates sub-tasks via auction, voting, or plan-and-retrieve |
verification_system |
Verifies tasks via agents or humans, tracks status via WebSockets |
agent_context_cache |
Key-value cache with topic-based broadcasting and backup control |
agent_tasks_db |
Stores and queries tasks across meta โ sub โ behavior layers |
agent_llm_interface |
Unified LLM inference + optimizer abstraction |
code_generator_sdk |
Dynamically generates and safely executes Python logic |
agents_db |
Registers and searches subject metadata and runtime instances |
communication_layer |
NATS and WebSocket-based priority messaging and coordination |
๐ข Communications
- ๐ง Email: community@opencyberspace.org
- ๐ฌ Discord: OpenCyberspace
- ๐ฆ X (Twitter): @opencyberspace
๐ค Join Us!
AIGrid is community-driven. Theory, Protocol, implementations - All contributions are welcome.
Get Involved
- ๐ฌ Join our Discord
- ๐ง Email us: community@opencyberspace.org