@x12i/memorix-pipeline

@x12i/memorix-pipeline

Durable pipeline DAG engine (memorix-pipeline/v2): captured plans, ordered step attempts, port registry (Memory, map, write, relationships, compose, enrich, …), retries, and run context.

Install

npm install @x12i/memorix-pipeline@3.0.2

Audience	Use this package?
Remote app	No — /api/pipelines
Platform / service	Yes

Exports

import {
  createPipelineRuntime,
  createLivePortRegistry,
  validatePipelineDefinition,
  createMongoRunLedger,
} from "@x12i/memorix-pipeline/v2";

Main entry also re-exports v2 surfaces from . where applicable; prefer ./v2 for new code.

Lifecycle

pipeline definition (metadata)
  → start run (capture plan + fingerprint)
  → execute steps (attempts with input/output / DataRef)
  → mutating steps emit mutationRefs (persisted on attempt)
  → retry / resume

Step kinds include: memory-pull, map-normalize, validate, identity-dedupe, write-record, relationship-discover, relationship-write, compose, enrich, analyze, decide, workflow, …

Quick example

import { createPipelineRuntime, validatePipelineDefinition } from "@x12i/memorix-pipeline/v2";

validatePipelineDefinition(definition);
const rt = createPipelineRuntime({
  orgId,
  ledger,
  ports: createLivePortRegistry({ /* data, memory, relationships, mappings */ }),
});
const run = await rt.start({ agentIds, pipelineId, definition, input });
const attempts = await rt.getStepAttempts(run.runId);

HTTP

Route	Role
GET /api/pipelines/definitions	From effective metadata
POST /api/pipelines/start	Start a run
GET /api/pipelines/runs/:runId	Run + attempts
POST .../retry-step · .../resume	Recovery

Related

Package	Role
@x12i/memorix-pipeline-runtime	Artifacts / claims / DLQ helpers
@x12i/memorix-data-journey	Reconstructs the data cone from attempts + mutationRefs
@x12i/memorix-mapping	map-normalize execution

Docs

• Package docs under docs/
• docs/mutation-refs-capture.md
• Ebook: Building Pipelines
• Hub: https://ebooks.memorix.x12i.com

npm test