284313f908
Some checks are pending
Bidi Control Character Guard / bidi-control-guard (push) Waiting to run
Circular Dependency Check / Check for new circular dependencies (push) Waiting to run
Citus Migration Smoke / Combined migrations on single-node Citus (push) Waiting to run
E2E Fresh Install Tests / fresh-install-e2e (push) Waiting to run
ext-v2 guardrails / Run ext-v2 guard and ESLint (push) Waiting to run
Integration Tests / Check for relevant changes (push) Waiting to run
Integration Tests / ${{ (github.event_name == 'schedule' || github.event.inputs.suite == 'full') && 'Full integration suite' || 'Tier-1 integration subset' }} (push) Blocked by required conditions
Mobile checks / Mobile lint + typecheck (push) Waiting to run
Mobile checks / Mobile unit tests (push) Waiting to run
Mobile checks / Mobile dependency audit (report) (push) Waiting to run
Mobile checks / Mobile reproducibility checks (push) Waiting to run
Secrets guard (env backups) / Ensure no tracked env backup files (push) Waiting to run
Temporal Readiness / fast-readiness (push) Waiting to run
Temporal Readiness / docker-parity (push) Waiting to run
TypeScript Type Check / Nx affected typecheck (push) Waiting to run
Unit Tests / Skipped-test budget (push) Waiting to run
Unit Tests / Nx affected unit tests (push) Waiting to run
Unit Tests / Server unit coverage (informational) (push) Waiting to run
Validate Tenant Management Schema / Check for relevant changes (push) Waiting to run
Validate Tenant Management Schema / Validate Tenant Management Schema (push) Blocked by required conditions
EE Workflows Build Guard / ee-workflows-build-guard (push) Waiting to run
Excluded: .git, node_modules, secrets/, compose.env, assemblyscript tgz Source: /opt/alga-psa on psa.joliet.tech
75 lines
8.9 KiB
Markdown
75 lines
8.9 KiB
Markdown
# Scratchpad — Workflow AI Inference Step
|
|
|
|
- Plan slug: `workflow-ai-inference-step`
|
|
- Created: `2026-03-14`
|
|
|
|
## What This Is
|
|
|
|
Keep a lightweight, continuously-updated log of discoveries and decisions made while implementing this plan.
|
|
|
|
Prefer short bullets. Append new entries as you learn things, and also update earlier notes when a decision changes.
|
|
|
|
## Decisions
|
|
|
|
- (2026-03-14) Model AI inference as a new grouped `action.call` action rather than a brand-new workflow node type. This reuses palette insertion, save-as handling, runtime execution, and most designer plumbing.
|
|
- (2026-03-14) Store AI output schemas inline per step instead of through schema refs in v1.
|
|
- (2026-03-14) Default schema authoring to a simple builder rooted at `type: object`, with advanced raw JSON Schema as an escape hatch.
|
|
- (2026-03-14) V1 simple mode only supports a constrained JSON Schema subset: primitive fields, nested objects, arrays of primitives, arrays of objects, required flags, and descriptions.
|
|
- (2026-03-14) V1 uses the existing app-level OpenAI-compatible provider resolution and does not add per-step provider or model selection.
|
|
- (2026-03-14) Preserve advanced-mode raw JSON text separately as `aiOutputSchemaText` so advanced-only schemas round-trip without lossy reformatting, while still caching parsed JSON in `aiOutputSchema` when valid.
|
|
- (2026-03-14) Reuse the normal `action.call` Zod passthrough object output contract for runtime storage safety and let the inference service own strict inline-schema validation.
|
|
- (2026-03-14) Factor publish-time output typing through a shared `resolveActionCallOutputSchema` helper so AI steps use inline schemas and non-AI steps continue using registry output schemas.
|
|
|
|
## Discoveries / Constraints
|
|
|
|
- (2026-03-14) Workflow Designer already centers grouped business and transform steps on `action.call`; grouped tiles are catalog-driven from `shared/workflow/runtime/designer/actionCatalog.ts`.
|
|
- (2026-03-14) Downstream `vars.<saveAs>` typing in the designer currently comes from action-registry output schemas, with transform actions as the existing precedent for per-step dynamic output-schema inference in `ee/server/src/components/workflow-designer/workflowDataContext.ts`.
|
|
- (2026-03-14) Publish-time best-effort typing in `ee/packages/workflows/src/actions/workflow-runtime-v2-actions.ts` also assumes registry-level static output schemas, so AI support needs an override seam there as well.
|
|
- (2026-03-14) Runtime `action.call` already validates both action input and action output via Zod in `shared/workflow/runtime/runtime/workflowRuntimeV2.ts`.
|
|
- (2026-03-14) Current server-side AI infrastructure has provider resolution in `ee/server/src/services/chatProviderResolver.ts`, but no reusable structured-output inference service yet.
|
|
- (2026-03-14) Existing chat services use OpenAI-compatible chat completions, but not JSON-schema structured-output helpers yet.
|
|
- (2026-03-14) Workflow bundle dependency logic is action/node oriented; inline AI schemas should avoid introducing new schema-ref dependencies if kept fully inline.
|
|
- (2026-03-14) `action.call` needed a `stepConfig` handoff from node execution into action handlers so `ai.infer` can read inline schema config at runtime without introducing a new node type.
|
|
- (2026-03-14) The cleanest reusable server-side inference seam lives in `packages/ee/src/services/workflowInferenceService.ts`, with `ee/server/src/services/workflowInferenceService.ts` as a thin re-export for server imports.
|
|
- (2026-03-14) Bundle import/export already preserves arbitrary step config verbatim; AI bundle work only needed tests plus a guard that dependency summaries do not treat inline AI schemas as schema refs.
|
|
- (2026-03-14) Server integration suites in this repo are noisy and some broader publish tests already fail for unrelated reasons, so AI verification is more reliable when run as focused `vitest -t ... --coverage.enabled=false` slices.
|
|
|
|
## Commands / Runbooks
|
|
|
|
- (2026-03-14) Inventory workflow designer/runtime seams:
|
|
- `rg -n "action.call|outputSchema|saveAs|designer-catalog|workflowDataContext" ee/server/src/components/workflow-designer ee/packages/workflows/src/actions shared/workflow/runtime`
|
|
- (2026-03-14) Inventory current AI provider infrastructure:
|
|
- `rg -n "chatProviderResolver|chat.completions.create|response_format|json_schema" ee/server/src/services ee/server/src/models`
|
|
- (2026-03-14) Focused shared/runtime verification:
|
|
- `npx vitest run --config shared/vitest.config.ts shared/workflow/runtime/actions/__tests__/actionOutputSchemaResolver.test.ts shared/workflow/runtime/actions/__tests__/registerAiActions.test.ts shared/workflow/runtime/ai/__tests__/aiSchema.test.ts packages/ee/src/services/__tests__/workflowInferenceService.test.ts`
|
|
- (2026-03-14) Focused designer verification:
|
|
- `cd ee/server && npx vitest run --config vitest.config.ts src/components/workflow-designer/__tests__/WorkflowActionInputSection.test.tsx src/components/workflow-designer/__tests__/WorkflowAiSchemaSection.test.tsx src/components/workflow-designer/__tests__/workflowReferenceOptions.test.ts src/components/workflow-designer/__tests__/workflowReferenceContext.test.ts src/components/workflow-designer/__tests__/workflowAiStepUtils.test.ts src/components/workflow-designer/__tests__/workflowDataContext.test.ts src/components/workflow-designer/__tests__/ActionSchemaReference.test.tsx src/components/workflow-designer/__tests__/groupedActionStep.test.ts`
|
|
- (2026-03-14) Focused server verification:
|
|
- `cd server && npx vitest run --config vitest.config.ts --coverage.enabled=false src/test/unit/workflowRuntimeV2.unit.test.ts -t 'T027|T028|T029'`
|
|
- `cd server && npx vitest run --config vitest.config.ts --coverage.enabled=false src/test/integration/workflowRuntimeV2.publish.integration.test.ts -t 'T041|T042'`
|
|
- `cd server && npx vitest run --config vitest.config.ts --coverage.enabled=false src/test/integration/workflowDesignerGroupedPersistence.integration.test.ts -t 'T008/T020/T031'`
|
|
- `cd server && npx vitest run --config vitest.config.ts --coverage.enabled=false src/test/integration/workflowBundleV1.importExport.integration.test.ts -t 'T032/T033/T045'`
|
|
|
|
## Links / References
|
|
|
|
- Designer entrypoint: [WorkflowDesigner.tsx](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/server/src/components/workflow-designer/WorkflowDesigner.tsx)
|
|
- Designer data context: [workflowDataContext.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/server/src/components/workflow-designer/workflowDataContext.ts)
|
|
- Grouped step helper: [groupedActionStep.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/server/src/components/workflow-designer/groupedActionStep.ts)
|
|
- Action registry: [actionRegistry.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/shared/workflow/runtime/registries/actionRegistry.ts)
|
|
- Runtime init: [init.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/shared/workflow/runtime/init.ts)
|
|
- Runtime execution: [workflowRuntimeV2.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/shared/workflow/runtime/runtime/workflowRuntimeV2.ts)
|
|
- Publish / registry server actions: [workflow-runtime-v2-actions.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/packages/workflows/src/actions/workflow-runtime-v2-actions.ts)
|
|
- Provider resolver: [chatProviderResolver.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/server/src/services/chatProviderResolver.ts)
|
|
- AI schema helpers: [aiSchema.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/shared/workflow/runtime/ai/aiSchema.ts)
|
|
- AI action registration: [registerAiActions.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/shared/workflow/runtime/actions/registerAiActions.ts)
|
|
- Publish-time output typing helper: [actionOutputSchemaResolver.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/shared/workflow/runtime/actions/actionOutputSchemaResolver.ts)
|
|
- Inference service: [workflowInferenceService.ts](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/packages/ee/src/services/workflowInferenceService.ts)
|
|
- AI schema panel: [WorkflowAiSchemaSection.tsx](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/server/src/components/workflow-designer/WorkflowAiSchemaSection.tsx)
|
|
- Recent analogous workflow-designer plan: [PRD.md](/Users/roberisaacs/alga-psa.worktrees/feature/ai-support-workflow-steps/ee/docs/plans/2026-03-13-workflow-designer-grouped-palette-inline-inputs-transform-actions/PRD.md)
|
|
|
|
## Open Questions
|
|
|
|
- How much of advanced JSON Schema should be accepted for v1 when provider behavior differs between OpenRouter and Vertex?
|
|
- Should advanced mode preserve raw JSON text formatting, or is parsed-and-normalized JSON acceptable?
|
|
- Should the AI action eventually expose optional system instructions or sampling controls in a follow-up?
|