Skip to main content

Physical AI Workflow Guide

Use this guide to build a Physical AI workflow with FactVerse AI Agent, digital twin scenes, simulation-ready asset packages, and simulation services. The workflow helps engineering teams prepare scenes, run approved simulation or rendering tasks, review assumptions, and reuse validated results for process planning, robot training, and virtual operation checks.

Prerequisites

RequirementDetails
Scene contextDesigner scene, factory or process layout, equipment placement, asset metadata, and version history.
Simulation-ready assetsGeometry, material, collision, motion, articulation, and behavior metadata required by the target simulation workflow.
Operational contextProduction constraints, operating envelope, safety zones, task sequence, source data, and real-world observations.
Simulation runtimeEnabled FactVerse simulation services, SimRunner, Omniverse, PhysX, Newton, Isaac, or other approved simulation and rendering services for the project environment.
Validation ownerEngineering owner who can accept assumptions, compare simulation output with field evidence, and approve reuse.

Endpoint and scopes

Use the current base and module endpoints for Physical AI workflows. The base endpoint provides shared scene, asset, compute, and action-draft access; module endpoints add operational signals that constrain the scenario.

EndpointScopeUse
/mcp/base/base.readRead scene records, asset metadata, documents, validation notes, and operational context.
/mcp/base/base.compute.runRun approved analysis, simulation preparation, or result summarization tasks.
Module endpointsModule read scopesBring in domain data such as facility operations, predictive maintenance, or industry-specific signals when enabled.
/mcp/base/base.action.writeStore approved scenario records, review notes, or task drafts after human approval.

Workflow steps

  1. Define the physical task: layout review, process planning, robot training context, packaging flow, or virtual operation check.
  2. Prepare the scene: confirm scene version, model asset IDs, model asset version IDs, component geometry, coordinate system, geometry scale, and equipment placement.
  3. Check asset readiness: verify collision shapes, materials, articulations, constraints, motion ranges, and required metadata.
  4. Bind operational data: attach process limits, task sequence, safety zones, historical observations, source data, and validation references.
  5. Run approved compute: use the enabled FactVerse simulation, SimRunner, or project runtime to generate trajectories, interactions, measurements, KPIs, or scene outputs.
  6. Review assumptions: record model simplifications, expected error range, missing parameters, and differences from field behavior.
  7. Reuse validated context: export approved results to engineering review, robot training, process planning, or downstream applications.

Product surfaces

SurfaceUse in a Physical AI workflow
Physical AI moduleCode-backed reference for model assets, BIM replay, layout optimization, simulation engines, SimRunner, and runtime handoff.
DFS mappingsMap units, ranges, topology, physics classification, source IDs, and operating constraints.
DFS Pro datasetsPrepare governed scenario input data and reusable records for review.
Workflow run recordStore scenario ID, assumptions, output references, validation notes, and reuse target.

DFS setup for operational constraints

Physical AI workflows often need current operating constraints, process limits, environment readings, and historical observations alongside the Designer scene.

Data needDFS workflow
Source signals and process dataDFS Lite Connectors
Units, ranges, topology, and physics classificationMapping Fields
Governed scenario input dataDFS Pro Datasets
Repeatable data preparationGovernance Studio
Agent-readable scenario evidenceCreate an AI Agent-Ready Dataset

For tool selection, endpoint groups, and recommended Agent sequences, see Physical AI Tools.

SectionContent
Scenario packageScene version, asset versions, task goal, operating assumptions, and simulation backend.
Asset readinessAssets ready for simulation, assets needing repair, and missing metadata.
Simulation resultMeasurements, interactions, constraints, generated trajectories, or rendered scene output.
Validation notesField comparison, accepted assumptions, limitations, and required follow-up tests.
Reuse pathEngineering review, robot training dataset, process planning package, or application handoff.

Engineering guidance

  • Keep simulation assumptions visible to reviewers and downstream users.
  • Compare generated results with field observations before expanding usage.
  • Use faster physics and rendering iteration to explore options, then reserve high-fidelity validation for the cases that need it.
  • Treat robot-training outputs as versioned engineering assets with scenario ID, source scene, asset versions, and validation notes.
  • Record corrections from field tests so the scene, asset metadata, and workflow prompts improve over time.

Common failure modes

SymptomLikely causeResponse
Simulation behaves unrealisticallyMissing collision, mass, articulation, friction, or constraint dataReturn an asset-readiness repair list before running further analysis.
Robot-training context transfers poorlyScenario assumptions differ from field conditionsCapture the gap, update the scene or asset metadata, and rerun the scenario.
Result reuse is blockedScene version, asset version, or backend parameters are missingRequire a scenario package before accepting the result.
Compute action is blockedScope or approval policy is missingKeep the request as a review task until the project owner approves execution.

Validation checklist

  • The workflow references scene version, asset version, and simulation backend.
  • Each compute result includes assumptions, limitations, and source references.
  • Asset-readiness issues are reported before the workflow treats a result as reusable.
  • Approved results are versioned for engineering review, robot training, or process-planning reuse.