Online Learning Compilers

Online Learning Compilers#

Follow one compiler workflow from a minimal recurrent model to a stacked one. The walkthrough keeps report and graph inspection beside the model that produced them, then compares the two compiled structures directly.

Compile and inspect#

RNN Compiler Walkthrough

Compile single-layer and two-layer RNNs in one page, inspect their hidden groups and ETP relations, and compare the compiler decisions.

RNN Compiler Walkthrough

Diagnostic workflow#

  1. Define the recurrent model and compile it with a representative input.

  2. Read learner.report for included, excluded, and diagnostic decisions.

  3. Inspect learner.graph to verify each parameter-primitive-hidden relation behind the report.

  4. Compare the single-layer and two-layer results before generalizing an expected grouping rule.

  5. Resolve structural diagnostics before evaluating learning behavior.

Important

Graphs and reports establish what the compiler selected. They do not, by themselves, demonstrate that an approximate learning rule matches BPTT or produces a valid descent direction.