Get started
Start with Mathematical Foundations
Vectors & Geometry
Back to modulesModule 17 · 0/38
Module 17
Frontier & Specialized Topics
0/381361
Submodule 01Representation Learning, Advanced Theory & Miscellaneous0/38
- 1Contrastive Loss (InfoNCE / SimCLR-style)conceptMed.
- 2Knowledge Distillation LossconceptMed.
- 3Create Composite Hypervector for a Dataset RowMed.
- 4Kanerva Coding for High-Dimensional SpacesconceptHard
- 5Graph Convolution Network (GCN) LayerconceptMed.
- 6Mean Ablation for Circuit DiscoveryconceptMed.
- 7Thanksgiving Feast Predictor: Softmax for Dish SelectionconceptEasy
- 8Baird's Counterexample: Off-Policy TD DivergenceconceptMed.
- 9Instability in the Deadly TriadconceptMed.
- 10Emphatic Temporal Difference Learning for Off-Policy EvaluationconceptMed.
- 11Gradient Temporal Difference (GTD2) for Off-Policy Value PredictionconceptMed.
- 12General Value FunctionsconceptMed.
- 13Parallel Value Functions (Horde)conceptMed.
- 14Successor Representation LearningconceptMed.
- 15State Aggregation for Value ApproximationconceptMed.
- 16Fourier Basis Features for Value Function ApproximationconceptMed.
- 17Tile Coding ImplementationconceptMed.
- 18Hash Function for Tile CodingconceptMed.
- 19Hashing for Memory-Efficient Tile CodingconceptMed.
- 20Tiling Offset Strategy ComparisonconceptMed.
- 21Step-Size Selection for Tile CodingconceptMed.
- 22RBF Center Placement StrategiesconceptMed.
- 23Feature Selection for RL Value Function ApproximationconceptMed.
- 24Value Generalization Pattern AnalysisconceptMed.
- 25Types of Eligibility TracesconceptMed.
- 26Action-Conditional Trace ClearingconceptMed.
- 27Error-Dependent Multiple Weight UpdatesconceptMed.
- 28Bootstrap Parameter Lambda StudyconceptMed.
- 29TD(λ) Asymptotic Error Bound VerificationconceptMed.
- 30TD(λ) Convergence VerificationconceptMed.
- 31The Pattern Weaver's CodeconceptMed.
- 32Directional Stripe TilingsconceptMed.
- 33Rote Learning for Game StatesconceptMed.
- 34Full vs Sample Backup ComparisonconceptMed.
- 35Expected vs Sample Updates ComparisonconceptMed.
- 36Branching Factor Impact on Sample BackupsconceptMed.
- 37On-Policy Trajectory SamplingconceptMed.
- 38Optimistic Initialization for ExplorationconceptMed.