Autoregressive Language Model
Model AIO:AutoregressiveLanguageModel NOT_REVIEWED
A language model that generates text sequentially predicting one token at a time based on the previously generated tokens excelling at natural language generation tasks by modeling the probability distribution over sequences of tokens.
Ontology IRI:
https://w3id.org/aio/AutoregressiveLanguageModel
Ontology Structure & Relationships
Parent Classes
Branches
Annotations & Sources
Synonyms:
- generative language model related
- sequence-to-sequence model related
Subsets:
https://w3id.org/aio/ModelSubset
Curated AIMech Concepts Grounded to this Class
6 Concepts| Curated Concept | Kind | Mapping Relation | Rationale |
|---|---|---|---|
Factored restricted Boltzmann machine language model
AIMech:FactoredRestrictedBoltzmannMachineLanguageModel |
Architectures | broad_match | The primary construction predicts the next word from preceding words, defining sequential word conditionals. The pinned AIO target is broader than this shared low-rank, context-conditioned latent-word architecture. This mapping uses sequential-probability scope, not an empirical generation-quality claim. FactoredLanguageModel denotes explicit linguistic factors, not factorized neural weight matrices; ImplicitLanguageModel and EnergyBasedLLM describe non-autoregressive sequence energies rather than these next-word conditionals. |
Hierarchical log-bilinear language model
AIMech:HierarchicalLogBilinearLanguageModel |
Architectures | broad_match | The source specifies next-word conditionals given preceding words, defining a sequential language model with a finite context. The AIO target is broader than this linear-context and tree-node architecture. The mapping uses its sequential-probability scope, not its qualitative assertion about excelling at generation. HierarchicalLanguageModel denotes multilevel representations and is not an exact identity for a vocabulary-tree construction; OutputLayer, SoftmaxLayer and EmbeddingLayer are components rather than whole-model superclasses. |
Hierarchical probabilistic neural network language model
AIMech:HierarchicalProbabilisticNeuralNetworkLanguageModel |
Architectures | broad_match | The source specifies next-word conditionals given preceding words, defining a sequential language model with a finite context. The AIO target is broader than this shared nonlinear node-conditioned architecture. The mapping uses its sequential-probability scope, not its qualitative assertion about excelling at generation. HierarchicalLanguageModel denotes multilevel representations and is not an exact identity for a vocabulary-tree construction; OutputLayer, SoftmaxLayer and EmbeddingLayer are components rather than whole-model superclasses. |
Log-bilinear language model
AIMech:LogBilinearLanguageModel |
Architectures | broad_match | The source specifies next-word conditionals given preceding words, defining a sequential language model with a finite context. The AIO target is broader than this position-specific bilinear context and flat vocabulary-output architecture. The mapping uses its sequential-probability scope, not its qualitative assertion about excelling at generation. HierarchicalLanguageModel denotes multilevel representations and is not an exact identity for a vocabulary-tree construction; OutputLayer, SoftmaxLayer and EmbeddingLayer are components rather than whole-model superclasses. |
Neural probabilistic language model
AIMech:NeuralProbabilisticLanguageModel |
Architectures | broad_match | The primary construction predicts the next word from preceding words, defining sequential word conditionals. The pinned AIO target is broader than this jointly learned embedding and nonlinear flat-output architecture. This mapping uses sequential-probability scope, not an empirical generation-quality claim. FactoredLanguageModel denotes explicit linguistic factors, not factorized neural weight matrices; ImplicitLanguageModel and EnergyBasedLLM describe non-autoregressive sequence energies rather than these next-word conditionals. |
Temporal factored restricted Boltzmann machine language model
AIMech:TemporalFactoredRestrictedBoltzmannMachineLanguageModel |
Architectures | broad_match | The primary construction predicts the next word from preceding words, defining sequential word conditionals. The pinned AIO target is broader than this temporally linked factored latent-word architecture. This mapping uses sequential-probability scope, not an empirical generation-quality claim. FactoredLanguageModel denotes explicit linguistic factors, not factorized neural weight matrices; ImplicitLanguageModel and EnergyBasedLLM describe non-autoregressive sequence energies rather than these next-word conditionals. |
Import Provenance & Upstream Synchronization
Source Repo: AIO GitHub
Release Version:
aio.jsonCommit:
397851c547…License: CC-BY-4.0
Imported At: 2026-10-10T07:34:10Z
SHA256:
8f741d71408c…
Source File:
data/aio/AutoregressiveLanguageModel.yaml