Home / AIO Classes / Models

Models

76 Classes

Concrete model architectures and family designations cataloged in AIO.

Showing 76 of 76

Concept	Origin	Kind / Branch	Identifier	Evidence / Status
Autoregressive Conditional Heteroskedasticity aka ARCH A model that describes the variance of the current error term as a function of the previous periods' error terms, capturing volatility clust…	AIO	Model	`AIO:AutoregressiveConditionalHeteroskedasticity`	Imported
Autoregressive Distributed Lag aka ARDL A model that includes lagged values of both the dependent variable and one or more independent variables, capturing dynamic relationships ov…	AIO	Model	`AIO:AutoregressiveDistributedLag`	Imported
Autoregressive Integrated Moving Average aka ARIMA A model which combines autoregression (AR), differencing (I), and moving average (MA) components. Used for analyzing and forecasting time se…	AIO	Model	`AIO:AutoregressiveIntegratedMovingAverage`	Imported
Autoregressive Language Model aka generative language model, sequence-to-sequence model A language model that generates text sequentially predicting one token at a time based on the previously generated tokens excelling at natur…	AIO	Model	`AIO:AutoregressiveLanguageModel`	Imported
Autoregressive Moving Average aka ARMA A model that combines autoregressive (AR) and moving average (MA) components to represent time series data, suitable for stationary series w…	AIO	Model	`AIO:AutoregressiveMovingAverage`	Imported
Bidirectional Transformer Language Model aka BERT, Bidirectional Transformer LM A transformer language model such as BERT that uses the transformer architecture to build deep bidirectional representations by predicting m…	AIO	Model	`AIO:BidirectionalTransformerLanguageModel`	Imported
Causal LLM aka Causal Large Language Model, autoregressive… A large language model that only attends to previous tokens in the sequence when generating text modeling the probability distribution autor…	AIO	Model	`AIO:CausalLLM`	Imported
Compositional Generalization LLM aka Compositional Generalization Large Language Model, out-of-distribution generalization… A large language model that is trained to understand and recombine the underlying compositional structures in language enabling better gener…	AIO	Model	`AIO:CompositionalGeneralizationLLM`	Imported
Continual Learning LLM aka CL-Large Language Model, Continual Learning Large Language Model… A large language model that continually acquires new knowledge and skills over time without forgetting previously learned information allowi…	AIO	Model	`AIO:ContinualLearningLLM`	Imported
Contrastive Learning LLM aka Representation learning A large language model that is trained to pull semantically similar samples closer together and push dissimilar samples apart in the represe…	AIO	Model	`AIO:ContrastiveLearningLLM`	Imported
Controllable LLM aka Controllable Large Language Model, conditional generation… A large language model that allows for explicit control over certain attributes of the generated text such as style tone topic or other desi…	AIO	Model	`AIO:ControllableLLM`	Imported
Cross-Domain LLM aka Domain-General LLM, cross-domain transfer… A large language model that performs well across a wide range of domains without significant loss in performance, facilitated by advanced do…	AIO	Model	`AIO:CrossDomainLLM`	Imported
Curriculum Learning LLM aka Learning progression A large language model that is trained by presenting learning examples in a meaningful order from simple to complex mimicking the learning t…	AIO	Model	`AIO:CurriculumLearningLLM`	Imported
Data-to-Text LLM aka Meaning representation A large language model that generates natural language descriptions from structured data sources like tables, graphs, and knowledge bases, r…	AIO	Model	`AIO:DatatoTextLLM`	Imported
Decoder LLM A large language model that uses a decoder-only architecture consisting of only a decoder trained to predict the next token in a sequence gi…	AIO	Model	`AIO:DecoderLLM`	Imported
Dialogue LLM aka Dialogue Large Language Model, conversational AI… A large language model that is optimized for engaging in multi-turn conversations understanding context and generating relevant coherent res…	AIO	Model	`AIO:DialogueLLM`	Imported
Differentiable LLM aka Differentiable Large Language Model, end-to-end training… A large language model that has an architecture amenable to full end-to-end training via backpropagation without relying on teacher forcing…	AIO	Model	`AIO:DifferentiableLLM`	Imported
Domain-Adapted LLM aka Domain-Adapted Large Language Model, domain robustness… A large language model which is pre-trained on a broad corpus and then fine-tuned on domain-specific data to specialize its capabilities for…	AIO	Model	`AIO:DomainAdaptedLLM`	Imported
Dynamic Conditional Correlation aka DCC A model that allows for time-varying correlations between different time series, used in financial econometrics to model and forecast covari…	AIO	Model	`AIO:DynamicConditionalCorrelation`	Imported
Embodied LLM aka Embodied Large Language Model, multimodal grounding A large language model that integrates language with other modalities like vision audio and robotics to enable grounded language understandi…	AIO	Model	`AIO:EmbodiedLLM`	Imported
Encoder LLM A large language model that uses an encoder-only architecture to encode the input sequence into a fixed-length representation which is then…	AIO	Model	`AIO:EncoderLLM`	Imported
Encoder-Decoder LLM A large language model introduced in the "Attention Is All You Need" paper. The encoder processes the input sequence to generate a hidden re…	AIO	Model	`AIO:EncoderDecoderLLM`	Imported
Energy-Based LLM aka Energy-Based Large Language Model, energy scoring… A large language model which models the explicit probability density over token sequences using an energy function, rather than an autoregre…	AIO	Model	`AIO:EnergyBasedLLM`	Imported
Ethical LLM aka Ethical Large Language Model, constituitional AI… A large language model that is trained to uphold certain ethical principles values or rules in its language generation to increase safety an…	AIO	Model	`AIO:EthicalLLM`	Imported
Evolutionary LLM aka Evolutionary Language Model, evolutionary algorithms… A large language model that applies principles of evolutionary computation to optimize its structure and parameters evolving over time to im…	AIO	Model	`AIO:EvolutionaryLLM`	Imported
Explainable LLM aka Explainable Language Model, XAI LLM… A large language model that is designed to provide insights into its decision-making process making it easier for users to understand and tr…	AIO	Model	`AIO:ExplainableLLM`	Imported
Exponential Smoothing State Space Model aka ETS A model that combines exponential smoothing with state space modeling, allowing for the inclusion of both trend and seasonal components. Use…	AIO	Model	`AIO:ExponentialSmoothingStateSpaceModel`	Imported
Factored Language Model aka Factorized Language Model A language model that views each word as a vector of multiple factors such as part-of-speech morphology and semantics to improve language mo…	AIO	Model	`AIO:FactoredLanguageModel`	Imported
Factorized LLM aka Factorized Large Language Model, Factorized Learning Assisted with Large Language Model… A large language model that decomposes the full language modeling task into multiple sub-components or experts that each focus on a subset o…	AIO	Model	`AIO:FactorizedLLM`	Imported
Federated LLM aka Federated Large Language Model, decentralized training… A large language model that is trained in a decentralized manner across multiple devices or silos without directly sharing private data enab…	AIO	Model	`AIO:FederatedLLM`	Imported
Generalized Autoregressive Conditional Heteroskedasticity aka GARCH A model that incorporates lagged conditional variances, allowing for more flexibility in modeling time-varying volatility.	AIO	Model	`AIO:GeneralizedAutoregressiveConditionalHeteroskedasticity`	Imported
Generative Adversarial Network-Augmented LLM aka GAN-Large Language Model, Generative Adversarial Network-Augmented Large Language Model… A large language model which incorporates a generative adversarial network (GAN) into its training process, using a discriminator network to…	AIO	Model	`AIO:GenerativeAdversarialNetworkAugmentedLLM`	Imported
Generative Commonsense LLM aka Generative Commonsense Large Language Model, World Model… A large language model that is trained to understand and model basic physics causality and common sense about how the real world works.	AIO	Model	`AIO:GenerativeCommonsenseLLM`	Imported
Generative Language Interface aka Interactive generation A language model that enables users to engage in an interactive dialogue with an LLM providing feedback to guide and refine the generated ou…	AIO	Model	`AIO:GenerativeLanguageInterface`	Imported
Graph Language Model aka Graph LM, Structured representations A language model that operates over structured inputs or outputs represented as graphs enabling reasoning over explicit relational knowledge…	AIO	Model	`AIO:GraphLanguageModel`	Imported
Hierarchical Language Model aka Hierarchical LM, multi-scale representations A language model that represents language at multiple levels of granularity learning hierarchical representations that capture both low-leve…	AIO	Model	`AIO:HierarchicalLanguageModel`	Imported
Implicit Language Model aka Implicit LM, Energy-based models… A language model that uses an energy function to score entire sequences instead of factorizing probabilities autoregressively better capturi…	AIO	Model	`AIO:ImplicitLanguageModel`	Imported
Instruction-Tuned LLM aka Instruction-Tuned Large Language Model, constitutional AI… A large language model which is fine-tuned to follow natural language instructions accurately and safely, learning to map from instructions…	AIO	Model	`AIO:InstructionTunedLLM`	Imported
Knowledge-Grounded LLM aka Knowledge-Grounded Large Language Model, factual grounding… A large language model which incorporates external knowledge sources or knowledge bases into the model architecture, enabling it to generate…	AIO	Model	`AIO:KnowledgeGroundedLLM`	Imported
Language Interface LLM aka Interactive learning A large language model that supports interactive semantic parsing enabling users to provide feedback and corrections to dynamically refine a…	AIO	Model	`AIO:LanguageInterfaceLLM`	Imported
Language Model A model designed to predict the next word in a sequence or assign probabilities to sequences of words in natural language.	AIO	Model	`AIO:LanguageModel`	Imported
Large Language Model aka LLM A language model consisting of a neural network with many parameters (typically billions of weights or more) trained on large quantities of…	AIO	Model	`AIO:LargeLanguageModel`	Imported
Lifelong Learning LLM aka Continual Learning LLM, Forever Learning… A large language model that continually acquires new knowledge over time without forgetting previously learned information maintaining a bal…	AIO	Model	`AIO:LifelongLearningLLM`	Imported
Low-Resource LLM aka Low-Resource Language Model, low-resource languages… A large language model which is optimized for performance in scenarios with limited data, computational resources, or for languages with spa…	AIO	Model	`AIO:LowResourceLLM`	Imported
Masked Language Model aka bidirectional encoder, denoising autoencoder A language model that is trained to predict randomly masked tokens in a sequence based on the remaining unmasked tokens allowing it to build…	AIO	Model	`AIO:MaskedLanguageModel`	Imported
Memory-Augmented LLM aka Memory-Augmented Large Language Model, external memory A large language model which incorporates external writable and readable memory components, allowing it to store and retrieve information ov…	AIO	Model	`AIO:MemoryAugmentedLLM`	Imported
Meta-Learning LLM aka Meta-Learning Large Language Model, few-shot adaptation… A large language model which is trained in a way that allows it to quickly adapt to new tasks or datasets through only a few examples or fin…	AIO	Model	`AIO:MetaLearningLLM`	Imported
Mixture-of-Experts LLM aka Mixture-of-Experts Large Language Model, MoE Large Language Model… A large language model which dynamically selects and combines outputs from multiple expert submodels, allowing for efficient scaling by cond…	AIO	Model	`AIO:MixtureofExpertsLLM`	Imported
Model An abstract representation of a complex system generally assembled as a set of logical mathematical or conceptual properties to simulate or…	AIO	Model	`AIO:Model`	Imported
Modular Language Model aka Modular LM A language model that consists of multiple specialized components or skills that can be dynamically composed and recombined to solve complex…	AIO	Model	`AIO:ModularLanguageModel`	Imported
Modular LLM aka Modular Large Language Model, component skills… A modular language model that consists of multiple specialized components or skills that can be dynamically composed and recombined to solve…	AIO	Model	`AIO:ModularLLM`	Imported
Multi-Task LLM aka Multi-Task Large Language Model, transfer learning A large language model which is trained jointly on multiple language tasks simultaneously, learning shared representations that transfer acr…	AIO	Model	`AIO:MultiTaskLLM`	Imported
Multilingual LLM aka Multilingual Large Language Model, cross-lingual transfer A large language model that is trained on text from multiple languages learning shared representations that enable zero-shot or few-shot tra…	AIO	Model	`AIO:MultilingualLLM`	Imported
Multimodal Fusion LLM aka cross-modal grounding A large language model that learns joint representations across different modalities like text vision and audio in an end-to-end fashion for…	AIO	Model	`AIO:MultimodalFusionLLM`	Imported
Multimodal Language Model aka Mulimodal LM A language model that learns joint representations across different modalities like text vision and audio in an end-to-end fashion for bette…	AIO	Model	`AIO:MultimodalLanguageModel`	Imported
Multimodal LLM aka Multimodal Large Language Model, cross-modal grounding A multimodal large language model that learns joint representations across different modalities like text vision and audio in an end-to-end…	AIO	Model	`AIO:MultimodalLLM`	Imported
Multimodal Prompt-based Language Model A multimodal large language model which processes prompts that include multiple modalities, such as both text and images, to generate releva…	AIO	Model	`AIO:MultimodalPromptbasedLanguageModel`	Imported
Neuro-Symbolic LLM aka Neuro-Symbolic Large Language Model, knowledge reasoning… A large language model which combines neural language modeling with symbolic reasoning components, leveraging structured knowledge represent…	AIO	Model	`AIO:NeuroSymbolicLLM`	Imported
Ordinal LLM aka Ordinal Large Language Model, preference modeling… A large language model that is trained to model ordinal relationships and rank outputs rather than model probability distributions over text…	AIO	Model	`AIO:OrdinalLLM`	Imported
Personalized LLM aka Personalized Large Language Model, user adaptation LLM A large language model that adapts its language modeling and generation to the preferences style and persona of individual users or audience…	AIO	Model	`AIO:PersonalizedLLM`	Imported
Prompt-based Fine-Tuning LLM aka Prompt-based Fine-Tuning Large Language Model, Prompt-tuned Large Language Model… A large language model which is fine-tuned on a small number of examples or prompts, rather than full task datasets. This allows for rapid a…	AIO	Model	`AIO:PromptbasedFineTuningLLM`	Imported
Reasoning LLM aka Rational Large Language Model, Reasoning Large Language Model… A large language model that incorporates explicit reasoning capabilities leveraging logical rules axioms or external knowledge to make deduc…	AIO	Model	`AIO:ReasoningLLM`	Imported
Recursive LLM aka Recursive Large Language Model, Self-Attending Large Language Model… A language model that uses recursive neural network architectures like TreeLSTMs to learn syntactic composition functions improving systemat…	AIO	Model	`AIO:RecursiveLLM`	Imported
Reinforcement Learning LLM aka RL-Large Language Model, Reinforcement Learning Large Language Model… A large language model that is fine-tuned using reinforcement learning where the model receives rewards for generating text that satisfies c…	AIO	Model	`AIO:ReinforcementLearningLLM`	Imported
Retrieval-Augmented LLM aka Retrieval-Augmented Large Language Model, knowledge grounding… A large language model which combines a pre-trained language model with a retrieval system that can access external knowledge sources. This…	AIO	Model	`AIO:RetrievalAugmentedLLM`	Imported
Seasonal Autoregressive Integrated Moving-Average aka SARIMA A model that extends ARIMA, explicitly supporting univariate time series data with a seasonal component, combining seasonal differencing wit…	AIO	Model	`AIO:SeasonalAutoregressiveIntegratedMovingAverage`	Imported
Self-Supervised LLM aka Pretext tasks A large language model which learns rich representations by solving pretext tasks that involve predicting parts of the input from other obse…	AIO	Model	`AIO:SelfSupervisedLLM`	Imported
Semi-Supervised LLM aka Semi-Supervised Large Language Model, self-training A large language model which combines self-supervised pretraining on unlabeled data with supervised fine-tuning on labeled task data.	AIO	Model	`AIO:SemiSupervisedLLM`	Imported
Sparse LLM aka Sparse Large Language Model, model compression… A large language model that uses techniques like pruning or quantization to reduce the number of non-zero parameters in the model making it…	AIO	Model	`AIO:SparseLLM`	Imported
Threshold Autoregressive aka TAR A model that allows for different autoregressive processes depending on the regime or state of the time series, enabling the capture of nonl…	AIO	Model	`AIO:ThresholdAutoregressive`	Imported
Transfer Learning LLM aka Transfer LLM, transfer learning A large language model that leverages knowledge acquired during training on one task to improve performance on different but related tasks f…	AIO	Model	`AIO:TransferLearningLLM`	Imported
Transformer Language Model aka Transformer LM A language model that uses the transformer architecture based on multi-head attention mechanisms allowing it to contextualize tokens within…	AIO	Model	`AIO:TransformerLanguageModel`	Imported
Transformer LLM aka Transformer Large Language Model A transformer language model with large training corpuses and sets of parameters that uses the transformer architecture based on multi-head…	AIO	Model	`AIO:TransformerLLM`	Imported
Unsupervised LLM aka Unsupervised Large Language Model, self-supervised A large language model that is trained solely on unlabeled data using self-supervised objectives like masked language modeling without any s…	AIO	Model	`AIO:UnsupervisedLLM`	Imported
Vector Autoregression aka VAR A model that captures the linear interdependencies among multiple time series, where each variable is modeled as a linear function of its ow…	AIO	Model	`AIO:VectorAutoregression`	Imported
Zero-Shot Learning LLM aka Zero-Shot LLM, zero-shot learning A large language model which performs tasks or understands concepts it has not explicitly been trained on, demonstrating a high degree of ge…	AIO	Model	`AIO:ZeroShotLearningLLM`	Imported