Home / AIO Classes / Model / Factorized LLM

Factorized LLM

Model AIO:FactorizedLLM NOT_REVIEWED

A large language model that decomposes the full language modeling task into multiple sub-components or experts that each focus on a subset of the information enabling more efficient scaling.

Ontology IRI: https://w3id.org/aio/FactorizedLLM

Ontology Structure & Relationships

Parent Classes

AIO:LargeLanguageModel (Large Language Model)

Branches

Model

Annotations & Sources

Synonyms:

Factorized Large Language Model exact
Factorized Learning Assisted with Large Language Model exact
Conditional masking related
Product of experts related

Definition Sources:

https://doi.org/10.48550/arXiv.2403.12556

Subsets:

https://w3id.org/aio/ModelSubset

Import Provenance & Upstream Synchronization

Source Repo: AIO GitHub

Release Version: aio.json

Commit: 397851c547…

License: CC-BY-4.0

Imported At: 2026-10-10T07:34:10Z

SHA256: 8f741d71408c…

Source File: data/aio/FactorizedLLM.yaml