Home / AIO Classes / Model / Bidirectional Transformer Language Model

Bidirectional Transformer Language Model

Model AIO:BidirectionalTransformerLanguageModel NOT_REVIEWED

A transformer language model such as BERT that uses the transformer architecture to build deep bidirectional representations by predicting masked tokens based on their context.

Ontology IRI: https://w3id.org/aio/BidirectionalTransformerLanguageModel

Ontology Structure & Relationships

Parent Classes

AIO:TransformerLanguageModel (Transformer Language Model)

Branches

Model

Annotations & Sources

Synonyms:

BERT exact
Bidirectional Transformer LM exact

Definition Sources:

https://arxiv.org/abs/1810.04805
https://en.wikipedia.org/wiki/BERT_(language_model)

Subsets:

https://w3id.org/aio/ModelSubset

Import Provenance & Upstream Synchronization

Source Repo: AIO GitHub

Release Version: aio.json

Commit: 397851c547…

License: CC-BY-4.0

Imported At: 2026-10-10T07:34:10Z

SHA256: 8f741d71408c…

Source File: data/aio/BidirectionalTransformerLanguageModel.yaml