Home / AIO Classes / Preprocessing

Preprocessing

10 Classes

Input transformations and representation preparation steps.

Showing 10 of 10

Concept	Origin	Kind / Branch	Identifier	Evidence / Status
Cleaning aka Data Cleansing, Standardization… A data preparation that removes noise inconsistencies and irrelevant information from data to enhance its quality and prepare it for analysi…	AIO	Preprocessing	`AIO:Cleaning`	Imported
Data Augmentation aka Data Enrichment, Data Expansion… A data enhancement used to increase the diversity and quantity of training data by applying various transformations such as rotation scaling…	AIO	Preprocessing	`AIO:DataAugmentation`	Imported
Data Preparation aka Data Assembly, Data Curation… A preprocessing that cleans, transforms and organizes raw data into a suitable format for analysis and modeling, ensuring the quality and re…	AIO	Preprocessing	`AIO:DataPreparation`	Imported
DataEnhancement A preprocessing used to improve the quality diversity and volume of data available for training machine learning models, such as data augmen…	AIO	Preprocessing	`AIO:DataEnhancement`	Imported
Feature Extraction aka Attribute Extraction, Feature Isolation… A data enhancement that transforms raw data into a set of measurable characteristics that can be used as input for machine learning algorith…	AIO	Preprocessing	`AIO:FeatureExtraction`	Imported
Normalization A data preparation that transforms data into a standard format or scale typically to reduce redundancy and improve consistency often involvi…	AIO	Preprocessing	`AIO:Normalization`	Imported
Preprocessing A process applied to raw data before it is used in a machine learning model, including tasks such as normalization, scaling, encoding, and t…	AIO	Preprocessing	`AIO:Preprocessing`	Imported
Subword Segmentation aka Fragmentation, Part-word Division… A data preparation that divides text into subword units which are smaller than words but larger than individual characters to improve the ef…	AIO	Preprocessing	`AIO:SubwordSegmentation`	Imported
Tokenization aka Lexical Analysis, Text Segmentation A data preparation that converts a sequence of text into smaller meaningful units called tokens typically words or subwords for the purpose…	AIO	Preprocessing	`AIO:Tokenization`	Imported
Vocabulary Reduction aka Lexical Simplification, Lexicon Pruning… A data preparation that limits the number of unique tokens in a language model's vocabulary by merging or eliminating less frequent tokens t…	AIO	Preprocessing	`AIO:VocabularyReduction`	Imported