Gradient Boost Decision Trees (GBDT) are an ensemble of regression trees used for classification tasks. Facebook chose GBDT for its reliability and effectiveness in handling complex decision-making processes with categorical and discrete features.