XGBoost (eXtreme Gradient Boosting) is an open-source machine learning library that uses gradient boosted decision trees, a supervised learning algorithm that uses gradient descent.