Can't load xgboost models created with Sagemaker Estimator

Question

Stumbled upon this while trying to evaluate my xgboost model:

```
model = pickle.load(open("./data/xgboost-model", "rb"))
UnpicklingError: unpickling stack underflow
```

The model was trained using :

```
container = image_uris.retrieve(framework='xgboost', region=boto3.Session().region_name, version='1.3-1')
```

Any ideas on how I can load the model? Thanks.

Answer

Hello,

I see that you are using XGBoost version = 1.3-1

Looks like the latest xgboost have changed the way the model is saved or loaded.

If you are using pickle to load the model, then try using the previous version of xgboost, such as 1.2-1, which will get loaded successfully.

https://stackoverflow.com/questions/69099627/what-causes-an-unpickling-stack-underflow-when-trying-to-serialize-a-succesfully

If you would like to use version 1.3-1, you can load it the following way -

=================

import xgboost as xgb

model = xgb.Booster()

model.load_model('xgboost-model')

=================

If you still continue to face the issue, I would recommend you to open a case with AWS Premium Support SageMaker team so that we can discuss more on the use case along with the implementation required for your use case
Open a support case with AWS using the link:
https://console.aws.amazon.com/support/home?#/case/create

Can't load xgboost models created with Sagemaker Estimator

Relevant content