In my attempt to reproduce this article I learned that:

  1. Stable Baselines is now Stable Baselines 3
  2. Stable Baselines (3) uses Gymnasium

I ran the following in the virtual environment I made for gymnasium (python -m venv env;source env/bin/activate, no miniconda required):

pip install 'stable-baselines3[extra]'