Bettermdptools is a package meant to help acclimate users to gymnasium, which is a maintained fork of OpenAI’s Gym library. Bettermdptools includes - a few planning and RL algorithms, some useful utils and plots, a transition and reward matrix for blackjack, and starter code to get going with gymnasium. That's it!
pip install or git clone bettermdptools.
pip install bettermdptools
git clone https://github.com/jlm429/bettermdptools
Starter code to get up and running on the gymnasium frozen lake environment. See bettermdptools/notebooks for more.
import gymnasium as gym
from bettermdptools.algorithms.planner import Planner
from bettermdptools.utils.plots import Plots
# make gym environment
frozen_lake = gym.make('FrozenLake8x8-v1', render_mode=None)
# run VI
V, V_track, pi = Planner(frozen_lake.P).value_iteration()
#plot state values
size=(8,8)
Plots.values_heat_map(V, "Frozen Lake\nValue Iteration State Values", size)
Pull requests are welcome.
- Fork bettermdptools.
- Create a branch (
git checkout -b branch_name) - Commit changes (
git commit -m "Comments") - Push to branch (
git push origin branch_name) - Open a pull request