ReRanking_XGB.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "provenance": [],
      "mount_file_id": "1koqLvWKzG_UUWRcXsYnHYD2kgAWQ8Qcu",
      "authorship_tag": "ABX9TyNr+ihIuYYLe2A0wVRsD+/X",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/Sarvesh1814/US-Book-Recommendation-System-/blob/main/ReRanking_XGB.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Training Reranker\n"
      ],
      "metadata": {
        "id": "nKJeTSlMk42z"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Importing Libraries"
      ],
      "metadata": {
        "id": "Dfvvfsc_j1zd"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "nXRAj7qAUuLf"
      },
      "outputs": [],
      "source": [
        "import numpy as np\n",
        "from sklearn.datasets import load_svmlight_file\n",
        "from sklearn.model_selection import train_test_split\n",
        "import pandas as pd\n",
        "import pickle\n",
        "import scipy"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Loading Dataset"
      ],
      "metadata": {
        "id": "B0xyrMuGlAX9"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "Base = \"/content/drive/MyDrive/RS Data/Assignment 3/Processed_data/\"\n",
        "train=pd.read_csv(Base+\"Train_df_final.csv\")\n",
        "test = pd.read_csv(Base+\"Test_df_final.csv\")\n",
        "train = train[[\"User-ID\"\t,\"ISBN\",\t\"Book-Rating\"\t,\"book_name\"]]\n",
        "test = test[[\"User-ID\"\t,\"ISBN\",\t\"Book-Rating\"\t,\"book_name\"]]"
      ],
      "metadata": {
        "id": "bUSSRKnjsyLf"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "datas = pd.read_csv(\"/content/drive/MyDrive/RS Data/Assignment 3/Processed_data/Books_with_108_features.csv\")"
      ],
      "metadata": {
        "id": "n1q7DBJc_PRC"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "users= pd.read_csv(\"/content/drive/MyDrive/RS Data/Assignment 3/Processed_data/users.csv\")"
      ],
      "metadata": {
        "id": "a_xWMgcPt0YR"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Train Features"
      ],
      "metadata": {
        "id": "NxCqbYy_Sgek"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Feteching the features of Books and Users and merging them to make common feature table\n",
        "\n",
        "train_features = train.merge(datas,on=\"ISBN\",how=\"left\")\n",
        "train_features = train_features.merge(users,on=\"User-ID\",how=\"left\")"
      ],
      "metadata": {
        "id": "7ttyZBIQstdd"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "train_features"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "WCALMi92_14M",
        "outputId": "29e0edb7-b6ca-4d6a-f342-b07e8f9a1509"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "       User-ID        ISBN  Book-Rating  \\\n",
              "0        68436  0345323440            8   \n",
              "1       216829  0375707972            5   \n",
              "2       153718  0373484887            7   \n",
              "3        62862  0140244824            5   \n",
              "4        17003  0312305060           10   \n",
              "...        ...         ...          ...   \n",
              "93451   251721  1551666766            3   \n",
              "93452   275476  0151008116            8   \n",
              "93453   237898  0375758232            7   \n",
              "93454      254  0451167317            8   \n",
              "93455    34588  0140257934           10   \n",
              "\n",
              "                                               book_name  \\\n",
              "0                                               Footfall   \n",
              "1                                             The Reader   \n",
              "2                          Hidden Star (The Star Series)   \n",
              "3      Songs in Ordinary Time (Oprah's Book Club (Pap...   \n",
              "4                                     The Hours: A Novel   \n",
              "...                                                  ...   \n",
              "93451                                   Naughty Marietta   \n",
              "93452                                         Life of Pi   \n",
              "93453                                  Paris to the Moon   \n",
              "93454                                      The Dark Half   \n",
              "93455        These High, Green Hills (The Mitford Years)   \n",
              "\n",
              "                                              Book-Title  page_count  \\\n",
              "0                                               Footfall       706.0   \n",
              "1                                             The Reader       224.0   \n",
              "2                          Hidden Star (The Star Series)       234.0   \n",
              "3      Songs in Ordinary Time (Oprah's Book Club (Pap...       682.0   \n",
              "4                                     The Hours: A Novel       295.0   \n",
              "...                                                  ...         ...   \n",
              "93451                                   Naughty Marietta       388.0   \n",
              "93452                                         Life of Pi       352.0   \n",
              "93453                                  Paris to the Moon       368.0   \n",
              "93454                                      The Dark Half       496.0   \n",
              "93455        These High, Green Hills (The Mitford Years)       372.0   \n",
              "\n",
              "                          categories  \\\n",
              "0                        ['Fiction']   \n",
              "1                        ['Fiction']   \n",
              "2                        ['Fiction']   \n",
              "3                        ['Fiction']   \n",
              "4                        ['Fiction']   \n",
              "...                              ...   \n",
              "93451         ['Kidnapping victims']   \n",
              "93452                             []   \n",
              "93453  ['Biography & Autobiography']   \n",
              "93454                    ['Fiction']   \n",
              "93455                    ['Fiction']   \n",
              "\n",
              "                                                Synopsis          Book-Author  \\\n",
              "0      hostile extraterrestrial known fithp invade ea...          Larry Niven   \n",
              "1      hailed coiled eroticism moral claim make upon ...     Bernhard Schlink   \n",
              "2      elevenyearold nolityes granny used say mess wo...         Nora Roberts   \n",
              "3      new york time bestseller troubled family 1960s...  Mary McGarry Morris   \n",
              "4      michael cunningham brings together pulitzer pr...   Michael Cunningham   \n",
              "...                                                  ...                  ...   \n",
              "93451  cole heflin agrees find return maxwell laceys ...             Nan Ryan   \n",
              "93452  one boy one boat one tiger tragic sinking carg...          Yann Martel   \n",
              "93453  paris name alone conjures image chestnutlined ...          Adam Gopnik   \n",
              "93454  set fictional town castle rock maine wondrousl...         Stephen King   \n",
              "93455  join 1 new york time bestselling author jan ka...            Jan Karon   \n",
              "\n",
              "       Year-Of-Publication  ... feature_95  feature_96  feature_97  \\\n",
              "0                     1996  ...   0.468369    0.346564    0.053775   \n",
              "1                     1999  ...   0.671669    0.287058    0.089154   \n",
              "2                     2001  ...   0.571358    0.256229    0.019965   \n",
              "3                     1996  ...   0.696558    0.284364   -0.012427   \n",
              "4                     2002  ...   1.172455    0.515726   -0.061136   \n",
              "...                    ...  ...        ...         ...         ...   \n",
              "93451                 2003  ...   0.526418    0.269839    0.425712   \n",
              "93452                 2002  ...   0.859223    0.280609    0.263873   \n",
              "93453                 2001  ...   0.660590    0.285059   -0.085148   \n",
              "93454                 1994  ...   0.851253    0.460726   -0.103199   \n",
              "93455                 1997  ...   0.731295    0.357440   -0.160549   \n",
              "\n",
              "       feature_98  feature_99  feature_100  Unnamed: 0  \\\n",
              "0       -0.575963    0.202055     0.013086       68435   \n",
              "1       -0.696850   -0.135784     0.029446      216828   \n",
              "2       -0.636953   -0.006536     0.099358      153717   \n",
              "3       -0.741037   -0.019430     0.027534       62861   \n",
              "4       -0.634418    0.506026    -0.319519       17002   \n",
              "...           ...         ...          ...         ...   \n",
              "93451   -0.483061   -0.093054     0.309306      251720   \n",
              "93452   -0.560046    0.083430    -0.219807      275475   \n",
              "93453   -0.642241    0.067873     0.057663      237897   \n",
              "93454   -0.629326    0.073446    -0.024774         253   \n",
              "93455   -0.721658   -0.106816     0.208603       34587   \n",
              "\n",
              "                            Location   Age  country  \n",
              "0       downieville, california, usa  49.0      usa  \n",
              "1              parker, colorado, usa   NaN      usa  \n",
              "2          round lake, illinois, usa  27.0      usa  \n",
              "3      new milford, connecticut, usa  47.0      usa  \n",
              "4          carlsbad, california, usa   NaN      usa  \n",
              "...                              ...   ...      ...  \n",
              "93451    orleans, massachusetts, usa  57.0      usa  \n",
              "93452           aspen, colorado, usa  50.0      usa  \n",
              "93453      salt lake city, utah, usa   NaN      usa  \n",
              "93454    minneapolis, minnesota, usa  24.0      usa  \n",
              "93455         west linn, oregon, usa   NaN      usa  \n",
              "\n",
              "[93456 rows x 115 columns]"
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-81fd3091-5eca-4b05-9391-1818f33bff2e\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>User-ID</th>\n",
              "      <th>ISBN</th>\n",
              "      <th>Book-Rating</th>\n",
              "      <th>book_name</th>\n",
              "      <th>Book-Title</th>\n",
              "      <th>page_count</th>\n",
              "      <th>categories</th>\n",
              "      <th>Synopsis</th>\n",
              "      <th>Book-Author</th>\n",
              "      <th>Year-Of-Publication</th>\n",
              "      <th>...</th>\n",
              "      <th>feature_95</th>\n",
              "      <th>feature_96</th>\n",
              "      <th>feature_97</th>\n",
              "      <th>feature_98</th>\n",
              "      <th>feature_99</th>\n",
              "      <th>feature_100</th>\n",
              "      <th>Unnamed: 0</th>\n",
              "      <th>Location</th>\n",
              "      <th>Age</th>\n",
              "      <th>country</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>68436</td>\n",
              "      <td>0345323440</td>\n",
              "      <td>8</td>\n",
              "      <td>Footfall</td>\n",
              "      <td>Footfall</td>\n",
              "      <td>706.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>hostile extraterrestrial known fithp invade ea...</td>\n",
              "      <td>Larry Niven</td>\n",
              "      <td>1996</td>\n",
              "      <td>...</td>\n",
              "      <td>0.468369</td>\n",
              "      <td>0.346564</td>\n",
              "      <td>0.053775</td>\n",
              "      <td>-0.575963</td>\n",
              "      <td>0.202055</td>\n",
              "      <td>0.013086</td>\n",
              "      <td>68435</td>\n",
              "      <td>downieville, california, usa</td>\n",
              "      <td>49.0</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>216829</td>\n",
              "      <td>0375707972</td>\n",
              "      <td>5</td>\n",
              "      <td>The Reader</td>\n",
              "      <td>The Reader</td>\n",
              "      <td>224.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>hailed coiled eroticism moral claim make upon ...</td>\n",
              "      <td>Bernhard Schlink</td>\n",
              "      <td>1999</td>\n",
              "      <td>...</td>\n",
              "      <td>0.671669</td>\n",
              "      <td>0.287058</td>\n",
              "      <td>0.089154</td>\n",
              "      <td>-0.696850</td>\n",
              "      <td>-0.135784</td>\n",
              "      <td>0.029446</td>\n",
              "      <td>216828</td>\n",
              "      <td>parker, colorado, usa</td>\n",
              "      <td>NaN</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>153718</td>\n",
              "      <td>0373484887</td>\n",
              "      <td>7</td>\n",
              "      <td>Hidden Star (The Star Series)</td>\n",
              "      <td>Hidden Star (The Star Series)</td>\n",
              "      <td>234.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>elevenyearold nolityes granny used say mess wo...</td>\n",
              "      <td>Nora Roberts</td>\n",
              "      <td>2001</td>\n",
              "      <td>...</td>\n",
              "      <td>0.571358</td>\n",
              "      <td>0.256229</td>\n",
              "      <td>0.019965</td>\n",
              "      <td>-0.636953</td>\n",
              "      <td>-0.006536</td>\n",
              "      <td>0.099358</td>\n",
              "      <td>153717</td>\n",
              "      <td>round lake, illinois, usa</td>\n",
              "      <td>27.0</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>62862</td>\n",
              "      <td>0140244824</td>\n",
              "      <td>5</td>\n",
              "      <td>Songs in Ordinary Time (Oprah's Book Club (Pap...</td>\n",
              "      <td>Songs in Ordinary Time (Oprah's Book Club (Pap...</td>\n",
              "      <td>682.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>new york time bestseller troubled family 1960s...</td>\n",
              "      <td>Mary McGarry Morris</td>\n",
              "      <td>1996</td>\n",
              "      <td>...</td>\n",
              "      <td>0.696558</td>\n",
              "      <td>0.284364</td>\n",
              "      <td>-0.012427</td>\n",
              "      <td>-0.741037</td>\n",
              "      <td>-0.019430</td>\n",
              "      <td>0.027534</td>\n",
              "      <td>62861</td>\n",
              "      <td>new milford, connecticut, usa</td>\n",
              "      <td>47.0</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>17003</td>\n",
              "      <td>0312305060</td>\n",
              "      <td>10</td>\n",
              "      <td>The Hours: A Novel</td>\n",
              "      <td>The Hours: A Novel</td>\n",
              "      <td>295.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>michael cunningham brings together pulitzer pr...</td>\n",
              "      <td>Michael Cunningham</td>\n",
              "      <td>2002</td>\n",
              "      <td>...</td>\n",
              "      <td>1.172455</td>\n",
              "      <td>0.515726</td>\n",
              "      <td>-0.061136</td>\n",
              "      <td>-0.634418</td>\n",
              "      <td>0.506026</td>\n",
              "      <td>-0.319519</td>\n",
              "      <td>17002</td>\n",
              "      <td>carlsbad, california, usa</td>\n",
              "      <td>NaN</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93451</th>\n",
              "      <td>251721</td>\n",
              "      <td>1551666766</td>\n",
              "      <td>3</td>\n",
              "      <td>Naughty Marietta</td>\n",
              "      <td>Naughty Marietta</td>\n",
              "      <td>388.0</td>\n",
              "      <td>['Kidnapping victims']</td>\n",
              "      <td>cole heflin agrees find return maxwell laceys ...</td>\n",
              "      <td>Nan Ryan</td>\n",
              "      <td>2003</td>\n",
              "      <td>...</td>\n",
              "      <td>0.526418</td>\n",
              "      <td>0.269839</td>\n",
              "      <td>0.425712</td>\n",
              "      <td>-0.483061</td>\n",
              "      <td>-0.093054</td>\n",
              "      <td>0.309306</td>\n",
              "      <td>251720</td>\n",
              "      <td>orleans, massachusetts, usa</td>\n",
              "      <td>57.0</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93452</th>\n",
              "      <td>275476</td>\n",
              "      <td>0151008116</td>\n",
              "      <td>8</td>\n",
              "      <td>Life of Pi</td>\n",
              "      <td>Life of Pi</td>\n",
              "      <td>352.0</td>\n",
              "      <td>[]</td>\n",
              "      <td>one boy one boat one tiger tragic sinking carg...</td>\n",
              "      <td>Yann Martel</td>\n",
              "      <td>2002</td>\n",
              "      <td>...</td>\n",
              "      <td>0.859223</td>\n",
              "      <td>0.280609</td>\n",
              "      <td>0.263873</td>\n",
              "      <td>-0.560046</td>\n",
              "      <td>0.083430</td>\n",
              "      <td>-0.219807</td>\n",
              "      <td>275475</td>\n",
              "      <td>aspen, colorado, usa</td>\n",
              "      <td>50.0</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93453</th>\n",
              "      <td>237898</td>\n",
              "      <td>0375758232</td>\n",
              "      <td>7</td>\n",
              "      <td>Paris to the Moon</td>\n",
              "      <td>Paris to the Moon</td>\n",
              "      <td>368.0</td>\n",
              "      <td>['Biography &amp; Autobiography']</td>\n",
              "      <td>paris name alone conjures image chestnutlined ...</td>\n",
              "      <td>Adam Gopnik</td>\n",
              "      <td>2001</td>\n",
              "      <td>...</td>\n",
              "      <td>0.660590</td>\n",
              "      <td>0.285059</td>\n",
              "      <td>-0.085148</td>\n",
              "      <td>-0.642241</td>\n",
              "      <td>0.067873</td>\n",
              "      <td>0.057663</td>\n",
              "      <td>237897</td>\n",
              "      <td>salt lake city, utah, usa</td>\n",
              "      <td>NaN</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93454</th>\n",
              "      <td>254</td>\n",
              "      <td>0451167317</td>\n",
              "      <td>8</td>\n",
              "      <td>The Dark Half</td>\n",
              "      <td>The Dark Half</td>\n",
              "      <td>496.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>set fictional town castle rock maine wondrousl...</td>\n",
              "      <td>Stephen King</td>\n",
              "      <td>1994</td>\n",
              "      <td>...</td>\n",
              "      <td>0.851253</td>\n",
              "      <td>0.460726</td>\n",
              "      <td>-0.103199</td>\n",
              "      <td>-0.629326</td>\n",
              "      <td>0.073446</td>\n",
              "      <td>-0.024774</td>\n",
              "      <td>253</td>\n",
              "      <td>minneapolis, minnesota, usa</td>\n",
              "      <td>24.0</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93455</th>\n",
              "      <td>34588</td>\n",
              "      <td>0140257934</td>\n",
              "      <td>10</td>\n",
              "      <td>These High, Green Hills (The Mitford Years)</td>\n",
              "      <td>These High, Green Hills (The Mitford Years)</td>\n",
              "      <td>372.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>join 1 new york time bestselling author jan ka...</td>\n",
              "      <td>Jan Karon</td>\n",
              "      <td>1997</td>\n",
              "      <td>...</td>\n",
              "      <td>0.731295</td>\n",
              "      <td>0.357440</td>\n",
              "      <td>-0.160549</td>\n",
              "      <td>-0.721658</td>\n",
              "      <td>-0.106816</td>\n",
              "      <td>0.208603</td>\n",
              "      <td>34587</td>\n",
              "      <td>west linn, oregon, usa</td>\n",
              "      <td>NaN</td>\n",
              "      <td>usa</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>93456 rows × 115 columns</p>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-81fd3091-5eca-4b05-9391-1818f33bff2e')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-81fd3091-5eca-4b05-9391-1818f33bff2e button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-81fd3091-5eca-4b05-9391-1818f33bff2e');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 39
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "#Extracting the State information from the location of users\n",
        "train_features[\"State\"]= ''\n",
        "for i in range(len(train_features)):\n",
        "  xxx=(train_features[\"Location\"].iloc[i]).split(\",\")\n",
        "  train_features[\"State\"].iloc[i] = xxx[1]\n"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2cXaqmmowWa6",
        "outputId": "e98c9e4d-b433-4189-b463-a346992ba4d4"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "<ipython-input-40-d99d959bac63>:4: SettingWithCopyWarning: \n",
            "A value is trying to be set on a copy of a slice from a DataFrame\n",
            "\n",
            "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
            "  train_features[\"State\"].iloc[i] = xxx[1]\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Filling the empty values of Age with mean\n",
        "mean_value=train_features['Age'].mean()\n",
        "train_features[\"Age\"].fillna(value=mean_value, inplace=True)"
      ],
      "metadata": {
        "id": "tSHLdewMtHho"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Dropping irrelevant features\n",
        "train_features=train_features.drop(axis='columns',labels=[\"Unnamed: 0\",\"Location\",\"country\",\"ISBN\",\"Book-Title\",\"book_name\",\"Synopsis\",\"Book-Author\",\"Publisher\"])"
      ],
      "metadata": {
        "id": "dxm_zyiqz2Lp"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "train_features"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 539
        },
        "id": "-F5IOf7TBZEl",
        "outputId": "7380bd27-4ace-49c6-fa64-a3b690069d6b"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "       User-ID  Book-Rating  page_count                     categories  \\\n",
              "0        68436            8       706.0                    ['Fiction']   \n",
              "1       216829            5       224.0                    ['Fiction']   \n",
              "2       153718            7       234.0                    ['Fiction']   \n",
              "3        62862            5       682.0                    ['Fiction']   \n",
              "4        17003           10       295.0                    ['Fiction']   \n",
              "...        ...          ...         ...                            ...   \n",
              "93451   251721            3       388.0         ['Kidnapping victims']   \n",
              "93452   275476            8       352.0                             []   \n",
              "93453   237898            7       368.0  ['Biography & Autobiography']   \n",
              "93454      254            8       496.0                    ['Fiction']   \n",
              "93455    34588           10       372.0                    ['Fiction']   \n",
              "\n",
              "       Year-Of-Publication  feature_1  feature_2  feature_3  feature_4  \\\n",
              "0                     1996  -0.324090   0.178090   0.085679   0.051699   \n",
              "1                     1999  -0.265439   0.180581  -0.044998   0.521798   \n",
              "2                     2001  -0.353918   0.205880   0.004314   0.376427   \n",
              "3                     1996  -0.372134   0.323817  -0.150502   0.530034   \n",
              "4                     2002  -0.439820   0.646338   0.074526   0.534048   \n",
              "...                    ...        ...        ...        ...        ...   \n",
              "93451                 2003  -0.431911   0.189106   0.178611   0.353429   \n",
              "93452                 2002  -0.226763   0.279756   0.136534   0.210636   \n",
              "93453                 2001  -0.392849   0.313611  -0.116709   0.383482   \n",
              "93454                 1994  -0.504749   0.368706   0.031612   0.569283   \n",
              "93455                 1997  -0.381510   0.281823  -0.106794   0.641973   \n",
              "\n",
              "       feature_5  ...  feature_93  feature_94  feature_95  feature_96  \\\n",
              "0      -0.233513  ...   -0.040599   -0.159770    0.468369    0.346564   \n",
              "1       0.064341  ...   -0.067668    0.264588    0.671669    0.287058   \n",
              "2      -0.038735  ...   -0.062447    0.144621    0.571358    0.256229   \n",
              "3       0.088527  ...    0.045399    0.196020    0.696558    0.284364   \n",
              "4       0.210026  ...   -0.010307   -0.071196    1.172455    0.515726   \n",
              "...          ...  ...         ...         ...         ...         ...   \n",
              "93451   0.059231  ...    0.055543    0.143617    0.526418    0.269839   \n",
              "93452  -0.047499  ...   -0.086392    0.063495    0.859223    0.280609   \n",
              "93453  -0.036119  ...    0.028992    0.084331    0.660590    0.285059   \n",
              "93454   0.101934  ...    0.071106    0.127090    0.851253    0.460726   \n",
              "93455   0.097135  ...    0.125253    0.349689    0.731295    0.357440   \n",
              "\n",
              "       feature_97  feature_98  feature_99  feature_100       Age  \\\n",
              "0        0.053775   -0.575963    0.202055     0.013086  49.00000   \n",
              "1        0.089154   -0.696850   -0.135784     0.029446  37.48389   \n",
              "2        0.019965   -0.636953   -0.006536     0.099358  27.00000   \n",
              "3       -0.012427   -0.741037   -0.019430     0.027534  47.00000   \n",
              "4       -0.061136   -0.634418    0.506026    -0.319519  37.48389   \n",
              "...           ...         ...         ...          ...       ...   \n",
              "93451    0.425712   -0.483061   -0.093054     0.309306  57.00000   \n",
              "93452    0.263873   -0.560046    0.083430    -0.219807  50.00000   \n",
              "93453   -0.085148   -0.642241    0.067873     0.057663  37.48389   \n",
              "93454   -0.103199   -0.629326    0.073446    -0.024774  24.00000   \n",
              "93455   -0.160549   -0.721658   -0.106816     0.208603  37.48389   \n",
              "\n",
              "                State  \n",
              "0          california  \n",
              "1            colorado  \n",
              "2            illinois  \n",
              "3         connecticut  \n",
              "4          california  \n",
              "...               ...  \n",
              "93451   massachusetts  \n",
              "93452        colorado  \n",
              "93453            utah  \n",
              "93454       minnesota  \n",
              "93455          oregon  \n",
              "\n",
              "[93456 rows x 107 columns]"
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-b643f371-cd2a-4e20-86ac-98387badddec\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>User-ID</th>\n",
              "      <th>Book-Rating</th>\n",
              "      <th>page_count</th>\n",
              "      <th>categories</th>\n",
              "      <th>Year-Of-Publication</th>\n",
              "      <th>feature_1</th>\n",
              "      <th>feature_2</th>\n",
              "      <th>feature_3</th>\n",
              "      <th>feature_4</th>\n",
              "      <th>feature_5</th>\n",
              "      <th>...</th>\n",
              "      <th>feature_93</th>\n",
              "      <th>feature_94</th>\n",
              "      <th>feature_95</th>\n",
              "      <th>feature_96</th>\n",
              "      <th>feature_97</th>\n",
              "      <th>feature_98</th>\n",
              "      <th>feature_99</th>\n",
              "      <th>feature_100</th>\n",
              "      <th>Age</th>\n",
              "      <th>State</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>68436</td>\n",
              "      <td>8</td>\n",
              "      <td>706.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>1996</td>\n",
              "      <td>-0.324090</td>\n",
              "      <td>0.178090</td>\n",
              "      <td>0.085679</td>\n",
              "      <td>0.051699</td>\n",
              "      <td>-0.233513</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.040599</td>\n",
              "      <td>-0.159770</td>\n",
              "      <td>0.468369</td>\n",
              "      <td>0.346564</td>\n",
              "      <td>0.053775</td>\n",
              "      <td>-0.575963</td>\n",
              "      <td>0.202055</td>\n",
              "      <td>0.013086</td>\n",
              "      <td>49.00000</td>\n",
              "      <td>california</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>216829</td>\n",
              "      <td>5</td>\n",
              "      <td>224.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>1999</td>\n",
              "      <td>-0.265439</td>\n",
              "      <td>0.180581</td>\n",
              "      <td>-0.044998</td>\n",
              "      <td>0.521798</td>\n",
              "      <td>0.064341</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.067668</td>\n",
              "      <td>0.264588</td>\n",
              "      <td>0.671669</td>\n",
              "      <td>0.287058</td>\n",
              "      <td>0.089154</td>\n",
              "      <td>-0.696850</td>\n",
              "      <td>-0.135784</td>\n",
              "      <td>0.029446</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>colorado</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>153718</td>\n",
              "      <td>7</td>\n",
              "      <td>234.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>2001</td>\n",
              "      <td>-0.353918</td>\n",
              "      <td>0.205880</td>\n",
              "      <td>0.004314</td>\n",
              "      <td>0.376427</td>\n",
              "      <td>-0.038735</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.062447</td>\n",
              "      <td>0.144621</td>\n",
              "      <td>0.571358</td>\n",
              "      <td>0.256229</td>\n",
              "      <td>0.019965</td>\n",
              "      <td>-0.636953</td>\n",
              "      <td>-0.006536</td>\n",
              "      <td>0.099358</td>\n",
              "      <td>27.00000</td>\n",
              "      <td>illinois</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>62862</td>\n",
              "      <td>5</td>\n",
              "      <td>682.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>1996</td>\n",
              "      <td>-0.372134</td>\n",
              "      <td>0.323817</td>\n",
              "      <td>-0.150502</td>\n",
              "      <td>0.530034</td>\n",
              "      <td>0.088527</td>\n",
              "      <td>...</td>\n",
              "      <td>0.045399</td>\n",
              "      <td>0.196020</td>\n",
              "      <td>0.696558</td>\n",
              "      <td>0.284364</td>\n",
              "      <td>-0.012427</td>\n",
              "      <td>-0.741037</td>\n",
              "      <td>-0.019430</td>\n",
              "      <td>0.027534</td>\n",
              "      <td>47.00000</td>\n",
              "      <td>connecticut</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>17003</td>\n",
              "      <td>10</td>\n",
              "      <td>295.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>2002</td>\n",
              "      <td>-0.439820</td>\n",
              "      <td>0.646338</td>\n",
              "      <td>0.074526</td>\n",
              "      <td>0.534048</td>\n",
              "      <td>0.210026</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.010307</td>\n",
              "      <td>-0.071196</td>\n",
              "      <td>1.172455</td>\n",
              "      <td>0.515726</td>\n",
              "      <td>-0.061136</td>\n",
              "      <td>-0.634418</td>\n",
              "      <td>0.506026</td>\n",
              "      <td>-0.319519</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>california</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93451</th>\n",
              "      <td>251721</td>\n",
              "      <td>3</td>\n",
              "      <td>388.0</td>\n",
              "      <td>['Kidnapping victims']</td>\n",
              "      <td>2003</td>\n",
              "      <td>-0.431911</td>\n",
              "      <td>0.189106</td>\n",
              "      <td>0.178611</td>\n",
              "      <td>0.353429</td>\n",
              "      <td>0.059231</td>\n",
              "      <td>...</td>\n",
              "      <td>0.055543</td>\n",
              "      <td>0.143617</td>\n",
              "      <td>0.526418</td>\n",
              "      <td>0.269839</td>\n",
              "      <td>0.425712</td>\n",
              "      <td>-0.483061</td>\n",
              "      <td>-0.093054</td>\n",
              "      <td>0.309306</td>\n",
              "      <td>57.00000</td>\n",
              "      <td>massachusetts</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93452</th>\n",
              "      <td>275476</td>\n",
              "      <td>8</td>\n",
              "      <td>352.0</td>\n",
              "      <td>[]</td>\n",
              "      <td>2002</td>\n",
              "      <td>-0.226763</td>\n",
              "      <td>0.279756</td>\n",
              "      <td>0.136534</td>\n",
              "      <td>0.210636</td>\n",
              "      <td>-0.047499</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.086392</td>\n",
              "      <td>0.063495</td>\n",
              "      <td>0.859223</td>\n",
              "      <td>0.280609</td>\n",
              "      <td>0.263873</td>\n",
              "      <td>-0.560046</td>\n",
              "      <td>0.083430</td>\n",
              "      <td>-0.219807</td>\n",
              "      <td>50.00000</td>\n",
              "      <td>colorado</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93453</th>\n",
              "      <td>237898</td>\n",
              "      <td>7</td>\n",
              "      <td>368.0</td>\n",
              "      <td>['Biography &amp; Autobiography']</td>\n",
              "      <td>2001</td>\n",
              "      <td>-0.392849</td>\n",
              "      <td>0.313611</td>\n",
              "      <td>-0.116709</td>\n",
              "      <td>0.383482</td>\n",
              "      <td>-0.036119</td>\n",
              "      <td>...</td>\n",
              "      <td>0.028992</td>\n",
              "      <td>0.084331</td>\n",
              "      <td>0.660590</td>\n",
              "      <td>0.285059</td>\n",
              "      <td>-0.085148</td>\n",
              "      <td>-0.642241</td>\n",
              "      <td>0.067873</td>\n",
              "      <td>0.057663</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>utah</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93454</th>\n",
              "      <td>254</td>\n",
              "      <td>8</td>\n",
              "      <td>496.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>1994</td>\n",
              "      <td>-0.504749</td>\n",
              "      <td>0.368706</td>\n",
              "      <td>0.031612</td>\n",
              "      <td>0.569283</td>\n",
              "      <td>0.101934</td>\n",
              "      <td>...</td>\n",
              "      <td>0.071106</td>\n",
              "      <td>0.127090</td>\n",
              "      <td>0.851253</td>\n",
              "      <td>0.460726</td>\n",
              "      <td>-0.103199</td>\n",
              "      <td>-0.629326</td>\n",
              "      <td>0.073446</td>\n",
              "      <td>-0.024774</td>\n",
              "      <td>24.00000</td>\n",
              "      <td>minnesota</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93455</th>\n",
              "      <td>34588</td>\n",
              "      <td>10</td>\n",
              "      <td>372.0</td>\n",
              "      <td>['Fiction']</td>\n",
              "      <td>1997</td>\n",
              "      <td>-0.381510</td>\n",
              "      <td>0.281823</td>\n",
              "      <td>-0.106794</td>\n",
              "      <td>0.641973</td>\n",
              "      <td>0.097135</td>\n",
              "      <td>...</td>\n",
              "      <td>0.125253</td>\n",
              "      <td>0.349689</td>\n",
              "      <td>0.731295</td>\n",
              "      <td>0.357440</td>\n",
              "      <td>-0.160549</td>\n",
              "      <td>-0.721658</td>\n",
              "      <td>-0.106816</td>\n",
              "      <td>0.208603</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>oregon</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>93456 rows × 107 columns</p>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-b643f371-cd2a-4e20-86ac-98387badddec')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-b643f371-cd2a-4e20-86ac-98387badddec button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-b643f371-cd2a-4e20-86ac-98387badddec');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 43
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "#Label encoding states and categories\n",
        "le = LabelEncoder()\n",
        "train_features['State'] = le.fit_transform(train_features['State'])\n",
        "train_features['categories'] = le.fit_transform(train_features['categories'])\n"
      ],
      "metadata": {
        "id": "JaJkh69s0fvO"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "train_features"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 505
        },
        "id": "isWKPLWA0W4e",
        "outputId": "2ec21bfa-4e78-4d89-a54f-8868417fcd21"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "       User-ID  Book-Rating  page_count  categories  Year-Of-Publication  \\\n",
              "0        68436            8       706.0         330                 1996   \n",
              "1       216829            5       224.0         330                 1999   \n",
              "2       153718            7       234.0         330                 2001   \n",
              "3        62862            5       682.0         330                 1996   \n",
              "4        17003           10       295.0         330                 2002   \n",
              "...        ...          ...         ...         ...                  ...   \n",
              "93451   251721            3       388.0         391                 2003   \n",
              "93452   275476            8       352.0         500                 2002   \n",
              "93453   237898            7       368.0         127                 2001   \n",
              "93454      254            8       496.0         330                 1994   \n",
              "93455    34588           10       372.0         330                 1997   \n",
              "\n",
              "       feature_1  feature_2  feature_3  feature_4  feature_5  ...  feature_93  \\\n",
              "0      -0.324090   0.178090   0.085679   0.051699  -0.233513  ...   -0.040599   \n",
              "1      -0.265439   0.180581  -0.044998   0.521798   0.064341  ...   -0.067668   \n",
              "2      -0.353918   0.205880   0.004314   0.376427  -0.038735  ...   -0.062447   \n",
              "3      -0.372134   0.323817  -0.150502   0.530034   0.088527  ...    0.045399   \n",
              "4      -0.439820   0.646338   0.074526   0.534048   0.210026  ...   -0.010307   \n",
              "...          ...        ...        ...        ...        ...  ...         ...   \n",
              "93451  -0.431911   0.189106   0.178611   0.353429   0.059231  ...    0.055543   \n",
              "93452  -0.226763   0.279756   0.136534   0.210636  -0.047499  ...   -0.086392   \n",
              "93453  -0.392849   0.313611  -0.116709   0.383482  -0.036119  ...    0.028992   \n",
              "93454  -0.504749   0.368706   0.031612   0.569283   0.101934  ...    0.071106   \n",
              "93455  -0.381510   0.281823  -0.106794   0.641973   0.097135  ...    0.125253   \n",
              "\n",
              "       feature_94  feature_95  feature_96  feature_97  feature_98  feature_99  \\\n",
              "0       -0.159770    0.468369    0.346564    0.053775   -0.575963    0.202055   \n",
              "1        0.264588    0.671669    0.287058    0.089154   -0.696850   -0.135784   \n",
              "2        0.144621    0.571358    0.256229    0.019965   -0.636953   -0.006536   \n",
              "3        0.196020    0.696558    0.284364   -0.012427   -0.741037   -0.019430   \n",
              "4       -0.071196    1.172455    0.515726   -0.061136   -0.634418    0.506026   \n",
              "...           ...         ...         ...         ...         ...         ...   \n",
              "93451    0.143617    0.526418    0.269839    0.425712   -0.483061   -0.093054   \n",
              "93452    0.063495    0.859223    0.280609    0.263873   -0.560046    0.083430   \n",
              "93453    0.084331    0.660590    0.285059   -0.085148   -0.642241    0.067873   \n",
              "93454    0.127090    0.851253    0.460726   -0.103199   -0.629326    0.073446   \n",
              "93455    0.349689    0.731295    0.357440   -0.160549   -0.721658   -0.106816   \n",
              "\n",
              "       feature_100       Age  State  \n",
              "0         0.013086  49.00000     17  \n",
              "1         0.029446  37.48389     23  \n",
              "2         0.099358  27.00000     43  \n",
              "3         0.027534  47.00000     24  \n",
              "4        -0.319519  37.48389     17  \n",
              "...            ...       ...    ...  \n",
              "93451     0.309306  57.00000     58  \n",
              "93452    -0.219807  50.00000     23  \n",
              "93453     0.057663  37.48389    121  \n",
              "93454    -0.024774  24.00000     65  \n",
              "93455     0.208603  37.48389     98  \n",
              "\n",
              "[93456 rows x 107 columns]"
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-5227500b-b8df-4880-9804-eb5f92b1bf7b\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>User-ID</th>\n",
              "      <th>Book-Rating</th>\n",
              "      <th>page_count</th>\n",
              "      <th>categories</th>\n",
              "      <th>Year-Of-Publication</th>\n",
              "      <th>feature_1</th>\n",
              "      <th>feature_2</th>\n",
              "      <th>feature_3</th>\n",
              "      <th>feature_4</th>\n",
              "      <th>feature_5</th>\n",
              "      <th>...</th>\n",
              "      <th>feature_93</th>\n",
              "      <th>feature_94</th>\n",
              "      <th>feature_95</th>\n",
              "      <th>feature_96</th>\n",
              "      <th>feature_97</th>\n",
              "      <th>feature_98</th>\n",
              "      <th>feature_99</th>\n",
              "      <th>feature_100</th>\n",
              "      <th>Age</th>\n",
              "      <th>State</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>68436</td>\n",
              "      <td>8</td>\n",
              "      <td>706.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1996</td>\n",
              "      <td>-0.324090</td>\n",
              "      <td>0.178090</td>\n",
              "      <td>0.085679</td>\n",
              "      <td>0.051699</td>\n",
              "      <td>-0.233513</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.040599</td>\n",
              "      <td>-0.159770</td>\n",
              "      <td>0.468369</td>\n",
              "      <td>0.346564</td>\n",
              "      <td>0.053775</td>\n",
              "      <td>-0.575963</td>\n",
              "      <td>0.202055</td>\n",
              "      <td>0.013086</td>\n",
              "      <td>49.00000</td>\n",
              "      <td>17</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>216829</td>\n",
              "      <td>5</td>\n",
              "      <td>224.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1999</td>\n",
              "      <td>-0.265439</td>\n",
              "      <td>0.180581</td>\n",
              "      <td>-0.044998</td>\n",
              "      <td>0.521798</td>\n",
              "      <td>0.064341</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.067668</td>\n",
              "      <td>0.264588</td>\n",
              "      <td>0.671669</td>\n",
              "      <td>0.287058</td>\n",
              "      <td>0.089154</td>\n",
              "      <td>-0.696850</td>\n",
              "      <td>-0.135784</td>\n",
              "      <td>0.029446</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>23</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>153718</td>\n",
              "      <td>7</td>\n",
              "      <td>234.0</td>\n",
              "      <td>330</td>\n",
              "      <td>2001</td>\n",
              "      <td>-0.353918</td>\n",
              "      <td>0.205880</td>\n",
              "      <td>0.004314</td>\n",
              "      <td>0.376427</td>\n",
              "      <td>-0.038735</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.062447</td>\n",
              "      <td>0.144621</td>\n",
              "      <td>0.571358</td>\n",
              "      <td>0.256229</td>\n",
              "      <td>0.019965</td>\n",
              "      <td>-0.636953</td>\n",
              "      <td>-0.006536</td>\n",
              "      <td>0.099358</td>\n",
              "      <td>27.00000</td>\n",
              "      <td>43</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>62862</td>\n",
              "      <td>5</td>\n",
              "      <td>682.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1996</td>\n",
              "      <td>-0.372134</td>\n",
              "      <td>0.323817</td>\n",
              "      <td>-0.150502</td>\n",
              "      <td>0.530034</td>\n",
              "      <td>0.088527</td>\n",
              "      <td>...</td>\n",
              "      <td>0.045399</td>\n",
              "      <td>0.196020</td>\n",
              "      <td>0.696558</td>\n",
              "      <td>0.284364</td>\n",
              "      <td>-0.012427</td>\n",
              "      <td>-0.741037</td>\n",
              "      <td>-0.019430</td>\n",
              "      <td>0.027534</td>\n",
              "      <td>47.00000</td>\n",
              "      <td>24</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>17003</td>\n",
              "      <td>10</td>\n",
              "      <td>295.0</td>\n",
              "      <td>330</td>\n",
              "      <td>2002</td>\n",
              "      <td>-0.439820</td>\n",
              "      <td>0.646338</td>\n",
              "      <td>0.074526</td>\n",
              "      <td>0.534048</td>\n",
              "      <td>0.210026</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.010307</td>\n",
              "      <td>-0.071196</td>\n",
              "      <td>1.172455</td>\n",
              "      <td>0.515726</td>\n",
              "      <td>-0.061136</td>\n",
              "      <td>-0.634418</td>\n",
              "      <td>0.506026</td>\n",
              "      <td>-0.319519</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>17</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93451</th>\n",
              "      <td>251721</td>\n",
              "      <td>3</td>\n",
              "      <td>388.0</td>\n",
              "      <td>391</td>\n",
              "      <td>2003</td>\n",
              "      <td>-0.431911</td>\n",
              "      <td>0.189106</td>\n",
              "      <td>0.178611</td>\n",
              "      <td>0.353429</td>\n",
              "      <td>0.059231</td>\n",
              "      <td>...</td>\n",
              "      <td>0.055543</td>\n",
              "      <td>0.143617</td>\n",
              "      <td>0.526418</td>\n",
              "      <td>0.269839</td>\n",
              "      <td>0.425712</td>\n",
              "      <td>-0.483061</td>\n",
              "      <td>-0.093054</td>\n",
              "      <td>0.309306</td>\n",
              "      <td>57.00000</td>\n",
              "      <td>58</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93452</th>\n",
              "      <td>275476</td>\n",
              "      <td>8</td>\n",
              "      <td>352.0</td>\n",
              "      <td>500</td>\n",
              "      <td>2002</td>\n",
              "      <td>-0.226763</td>\n",
              "      <td>0.279756</td>\n",
              "      <td>0.136534</td>\n",
              "      <td>0.210636</td>\n",
              "      <td>-0.047499</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.086392</td>\n",
              "      <td>0.063495</td>\n",
              "      <td>0.859223</td>\n",
              "      <td>0.280609</td>\n",
              "      <td>0.263873</td>\n",
              "      <td>-0.560046</td>\n",
              "      <td>0.083430</td>\n",
              "      <td>-0.219807</td>\n",
              "      <td>50.00000</td>\n",
              "      <td>23</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93453</th>\n",
              "      <td>237898</td>\n",
              "      <td>7</td>\n",
              "      <td>368.0</td>\n",
              "      <td>127</td>\n",
              "      <td>2001</td>\n",
              "      <td>-0.392849</td>\n",
              "      <td>0.313611</td>\n",
              "      <td>-0.116709</td>\n",
              "      <td>0.383482</td>\n",
              "      <td>-0.036119</td>\n",
              "      <td>...</td>\n",
              "      <td>0.028992</td>\n",
              "      <td>0.084331</td>\n",
              "      <td>0.660590</td>\n",
              "      <td>0.285059</td>\n",
              "      <td>-0.085148</td>\n",
              "      <td>-0.642241</td>\n",
              "      <td>0.067873</td>\n",
              "      <td>0.057663</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>121</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93454</th>\n",
              "      <td>254</td>\n",
              "      <td>8</td>\n",
              "      <td>496.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1994</td>\n",
              "      <td>-0.504749</td>\n",
              "      <td>0.368706</td>\n",
              "      <td>0.031612</td>\n",
              "      <td>0.569283</td>\n",
              "      <td>0.101934</td>\n",
              "      <td>...</td>\n",
              "      <td>0.071106</td>\n",
              "      <td>0.127090</td>\n",
              "      <td>0.851253</td>\n",
              "      <td>0.460726</td>\n",
              "      <td>-0.103199</td>\n",
              "      <td>-0.629326</td>\n",
              "      <td>0.073446</td>\n",
              "      <td>-0.024774</td>\n",
              "      <td>24.00000</td>\n",
              "      <td>65</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93455</th>\n",
              "      <td>34588</td>\n",
              "      <td>10</td>\n",
              "      <td>372.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1997</td>\n",
              "      <td>-0.381510</td>\n",
              "      <td>0.281823</td>\n",
              "      <td>-0.106794</td>\n",
              "      <td>0.641973</td>\n",
              "      <td>0.097135</td>\n",
              "      <td>...</td>\n",
              "      <td>0.125253</td>\n",
              "      <td>0.349689</td>\n",
              "      <td>0.731295</td>\n",
              "      <td>0.357440</td>\n",
              "      <td>-0.160549</td>\n",
              "      <td>-0.721658</td>\n",
              "      <td>-0.106816</td>\n",
              "      <td>0.208603</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>98</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>93456 rows × 107 columns</p>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-5227500b-b8df-4880-9804-eb5f92b1bf7b')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-5227500b-b8df-4880-9804-eb5f92b1bf7b button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-5227500b-b8df-4880-9804-eb5f92b1bf7b');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 45
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# extracting query information of users for reranker \n",
        "groups = train_features.groupby('User-ID').size().values"
      ],
      "metadata": {
        "id": "4HgyOmGRDNk3"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "train_features = train_features.drop(axis='columns',labels=[\"User-ID\"])"
      ],
      "metadata": {
        "id": "_egrW8Y6DXg6"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "train_features"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 505
        },
        "id": "Kbp1_j9hrT5G",
        "outputId": "ce772e49-786f-419b-8694-cbc0f96be4e3"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "       Book-Rating  page_count  categories  Year-Of-Publication  feature_1  \\\n",
              "0                8       706.0         330                 1996  -0.324090   \n",
              "1                5       224.0         330                 1999  -0.265439   \n",
              "2                7       234.0         330                 2001  -0.353918   \n",
              "3                5       682.0         330                 1996  -0.372134   \n",
              "4               10       295.0         330                 2002  -0.439820   \n",
              "...            ...         ...         ...                  ...        ...   \n",
              "93451            3       388.0         391                 2003  -0.431911   \n",
              "93452            8       352.0         500                 2002  -0.226763   \n",
              "93453            7       368.0         127                 2001  -0.392849   \n",
              "93454            8       496.0         330                 1994  -0.504749   \n",
              "93455           10       372.0         330                 1997  -0.381510   \n",
              "\n",
              "       feature_2  feature_3  feature_4  feature_5  feature_6  ...  feature_93  \\\n",
              "0       0.178090   0.085679   0.051699  -0.233513  -0.268032  ...   -0.040599   \n",
              "1       0.180581  -0.044998   0.521798   0.064341  -0.506745  ...   -0.067668   \n",
              "2       0.205880   0.004314   0.376427  -0.038735  -0.445708  ...   -0.062447   \n",
              "3       0.323817  -0.150502   0.530034   0.088527  -0.456844  ...    0.045399   \n",
              "4       0.646338   0.074526   0.534048   0.210026  -0.484646  ...   -0.010307   \n",
              "...          ...        ...        ...        ...        ...  ...         ...   \n",
              "93451   0.189106   0.178611   0.353429   0.059231  -0.489475  ...    0.055543   \n",
              "93452   0.279756   0.136534   0.210636  -0.047499  -0.658961  ...   -0.086392   \n",
              "93453   0.313611  -0.116709   0.383482  -0.036119  -0.425903  ...    0.028992   \n",
              "93454   0.368706   0.031612   0.569283   0.101934  -0.427562  ...    0.071106   \n",
              "93455   0.281823  -0.106794   0.641973   0.097135  -0.455716  ...    0.125253   \n",
              "\n",
              "       feature_94  feature_95  feature_96  feature_97  feature_98  feature_99  \\\n",
              "0       -0.159770    0.468369    0.346564    0.053775   -0.575963    0.202055   \n",
              "1        0.264588    0.671669    0.287058    0.089154   -0.696850   -0.135784   \n",
              "2        0.144621    0.571358    0.256229    0.019965   -0.636953   -0.006536   \n",
              "3        0.196020    0.696558    0.284364   -0.012427   -0.741037   -0.019430   \n",
              "4       -0.071196    1.172455    0.515726   -0.061136   -0.634418    0.506026   \n",
              "...           ...         ...         ...         ...         ...         ...   \n",
              "93451    0.143617    0.526418    0.269839    0.425712   -0.483061   -0.093054   \n",
              "93452    0.063495    0.859223    0.280609    0.263873   -0.560046    0.083430   \n",
              "93453    0.084331    0.660590    0.285059   -0.085148   -0.642241    0.067873   \n",
              "93454    0.127090    0.851253    0.460726   -0.103199   -0.629326    0.073446   \n",
              "93455    0.349689    0.731295    0.357440   -0.160549   -0.721658   -0.106816   \n",
              "\n",
              "       feature_100       Age  State  \n",
              "0         0.013086  49.00000     17  \n",
              "1         0.029446  37.48389     23  \n",
              "2         0.099358  27.00000     43  \n",
              "3         0.027534  47.00000     24  \n",
              "4        -0.319519  37.48389     17  \n",
              "...            ...       ...    ...  \n",
              "93451     0.309306  57.00000     58  \n",
              "93452    -0.219807  50.00000     23  \n",
              "93453     0.057663  37.48389    121  \n",
              "93454    -0.024774  24.00000     65  \n",
              "93455     0.208603  37.48389     98  \n",
              "\n",
              "[93456 rows x 106 columns]"
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-5d2b3429-52bd-4d64-a79d-3244f7a17af3\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Book-Rating</th>\n",
              "      <th>page_count</th>\n",
              "      <th>categories</th>\n",
              "      <th>Year-Of-Publication</th>\n",
              "      <th>feature_1</th>\n",
              "      <th>feature_2</th>\n",
              "      <th>feature_3</th>\n",
              "      <th>feature_4</th>\n",
              "      <th>feature_5</th>\n",
              "      <th>feature_6</th>\n",
              "      <th>...</th>\n",
              "      <th>feature_93</th>\n",
              "      <th>feature_94</th>\n",
              "      <th>feature_95</th>\n",
              "      <th>feature_96</th>\n",
              "      <th>feature_97</th>\n",
              "      <th>feature_98</th>\n",
              "      <th>feature_99</th>\n",
              "      <th>feature_100</th>\n",
              "      <th>Age</th>\n",
              "      <th>State</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>8</td>\n",
              "      <td>706.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1996</td>\n",
              "      <td>-0.324090</td>\n",
              "      <td>0.178090</td>\n",
              "      <td>0.085679</td>\n",
              "      <td>0.051699</td>\n",
              "      <td>-0.233513</td>\n",
              "      <td>-0.268032</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.040599</td>\n",
              "      <td>-0.159770</td>\n",
              "      <td>0.468369</td>\n",
              "      <td>0.346564</td>\n",
              "      <td>0.053775</td>\n",
              "      <td>-0.575963</td>\n",
              "      <td>0.202055</td>\n",
              "      <td>0.013086</td>\n",
              "      <td>49.00000</td>\n",
              "      <td>17</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>5</td>\n",
              "      <td>224.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1999</td>\n",
              "      <td>-0.265439</td>\n",
              "      <td>0.180581</td>\n",
              "      <td>-0.044998</td>\n",
              "      <td>0.521798</td>\n",
              "      <td>0.064341</td>\n",
              "      <td>-0.506745</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.067668</td>\n",
              "      <td>0.264588</td>\n",
              "      <td>0.671669</td>\n",
              "      <td>0.287058</td>\n",
              "      <td>0.089154</td>\n",
              "      <td>-0.696850</td>\n",
              "      <td>-0.135784</td>\n",
              "      <td>0.029446</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>23</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>7</td>\n",
              "      <td>234.0</td>\n",
              "      <td>330</td>\n",
              "      <td>2001</td>\n",
              "      <td>-0.353918</td>\n",
              "      <td>0.205880</td>\n",
              "      <td>0.004314</td>\n",
              "      <td>0.376427</td>\n",
              "      <td>-0.038735</td>\n",
              "      <td>-0.445708</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.062447</td>\n",
              "      <td>0.144621</td>\n",
              "      <td>0.571358</td>\n",
              "      <td>0.256229</td>\n",
              "      <td>0.019965</td>\n",
              "      <td>-0.636953</td>\n",
              "      <td>-0.006536</td>\n",
              "      <td>0.099358</td>\n",
              "      <td>27.00000</td>\n",
              "      <td>43</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>5</td>\n",
              "      <td>682.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1996</td>\n",
              "      <td>-0.372134</td>\n",
              "      <td>0.323817</td>\n",
              "      <td>-0.150502</td>\n",
              "      <td>0.530034</td>\n",
              "      <td>0.088527</td>\n",
              "      <td>-0.456844</td>\n",
              "      <td>...</td>\n",
              "      <td>0.045399</td>\n",
              "      <td>0.196020</td>\n",
              "      <td>0.696558</td>\n",
              "      <td>0.284364</td>\n",
              "      <td>-0.012427</td>\n",
              "      <td>-0.741037</td>\n",
              "      <td>-0.019430</td>\n",
              "      <td>0.027534</td>\n",
              "      <td>47.00000</td>\n",
              "      <td>24</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>10</td>\n",
              "      <td>295.0</td>\n",
              "      <td>330</td>\n",
              "      <td>2002</td>\n",
              "      <td>-0.439820</td>\n",
              "      <td>0.646338</td>\n",
              "      <td>0.074526</td>\n",
              "      <td>0.534048</td>\n",
              "      <td>0.210026</td>\n",
              "      <td>-0.484646</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.010307</td>\n",
              "      <td>-0.071196</td>\n",
              "      <td>1.172455</td>\n",
              "      <td>0.515726</td>\n",
              "      <td>-0.061136</td>\n",
              "      <td>-0.634418</td>\n",
              "      <td>0.506026</td>\n",
              "      <td>-0.319519</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>17</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93451</th>\n",
              "      <td>3</td>\n",
              "      <td>388.0</td>\n",
              "      <td>391</td>\n",
              "      <td>2003</td>\n",
              "      <td>-0.431911</td>\n",
              "      <td>0.189106</td>\n",
              "      <td>0.178611</td>\n",
              "      <td>0.353429</td>\n",
              "      <td>0.059231</td>\n",
              "      <td>-0.489475</td>\n",
              "      <td>...</td>\n",
              "      <td>0.055543</td>\n",
              "      <td>0.143617</td>\n",
              "      <td>0.526418</td>\n",
              "      <td>0.269839</td>\n",
              "      <td>0.425712</td>\n",
              "      <td>-0.483061</td>\n",
              "      <td>-0.093054</td>\n",
              "      <td>0.309306</td>\n",
              "      <td>57.00000</td>\n",
              "      <td>58</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93452</th>\n",
              "      <td>8</td>\n",
              "      <td>352.0</td>\n",
              "      <td>500</td>\n",
              "      <td>2002</td>\n",
              "      <td>-0.226763</td>\n",
              "      <td>0.279756</td>\n",
              "      <td>0.136534</td>\n",
              "      <td>0.210636</td>\n",
              "      <td>-0.047499</td>\n",
              "      <td>-0.658961</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.086392</td>\n",
              "      <td>0.063495</td>\n",
              "      <td>0.859223</td>\n",
              "      <td>0.280609</td>\n",
              "      <td>0.263873</td>\n",
              "      <td>-0.560046</td>\n",
              "      <td>0.083430</td>\n",
              "      <td>-0.219807</td>\n",
              "      <td>50.00000</td>\n",
              "      <td>23</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93453</th>\n",
              "      <td>7</td>\n",
              "      <td>368.0</td>\n",
              "      <td>127</td>\n",
              "      <td>2001</td>\n",
              "      <td>-0.392849</td>\n",
              "      <td>0.313611</td>\n",
              "      <td>-0.116709</td>\n",
              "      <td>0.383482</td>\n",
              "      <td>-0.036119</td>\n",
              "      <td>-0.425903</td>\n",
              "      <td>...</td>\n",
              "      <td>0.028992</td>\n",
              "      <td>0.084331</td>\n",
              "      <td>0.660590</td>\n",
              "      <td>0.285059</td>\n",
              "      <td>-0.085148</td>\n",
              "      <td>-0.642241</td>\n",
              "      <td>0.067873</td>\n",
              "      <td>0.057663</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>121</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93454</th>\n",
              "      <td>8</td>\n",
              "      <td>496.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1994</td>\n",
              "      <td>-0.504749</td>\n",
              "      <td>0.368706</td>\n",
              "      <td>0.031612</td>\n",
              "      <td>0.569283</td>\n",
              "      <td>0.101934</td>\n",
              "      <td>-0.427562</td>\n",
              "      <td>...</td>\n",
              "      <td>0.071106</td>\n",
              "      <td>0.127090</td>\n",
              "      <td>0.851253</td>\n",
              "      <td>0.460726</td>\n",
              "      <td>-0.103199</td>\n",
              "      <td>-0.629326</td>\n",
              "      <td>0.073446</td>\n",
              "      <td>-0.024774</td>\n",
              "      <td>24.00000</td>\n",
              "      <td>65</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>93455</th>\n",
              "      <td>10</td>\n",
              "      <td>372.0</td>\n",
              "      <td>330</td>\n",
              "      <td>1997</td>\n",
              "      <td>-0.381510</td>\n",
              "      <td>0.281823</td>\n",
              "      <td>-0.106794</td>\n",
              "      <td>0.641973</td>\n",
              "      <td>0.097135</td>\n",
              "      <td>-0.455716</td>\n",
              "      <td>...</td>\n",
              "      <td>0.125253</td>\n",
              "      <td>0.349689</td>\n",
              "      <td>0.731295</td>\n",
              "      <td>0.357440</td>\n",
              "      <td>-0.160549</td>\n",
              "      <td>-0.721658</td>\n",
              "      <td>-0.106816</td>\n",
              "      <td>0.208603</td>\n",
              "      <td>37.48389</td>\n",
              "      <td>98</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>93456 rows × 106 columns</p>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-5d2b3429-52bd-4d64-a79d-3244f7a17af3')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-5d2b3429-52bd-4d64-a79d-3244f7a17af3 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-5d2b3429-52bd-4d64-a79d-3244f7a17af3');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 48
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Splitting Features and rating into seperate frames\n",
        "y_train = train_features.iloc[:,1]\n",
        "x_train = train_features.iloc[:,2:]\n"
      ],
      "metadata": {
        "id": "-3pf-0sEraSF"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Converting Data into preferable ranking\n",
        "\n",
        "ratings = y_train\n",
        "ratings_scaled = (ratings - 1) / 9\n",
        "\n",
        "# Convert scaled ratings to ranks\n",
        "ranks = scipy.stats.rankdata(-ratings_scaled, method='ordinal')\n",
        "\n",
        "# Update target variable with ranks\n",
        "Y_train = ranks.astype(int)\n",
        "\n"
      ],
      "metadata": {
        "id": "2NSyP2KM0bCX"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Test Set Features"
      ],
      "metadata": {
        "id": "mXZK3KU2pXos"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Performing all same process that were done with Training Data \n",
        "\n",
        "test_features = test.merge(datas,on=\"ISBN\",how=\"left\")\n",
        "test_features = test_features.merge(users,on=\"User-ID\",how=\"left\")\n",
        "test_features[\"State\"]= ''\n",
        "for i in range(len(test_features)):\n",
        "  xxx=(test_features[\"Location\"].iloc[i]).split(\",\")\n",
        "  test_features[\"State\"].iloc[i] = xxx[1]\n",
        "mean_value=test_features['Age'].mean()\n",
        "test_features[\"Age\"].fillna(value=mean_value, inplace=True)\n",
        "test_features=test_features.drop(axis='columns',labels=[\"Unnamed: 0\",\"Location\",\"country\",\"ISBN\",\"Book-Title\",\"book_name\",\"Synopsis\",\"Book-Author\",\"Publisher\"])\n",
        "test_features['State'] = le.fit_transform(test_features['State'])\n",
        "test_features['categories'] = le.fit_transform(test_features['categories'])\n",
        "test_features = test_features.drop(axis='columns',labels=[\"User-ID\"])\n",
        "y_test = test_features.iloc[:,1]\n",
        "x_test = test_features.iloc[:,2:]\n",
        "ratings = y_test\n",
        "ratings_scaled = (ratings - 1) / 9\n",
        "\n",
        "# Convert scaled ratings to ranks\n",
        "ranks = scipy.stats.rankdata(-ratings_scaled, method='ordinal')\n",
        "\n",
        "# Update target variable with ranks\n",
        "Y_test = ranks.astype(int)\n"
      ],
      "metadata": {
        "id": "8AmdsiXDpaCf"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Training the ranker"
      ],
      "metadata": {
        "id": "zJKUcjrjlHZG"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "from xgboost import XGBRanker\n",
        "model = XGBRanker(\n",
        "    objective='rank:ndcg',\n",
        "    learning_rate=0.05,\n",
        "    n_estimators=100,\n",
        "    max_depth=6,\n",
        "    reg_lambda=1,\n",
        "    gamma=0,\n",
        "    min_child_weight=1,\n",
        "    subsample=0.8,\n",
        "    colsample_bytree=0.8,\n",
        "    eval_metric=['ndcg'],\n",
        "    verbosity=0,\n",
        "    random_state=42\n",
        ")\n",
        "\n",
        "model.fit(x_train, Y_train, group=groups)"
      ],
      "metadata": {
        "id": "kDB1sBsBqlKz",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 231
        },
        "outputId": "ca6a0920-6726-44bb-ce30-055b45c5b5ad"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "XGBRanker(base_score=None, booster=None, callbacks=None, colsample_bylevel=None,\n",
              "          colsample_bynode=None, colsample_bytree=0.8,\n",
              "          early_stopping_rounds=None, enable_categorical=False,\n",
              "          eval_metric=['ndcg'], feature_types=None, gamma=0, gpu_id=None,\n",
              "          grow_policy=None, importance_type=None, interaction_constraints=None,\n",
              "          learning_rate=0.05, max_bin=None, max_cat_threshold=None,\n",
              "          max_cat_to_onehot=None, max_delta_step=None, max_depth=6,\n",
              "          max_leaves=None, min_child_weight=1, missing=nan,\n",
              "          monotone_constraints=None, n_estimators=100, n_jobs=None,\n",
              "          num_parallel_tree=None, objective='rank:ndcg', predictor=None, ...)"
            ],
            "text/html": [
              "<style>#sk-container-id-2 {color: black;background-color: white;}#sk-container-id-2 pre{padding: 0;}#sk-container-id-2 div.sk-toggleable {background-color: white;}#sk-container-id-2 label.sk-toggleable__label {cursor: pointer;display: block;width: 100%;margin-bottom: 0;padding: 0.3em;box-sizing: border-box;text-align: center;}#sk-container-id-2 label.sk-toggleable__label-arrow:before {content: \"▸\";float: left;margin-right: 0.25em;color: #696969;}#sk-container-id-2 label.sk-toggleable__label-arrow:hover:before {color: black;}#sk-container-id-2 div.sk-estimator:hover label.sk-toggleable__label-arrow:before {color: black;}#sk-container-id-2 div.sk-toggleable__content {max-height: 0;max-width: 0;overflow: hidden;text-align: left;background-color: #f0f8ff;}#sk-container-id-2 div.sk-toggleable__content pre {margin: 0.2em;color: black;border-radius: 0.25em;background-color: #f0f8ff;}#sk-container-id-2 input.sk-toggleable__control:checked~div.sk-toggleable__content {max-height: 200px;max-width: 100%;overflow: auto;}#sk-container-id-2 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {content: \"▾\";}#sk-container-id-2 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-2 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-2 input.sk-hidden--visually {border: 0;clip: rect(1px 1px 1px 1px);clip: rect(1px, 1px, 1px, 1px);height: 1px;margin: -1px;overflow: hidden;padding: 0;position: absolute;width: 1px;}#sk-container-id-2 div.sk-estimator {font-family: monospace;background-color: #f0f8ff;border: 1px dotted black;border-radius: 0.25em;box-sizing: border-box;margin-bottom: 0.5em;}#sk-container-id-2 div.sk-estimator:hover {background-color: #d4ebff;}#sk-container-id-2 div.sk-parallel-item::after {content: \"\";width: 100%;border-bottom: 1px solid gray;flex-grow: 1;}#sk-container-id-2 div.sk-label:hover label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-2 div.sk-serial::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: 0;}#sk-container-id-2 div.sk-serial {display: flex;flex-direction: column;align-items: center;background-color: white;padding-right: 0.2em;padding-left: 0.2em;position: relative;}#sk-container-id-2 div.sk-item {position: relative;z-index: 1;}#sk-container-id-2 div.sk-parallel {display: flex;align-items: stretch;justify-content: center;background-color: white;position: relative;}#sk-container-id-2 div.sk-item::before, #sk-container-id-2 div.sk-parallel-item::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: -1;}#sk-container-id-2 div.sk-parallel-item {display: flex;flex-direction: column;z-index: 1;position: relative;background-color: white;}#sk-container-id-2 div.sk-parallel-item:first-child::after {align-self: flex-end;width: 50%;}#sk-container-id-2 div.sk-parallel-item:last-child::after {align-self: flex-start;width: 50%;}#sk-container-id-2 div.sk-parallel-item:only-child::after {width: 0;}#sk-container-id-2 div.sk-dashed-wrapped {border: 1px dashed gray;margin: 0 0.4em 0.5em 0.4em;box-sizing: border-box;padding-bottom: 0.4em;background-color: white;}#sk-container-id-2 div.sk-label label {font-family: monospace;font-weight: bold;display: inline-block;line-height: 1.2em;}#sk-container-id-2 div.sk-label-container {text-align: center;}#sk-container-id-2 div.sk-container {/* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */display: inline-block !important;position: relative;}#sk-container-id-2 div.sk-text-repr-fallback {display: none;}</style><div id=\"sk-container-id-2\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>XGBRanker(base_score=None, booster=None, callbacks=None, colsample_bylevel=None,\n",
              "          colsample_bynode=None, colsample_bytree=0.8,\n",
              "          early_stopping_rounds=None, enable_categorical=False,\n",
              "          eval_metric=[&#x27;ndcg&#x27;], feature_types=None, gamma=0, gpu_id=None,\n",
              "          grow_policy=None, importance_type=None, interaction_constraints=None,\n",
              "          learning_rate=0.05, max_bin=None, max_cat_threshold=None,\n",
              "          max_cat_to_onehot=None, max_delta_step=None, max_depth=6,\n",
              "          max_leaves=None, min_child_weight=1, missing=nan,\n",
              "          monotone_constraints=None, n_estimators=100, n_jobs=None,\n",
              "          num_parallel_tree=None, objective=&#x27;rank:ndcg&#x27;, predictor=None, ...)</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item\"><div class=\"sk-estimator sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-2\" type=\"checkbox\" checked><label for=\"sk-estimator-id-2\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">XGBRanker</label><div class=\"sk-toggleable__content\"><pre>XGBRanker(base_score=None, booster=None, callbacks=None, colsample_bylevel=None,\n",
              "          colsample_bynode=None, colsample_bytree=0.8,\n",
              "          early_stopping_rounds=None, enable_categorical=False,\n",
              "          eval_metric=[&#x27;ndcg&#x27;], feature_types=None, gamma=0, gpu_id=None,\n",
              "          grow_policy=None, importance_type=None, interaction_constraints=None,\n",
              "          learning_rate=0.05, max_bin=None, max_cat_threshold=None,\n",
              "          max_cat_to_onehot=None, max_delta_step=None, max_depth=6,\n",
              "          max_leaves=None, min_child_weight=1, missing=nan,\n",
              "          monotone_constraints=None, n_estimators=100, n_jobs=None,\n",
              "          num_parallel_tree=None, objective=&#x27;rank:ndcg&#x27;, predictor=None, ...)</pre></div></div></div></div></div>"
            ]
          },
          "metadata": {},
          "execution_count": 53
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Hyperparameters information"
      ],
      "metadata": {
        "id": "e8jaSB14U4Gp"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "**objective**='rank:ndcg'  # The ranking objective function to optimize. 'rank:ndcg' optimizes NDCG.\n",
        "\n",
        "**learning_rate**=0.05  # The learning rate for gradient boosting. Controls the step size during updates.\n",
        "\n",
        "**n_estimators**=100  # The number of trees in the ensemble.\n",
        "\n",
        "**max_depth**=6  # The maximum depth of each tree in the ensemble.\n",
        "\n",
        "**reg_lambda**=1  # L2 regularization term on weights.\n",
        "\n",
        "**gamma**=0  # Minimum loss reduction required to make a further partition on a leaf node of the tree.\n",
        "\n",
        "**min_child_weight**=1  # Minimum sum of instance weight needed in a child.\n",
        "\n",
        "**subsample**=0.8  # Subsample ratio of the training instances.\n",
        "\n",
        "**colsample_bytree**=0.8  # Subsample ratio of columns when constructing each tree.\n",
        "\n",
        "**eval_metric**=['ndcg']  # Evaluation metric used to monitor model performance during training. 'ndcg' is the metric used to optimize the objective function.\n",
        "\n",
        "**verbosity**=0  # Verbosity level of printing messages. 0 means silent.\n",
        "\n",
        "**random_state**=42  # Seed used by the random number generator.\n"
      ],
      "metadata": {
        "id": "AwClneTUU2gT"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Evaluating Model"
      ],
      "metadata": {
        "id": "gHs28J2pUkGG"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def ndcg(y_true, y_pred, k=10):\n",
        "    ideal_ranking = np.argsort(y_true)[::-1]\n",
        "    ideal_dcg = np.sum((2**y_true[ideal_ranking[:k]] - 1) / np.log2(np.arange(2, k+2)))\n",
        "    pred_ranking = np.argsort(y_pred)[::-1]\n",
        "    pred_dcg = np.sum((2**y_true[pred_ranking[:k]] - 1) / np.log2(np.arange(2, k+2)))\n",
        "    ndcg = pred_dcg / ideal_dcg\n",
        "    return ndcg, "
      ],
      "metadata": {
        "id": "PG6rnBpjud-K"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Evaluate model on test data\n",
        "y_pred = model.predict(x_train)\n",
        "ndcg_scores = ndcg(Y_train, y_pred, k=10)\n",
        "\n",
        "ndcg_scores"
      ],
      "metadata": {
        "id": "QfiZdCPoqT3d",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "c53c8953-a9fa-4cb9-bbb7-ab27d1f20ed7"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(1.0,)"
            ]
          },
          "metadata": {},
          "execution_count": 56
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Evaluate model on test data\n",
        "y_preds= model.predict(x_test)\n",
        "ndcg_scores1 = ndcg(Y_test, y_preds, k=10)\n",
        "ndcg_scores1"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "lfsfb_1ywodE",
        "outputId": "ceae61d0-e385-47f0-a5af-eac6a0765788"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(1.0,)"
            ]
          },
          "metadata": {},
          "execution_count": 57
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Saving the Reranker Model"
      ],
      "metadata": {
        "id": "-QKZy6hKUoDD"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "with open('/content/drive/MyDrive/RS Data/Assignment 3/Processed_data/XGB_Ranker.pkl', 'wb') as file:\n",
        "    pickle.dump(model, file)"
      ],
      "metadata": {
        "id": "Xw7Bm24VypGC"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "from joblib import dump, load\n",
        "dump(le, '/content/drive/MyDrive/RS Data/Assignment 3/Processed_data/label_encoder.joblib')"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "CbX_JBNvy6Pt",
        "outputId": "f71477cc-7b77-4365-9237-4059870e2916"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['/content/drive/MyDrive/RS Data/Assignment 3/Processed_data/label_encoder.joblib']"
            ]
          },
          "metadata": {},
          "execution_count": 61
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "**Note**: LambdaRank and XGBRanker both use gradient boosting to optimize the ranking objective function. The difference between them is the way they calculate the gradient and update the model parameters during training. LambdaRank calculates gradients based on the gradient of NDCG with respect to the predicted scores, while XGBRanker calculates gradients based on pairwise comparisons between documents"
      ],
      "metadata": {
        "id": "DJZA-245UXHR"
      }
    }
  ]
}