Steepest_Descent_Search_Gradient_Descent.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Steepest_Descent_Search_Gradient_Descent.ipynb",
      "provenance": [],
      "authorship_tag": "ABX9TyMirLGseRfVgVL+kvNGQd4w",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/AjayKadoula/Mtech_Lab_1/blob/main/Steepest_Descent_Search_Gradient_Descent.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "v1Vl-hSP3Fzw"
      },
      "source": [
        "**Steepest Descent Search( Gradient Descent)**\r\n",
        "\r\n",
        "Gradient descent is an optimization algorithm used to minimize some function by iteratively moving in the direction of steepest descent as defined by the negative of the gradient. In machine learning, we use gradient descent to update the parameters of our model. Parameters refer to coefficients in Linear Regression and weights in neural networks.\r\n",
        "\r\n",
        "\r\n",
        "Gradient Descent is the most common optimization algorithm in machine learning and deep learning. It is a first-order optimization algorithm. This means it only takes into account the first derivative when performing the updates on the parameters. On each iteration, we update the parameters in the opposite direction of the gradient of the objective function J(w) w.r.t the parameters where the gradient gives the direction of the steepest ascent. The size of the step we take on each iteration to reach the local minimum is determined by the learning rate α. Therefore, we follow the direction of the slope downhill until we reach a local minimum."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "IUIIYz2G5gE_"
      },
      "source": [
        "# **ALGORITHM :**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "MYsnJfiN4-Oq"
      },
      "source": [
        "def f(x,w,b):\r\n",
        "    '''Sigmoid Function'''\r\n",
        "    f = 1/(1+np.exp(-(w*x+b)))\r\n",
        "    return f\r\n",
        "def mse(x,y,w,b):\r\n",
        "    '''Mean Squared Loss Function'''\r\n",
        "    L = 0.0\r\n",
        "    for i in range(x.shape[0]):\r\n",
        "        L += 0.5*(y[i]-f(x[i],w,b))**2\r\n",
        "    return L\r\n",
        "def cross_entropy(x,y,w,b):\r\n",
        "    '''Cross Entropy Loss Function'''\r\n",
        "    L = 0.0\r\n",
        "    for i in range(x.shape[0]):\r\n",
        "        L += -(y[i]*np.log(f(x[i],w,b)))\r\n",
        "    return L\r\n",
        "def grad_w_mse(x,y,w,b):\r\n",
        "    fx = f(x,w,b) \r\n",
        "    dw = (fx - y)*fx*(1-fx)*x\r\n",
        "    return dw\r\n",
        "def grad_b_mse(x,y,w,b):\r\n",
        "    fx = f(x,w,b) \r\n",
        "    db = (fx - y)*fx*(1-fx)\r\n",
        "    return db\r\n",
        "def grad_w_cross(x,y,w,b):\r\n",
        "    fx = f(x,w,b) \r\n",
        "    dw = (- y)*(1-fx)*x\r\n",
        "    return dw\r\n",
        "def grad_b_cross(x,y,w,b):\r\n",
        "    fx = f(x,w,b) \r\n",
        "    db = (- y)*(1-fx)\r\n",
        "    return db\r\n",
        "\r\n",
        "#Algorithm\r\n",
        "#Gradient Discent\r\n",
        "def Line_search_GD(x,y,epochs,batch_size,loss,lr_list):\r\n",
        "    w = np.random.randn()\r\n",
        "    b = np.random.randn()\r\n",
        "    l_list = []\r\n",
        "    w_list = []\r\n",
        "    b_list = []\r\n",
        "    points = 0\r\n",
        "    ep = [i for i in range(epochs+1)]\r\n",
        "    dw,db = 0,0\r\n",
        "    for i in range(epochs+1):\r\n",
        "        dw,db = 0,0\r\n",
        "        for j in range(x.shape[0]):\r\n",
        "            if (loss == 'mse'):\r\n",
        "                dw += grad_w_mse(x[j],y[j],w,b)\r\n",
        "                db += grad_b_mse(x[j],y[j],w,b)\r\n",
        "            elif (loss == 'cross_entropy'):\r\n",
        "                dw += grad_w_cross(x[j],y[j],w,b)\r\n",
        "                db += grad_b_cross(x[j],y[j],w,b)\r\n",
        "            points += 1\r\n",
        "            if(points % batch_size == 0):\r\n",
        "                best_w,best_b = w,b\r\n",
        "                min_loss = 10000\r\n",
        "                for i in range(len(lr_list)):\r\n",
        "                    tmp_w = w - lr_list[i]*dw\r\n",
        "                    tmp_b = b - lr_list[i]*db\r\n",
        "                    if (loss == 'mse'):\r\n",
        "                        loss = mse(x,y,tmp_w,tmp_b)[0]\r\n",
        "                    elif (loss == 'cross_entropy'):\r\n",
        "                        loss = cross_entropy(x,y,tmp_w,tmp_b)[0]\r\n",
        "                    if (loss<min_loss):\r\n",
        "                        min_loss = loss\r\n",
        "                        best_w,best_b = tmp_w,tmp_b\r\n",
        "                w,b = best_w,best_b\r\n",
        "                dw,db = 0,0\r\n",
        "        if (loss == 'mse'):\r\n",
        "            print('Loss after {}th epoch = {}\\n'.format(i,mse(x,y,w,b)[0]))\r\n",
        "            l_list.append(mse(x,y,w,b)[0])\r\n",
        "        elif (loss == 'cross_entropy'):\r\n",
        "            print('Loss after {}th epoch = {}\\n'.format(i,cross_entropy(x,y,w,b)[0]))\r\n",
        "            l_list.append(cross_entropy(x,y,w,b)[0])\r\n",
        "        w_list.append(w[0])\r\n",
        "        b_list.append(b[0])\r\n",
        "    plt.xlabel('Epochs')\r\n",
        "    plt.ylabel('Loss')\r\n",
        "    plt.title('Loss vs Epoch Curve\\nAlgotithm :Line Search Mini Batch Gradient Decent\\nBatch Size = {}\\nLoss Function = {}'.format(batch_size,loss))\r\n",
        "    #plt.plot(ep,l_list)\r\n",
        "    #plt.show()\r\n",
        "    return w_list,b_list"
      ],
      "execution_count": 6,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "4Qutnju33ZWH",
        "outputId": "c72d5e98-a7c5-458a-f994-9911fb55b7f9"
      },
      "source": [
        "import numpy as np\r\n",
        "from numpy import *\r\n",
        "import numpy.linalg as linalg\r\n",
        "import scipy.optimize as optimize\r\n",
        "def loss(x, w, t):\r\n",
        "    N, D = np.shape(x)\r\n",
        "    y = np.matmul(x,w)\r\n",
        "    loss = (y - t)\r\n",
        "    return loss\r\n",
        "\r\n",
        "def cost(x,w, t):\r\n",
        "    '''\r\n",
        "    Evaluate the cost function in a vectorized manner for \r\n",
        "    inputs `x` and targets `t`, at weights `w1`, `w2` and `b`.\r\n",
        "    '''\r\n",
        "    N, D = np.shape(x)\r\n",
        "    return (loss(x, w,t) **2).sum() / (2.0 * 5)\r\n",
        "def getGradient(x, w, t):\r\n",
        "    N, D = np.shape(x)\r\n",
        "    gradient = (2) * np.matmul(x.T, loss(x,w,t))\r\n",
        "    return gradient\r\n",
        "\r\n",
        "def getGradient(x, w, t):\r\n",
        "    N, D = np.shape(x)\r\n",
        "    gradient = (1.0/ float(N)) * np.matmul(np.transpose(x), loss(x,w,t))\r\n",
        "    return gradient\r\n",
        "\r\n",
        "\r\n",
        "def gradientDescentMethod(x, t, alpha=0.1, tolerance=1e-2):\r\n",
        "    N, D = np.shape(x)\r\n",
        "    #w = np.random.randn(D)\r\n",
        "    w = np.zeros([D])\r\n",
        "    # Perform Gradient Descent\r\n",
        "    iterations = 1\r\n",
        "    w_cost = [(w, cost(x,w, t))]\r\n",
        "    while True:\r\n",
        "        dw = getGradient(x, w, t)\r\n",
        "        w_k = w - alpha * dw\r\n",
        "        w_cost.append((w, cost(x, w, t)))\r\n",
        "        # Stopping Condition\r\n",
        "        if np.sum(abs(w_k - w)) < tolerance :\r\n",
        "            print (\"Converged.\")\r\n",
        "            break\r\n",
        "        if iterations % 100 == 0:\r\n",
        "            print (\"Iteration: %d - cost: %.4f\" %(iterations, cost(x, w, t)))\r\n",
        "        iterations += 1\r\n",
        "        w = w_k\r\n",
        "    return  w, w_cost\r\n",
        "x = np.array([[1,1,1,1,1],[1,2,4,8,16],[1,3,9,27,81],[1,4,16,64,256],[1,5,25,125,625]])\r\n",
        "t = np.array([[5],[31],[121],[341],[781]])\r\n",
        "print(gradientDescentMethod(x,t))"
      ],
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:17: RuntimeWarning: overflow encountered in square\n",
            "/usr/local/lib/python3.6/dist-packages/numpy/core/_methods.py:47: RuntimeWarning: overflow encountered in reduce\n",
            "  return umr_sum(a, axis, dtype, out, keepdims, initial, where)\n",
            "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:25: RuntimeWarning: overflow encountered in matmul\n",
            "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:7: RuntimeWarning: overflow encountered in matmul\n",
            "  import sys\n",
            "/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:38: RuntimeWarning: invalid value encountered in subtract\n"
          ],
          "name": "stderr"
        },
        {
          "output_type": "stream",
          "text": [
            "Iteration: 100 - cost: nan\n",
            "Iteration: 200 - cost: nan\n",
            "Iteration: 300 - cost: nan\n",
            "Iteration: 400 - cost: nan\n",
            "Iteration: 500 - cost: nan\n",
            "Iteration: 600 - cost: nan\n",
            "Iteration: 700 - cost: nan\n",
            "Iteration: 800 - cost: nan\n",
            "Iteration: 900 - cost: nan\n",
            "Iteration: 1000 - cost: nan\n",
            "Iteration: 1100 - cost: nan\n",
            "Iteration: 1200 - cost: nan\n",
            "Iteration: 1300 - cost: nan\n",
            "Iteration: 1400 - cost: nan\n",
            "Iteration: 1500 - cost: nan\n",
            "Iteration: 1600 - cost: nan\n",
            "Iteration: 1700 - cost: nan\n",
            "Iteration: 1800 - cost: nan\n",
            "Iteration: 1900 - cost: nan\n",
            "Iteration: 2000 - cost: nan\n",
            "Iteration: 2100 - cost: nan\n",
            "Iteration: 2200 - cost: nan\n",
            "Iteration: 2300 - cost: nan\n",
            "Iteration: 2400 - cost: nan\n",
            "Iteration: 2500 - cost: nan\n",
            "Iteration: 2600 - cost: nan\n",
            "Iteration: 2700 - cost: nan\n",
            "Iteration: 2800 - cost: nan\n",
            "Iteration: 2900 - cost: nan\n",
            "Iteration: 3000 - cost: nan\n",
            "Iteration: 3100 - cost: nan\n",
            "Iteration: 3200 - cost: nan\n",
            "Iteration: 3300 - cost: nan\n",
            "Iteration: 3400 - cost: nan\n",
            "Iteration: 3500 - cost: nan\n",
            "Iteration: 3600 - cost: nan\n",
            "Iteration: 3700 - cost: nan\n",
            "Iteration: 3800 - cost: nan\n",
            "Iteration: 3900 - cost: nan\n",
            "Iteration: 4000 - cost: nan\n",
            "Iteration: 4100 - cost: nan\n",
            "Iteration: 4200 - cost: nan\n",
            "Iteration: 4300 - cost: nan\n",
            "Iteration: 4400 - cost: nan\n",
            "Iteration: 4500 - cost: nan\n",
            "Iteration: 4600 - cost: nan\n",
            "Iteration: 4700 - cost: nan\n",
            "Iteration: 4800 - cost: nan\n",
            "Iteration: 4900 - cost: nan\n",
            "Iteration: 5000 - cost: nan\n",
            "Iteration: 5100 - cost: nan\n",
            "Iteration: 5200 - cost: nan\n",
            "Iteration: 5300 - cost: nan\n",
            "Iteration: 5400 - cost: nan\n",
            "Iteration: 5500 - cost: nan\n",
            "Iteration: 5600 - cost: nan\n",
            "Iteration: 5700 - cost: nan\n",
            "Iteration: 5800 - cost: nan\n",
            "Iteration: 5900 - cost: nan\n",
            "Iteration: 6000 - cost: nan\n",
            "Iteration: 6100 - cost: nan\n",
            "Iteration: 6200 - cost: nan\n",
            "Iteration: 6300 - cost: nan\n",
            "Iteration: 6400 - cost: nan\n",
            "Iteration: 6500 - cost: nan\n",
            "Iteration: 6600 - cost: nan\n",
            "Iteration: 6700 - cost: nan\n",
            "Iteration: 6800 - cost: nan\n",
            "Iteration: 6900 - cost: nan\n",
            "Iteration: 7000 - cost: nan\n",
            "Iteration: 7100 - cost: nan\n",
            "Iteration: 7200 - cost: nan\n",
            "Iteration: 7300 - cost: nan\n",
            "Iteration: 7400 - cost: nan\n",
            "Iteration: 7500 - cost: nan\n",
            "Iteration: 7600 - cost: nan\n",
            "Iteration: 7700 - cost: nan\n",
            "Iteration: 7800 - cost: nan\n",
            "Iteration: 7900 - cost: nan\n",
            "Iteration: 8000 - cost: nan\n",
            "Iteration: 8100 - cost: nan\n",
            "Iteration: 8200 - cost: nan\n",
            "Iteration: 8300 - cost: nan\n",
            "Iteration: 8400 - cost: nan\n",
            "Iteration: 8500 - cost: nan\n",
            "Iteration: 8600 - cost: nan\n",
            "Iteration: 8700 - cost: nan\n",
            "Iteration: 8800 - cost: nan\n",
            "Iteration: 8900 - cost: nan\n",
            "Iteration: 9000 - cost: nan\n",
            "Iteration: 9100 - cost: nan\n",
            "Iteration: 9200 - cost: nan\n",
            "Iteration: 9300 - cost: nan\n",
            "Iteration: 9400 - cost: nan\n",
            "Iteration: 9500 - cost: nan\n",
            "Iteration: 9600 - cost: nan\n",
            "Iteration: 9700 - cost: nan\n",
            "Iteration: 9800 - cost: nan\n",
            "Iteration: 9900 - cost: nan\n",
            "Iteration: 10000 - cost: nan\n",
            "Iteration: 10100 - cost: nan\n",
            "Iteration: 10200 - cost: nan\n",
            "Iteration: 10300 - cost: nan\n",
            "Iteration: 10400 - cost: nan\n",
            "Iteration: 10500 - cost: nan\n",
            "Iteration: 10600 - cost: nan\n",
            "Iteration: 10700 - cost: nan\n",
            "Iteration: 10800 - cost: nan\n",
            "Iteration: 10900 - cost: nan\n",
            "Iteration: 11000 - cost: nan\n",
            "Iteration: 11100 - cost: nan\n",
            "Iteration: 11200 - cost: nan\n",
            "Iteration: 11300 - cost: nan\n",
            "Iteration: 11400 - cost: nan\n",
            "Iteration: 11500 - cost: nan\n",
            "Iteration: 11600 - cost: nan\n",
            "Iteration: 11700 - cost: nan\n",
            "Iteration: 11800 - cost: nan\n",
            "Iteration: 11900 - cost: nan\n",
            "Iteration: 12000 - cost: nan\n",
            "Iteration: 12100 - cost: nan\n",
            "Iteration: 12200 - cost: nan\n",
            "Iteration: 12300 - cost: nan\n",
            "Iteration: 12400 - cost: nan\n",
            "Iteration: 12500 - cost: nan\n",
            "Iteration: 12600 - cost: nan\n",
            "Iteration: 12700 - cost: nan\n",
            "Iteration: 12800 - cost: nan\n",
            "Iteration: 12900 - cost: nan\n",
            "Iteration: 13000 - cost: nan\n",
            "Iteration: 13100 - cost: nan\n",
            "Iteration: 13200 - cost: nan\n",
            "Iteration: 13300 - cost: nan\n",
            "Iteration: 13400 - cost: nan\n",
            "Iteration: 13500 - cost: nan\n",
            "Iteration: 13600 - cost: nan\n",
            "Iteration: 13700 - cost: nan\n",
            "Iteration: 13800 - cost: nan\n",
            "Iteration: 13900 - cost: nan\n",
            "Iteration: 14000 - cost: nan\n",
            "Iteration: 14100 - cost: nan\n",
            "Iteration: 14200 - cost: nan\n",
            "Iteration: 14300 - cost: nan\n",
            "Iteration: 14400 - cost: nan\n",
            "Iteration: 14500 - cost: nan\n",
            "Iteration: 14600 - cost: nan\n",
            "Iteration: 14700 - cost: nan\n",
            "Iteration: 14800 - cost: nan\n",
            "Iteration: 14900 - cost: nan\n",
            "Iteration: 15000 - cost: nan\n",
            "Iteration: 15100 - cost: nan\n",
            "Iteration: 15200 - cost: nan\n",
            "Iteration: 15300 - cost: nan\n",
            "Iteration: 15400 - cost: nan\n",
            "Iteration: 15500 - cost: nan\n",
            "Iteration: 15600 - cost: nan\n",
            "Iteration: 15700 - cost: nan\n",
            "Iteration: 15800 - cost: nan\n",
            "Iteration: 15900 - cost: nan\n",
            "Iteration: 16000 - cost: nan\n",
            "Iteration: 16100 - cost: nan\n",
            "Iteration: 16200 - cost: nan\n",
            "Iteration: 16300 - cost: nan\n",
            "Iteration: 16400 - cost: nan\n",
            "Iteration: 16500 - cost: nan\n",
            "Iteration: 16600 - cost: nan\n",
            "Iteration: 16700 - cost: nan\n",
            "Iteration: 16800 - cost: nan\n",
            "Iteration: 16900 - cost: nan\n",
            "Iteration: 17000 - cost: nan\n",
            "Iteration: 17100 - cost: nan\n",
            "Iteration: 17200 - cost: nan\n",
            "Iteration: 17300 - cost: nan\n",
            "Iteration: 17400 - cost: nan\n",
            "Iteration: 17500 - cost: nan\n",
            "Iteration: 17600 - cost: nan\n",
            "Iteration: 17700 - cost: nan\n",
            "Iteration: 17800 - cost: nan\n",
            "Iteration: 17900 - cost: nan\n",
            "Iteration: 18000 - cost: nan\n",
            "Iteration: 18100 - cost: nan\n",
            "Iteration: 18200 - cost: nan\n",
            "Iteration: 18300 - cost: nan\n",
            "Iteration: 18400 - cost: nan\n",
            "Iteration: 18500 - cost: nan\n",
            "Iteration: 18600 - cost: nan\n",
            "Iteration: 18700 - cost: nan\n",
            "Iteration: 18800 - cost: nan\n",
            "Iteration: 18900 - cost: nan\n",
            "Iteration: 19000 - cost: nan\n",
            "Iteration: 19100 - cost: nan\n",
            "Iteration: 19200 - cost: nan\n",
            "Iteration: 19300 - cost: nan\n",
            "Iteration: 19400 - cost: nan\n",
            "Iteration: 19500 - cost: nan\n",
            "Iteration: 19600 - cost: nan\n",
            "Iteration: 19700 - cost: nan\n",
            "Iteration: 19800 - cost: nan\n",
            "Iteration: 19900 - cost: nan\n",
            "Iteration: 20000 - cost: nan\n",
            "Iteration: 20100 - cost: nan\n",
            "Iteration: 20200 - cost: nan\n",
            "Iteration: 20300 - cost: nan\n",
            "Iteration: 20400 - cost: nan\n",
            "Iteration: 20500 - cost: nan\n",
            "Iteration: 20600 - cost: nan\n",
            "Iteration: 20700 - cost: nan\n",
            "Iteration: 20800 - cost: nan\n",
            "Iteration: 20900 - cost: nan\n",
            "Iteration: 21000 - cost: nan\n",
            "Iteration: 21100 - cost: nan\n",
            "Iteration: 21200 - cost: nan\n",
            "Iteration: 21300 - cost: nan\n",
            "Iteration: 21400 - cost: nan\n",
            "Iteration: 21500 - cost: nan\n",
            "Iteration: 21600 - cost: nan\n",
            "Iteration: 21700 - cost: nan\n",
            "Iteration: 21800 - cost: nan\n",
            "Iteration: 21900 - cost: nan\n",
            "Iteration: 22000 - cost: nan\n",
            "Iteration: 22100 - cost: nan\n",
            "Iteration: 22200 - cost: nan\n",
            "Iteration: 22300 - cost: nan\n",
            "Iteration: 22400 - cost: nan\n",
            "Iteration: 22500 - cost: nan\n",
            "Iteration: 22600 - cost: nan\n",
            "Iteration: 22700 - cost: nan\n",
            "Iteration: 22800 - cost: nan\n",
            "Iteration: 22900 - cost: nan\n",
            "Iteration: 23000 - cost: nan\n",
            "Iteration: 23100 - cost: nan\n",
            "Iteration: 23200 - cost: nan\n",
            "Iteration: 23300 - cost: nan\n",
            "Iteration: 23400 - cost: nan\n",
            "Iteration: 23500 - cost: nan\n",
            "Iteration: 23600 - cost: nan\n",
            "Iteration: 23700 - cost: nan\n",
            "Iteration: 23800 - cost: nan\n",
            "Iteration: 23900 - cost: nan\n",
            "Iteration: 24000 - cost: nan\n",
            "Iteration: 24100 - cost: nan\n",
            "Iteration: 24200 - cost: nan\n",
            "Iteration: 24300 - cost: nan\n",
            "Iteration: 24400 - cost: nan\n",
            "Iteration: 24500 - cost: nan\n",
            "Iteration: 24600 - cost: nan\n",
            "Iteration: 24700 - cost: nan\n",
            "Iteration: 24800 - cost: nan\n",
            "Iteration: 24900 - cost: nan\n",
            "Iteration: 25000 - cost: nan\n",
            "Iteration: 25100 - cost: nan\n",
            "Iteration: 25200 - cost: nan\n",
            "Iteration: 25300 - cost: nan\n",
            "Iteration: 25400 - cost: nan\n",
            "Iteration: 25500 - cost: nan\n",
            "Iteration: 25600 - cost: nan\n",
            "Iteration: 25700 - cost: nan\n",
            "Iteration: 25800 - cost: nan\n",
            "Iteration: 25900 - cost: nan\n",
            "Iteration: 26000 - cost: nan\n",
            "Iteration: 26100 - cost: nan\n",
            "Iteration: 26200 - cost: nan\n",
            "Iteration: 26300 - cost: nan\n",
            "Iteration: 26400 - cost: nan\n",
            "Iteration: 26500 - cost: nan\n",
            "Iteration: 26600 - cost: nan\n",
            "Iteration: 26700 - cost: nan\n",
            "Iteration: 26800 - cost: nan\n",
            "Iteration: 26900 - cost: nan\n",
            "Iteration: 27000 - cost: nan\n",
            "Iteration: 27100 - cost: nan\n",
            "Iteration: 27200 - cost: nan\n",
            "Iteration: 27300 - cost: nan\n",
            "Iteration: 27400 - cost: nan\n",
            "Iteration: 27500 - cost: nan\n",
            "Iteration: 27600 - cost: nan\n",
            "Iteration: 27700 - cost: nan\n",
            "Iteration: 27800 - cost: nan\n",
            "Iteration: 27900 - cost: nan\n",
            "Iteration: 28000 - cost: nan\n",
            "Iteration: 28100 - cost: nan\n",
            "Iteration: 28200 - cost: nan\n",
            "Iteration: 28300 - cost: nan\n",
            "Iteration: 28400 - cost: nan\n",
            "Iteration: 28500 - cost: nan\n",
            "Iteration: 28600 - cost: nan\n",
            "Iteration: 28700 - cost: nan\n",
            "Iteration: 28800 - cost: nan\n",
            "Iteration: 28900 - cost: nan\n",
            "Iteration: 29000 - cost: nan\n",
            "Iteration: 29100 - cost: nan\n",
            "Iteration: 29200 - cost: nan\n",
            "Iteration: 29300 - cost: nan\n",
            "Iteration: 29400 - cost: nan\n",
            "Iteration: 29500 - cost: nan\n",
            "Iteration: 29600 - cost: nan\n",
            "Iteration: 29700 - cost: nan\n",
            "Iteration: 29800 - cost: nan\n",
            "Iteration: 29900 - cost: nan\n",
            "Iteration: 30000 - cost: nan\n",
            "Iteration: 30100 - cost: nan\n",
            "Iteration: 30200 - cost: nan\n",
            "Iteration: 30300 - cost: nan\n",
            "Iteration: 30400 - cost: nan\n",
            "Iteration: 30500 - cost: nan\n",
            "Iteration: 30600 - cost: nan\n",
            "Iteration: 30700 - cost: nan\n",
            "Iteration: 30800 - cost: nan\n",
            "Iteration: 30900 - cost: nan\n",
            "Iteration: 31000 - cost: nan\n",
            "Iteration: 31100 - cost: nan\n",
            "Iteration: 31200 - cost: nan\n",
            "Iteration: 31300 - cost: nan\n",
            "Iteration: 31400 - cost: nan\n",
            "Iteration: 31500 - cost: nan\n",
            "Iteration: 31600 - cost: nan\n",
            "Iteration: 31700 - cost: nan\n",
            "Iteration: 31800 - cost: nan\n",
            "Iteration: 31900 - cost: nan\n",
            "Iteration: 32000 - cost: nan\n",
            "Iteration: 32100 - cost: nan\n",
            "Iteration: 32200 - cost: nan\n",
            "Iteration: 32300 - cost: nan\n",
            "Iteration: 32400 - cost: nan\n",
            "Iteration: 32500 - cost: nan\n",
            "Iteration: 32600 - cost: nan\n",
            "Iteration: 32700 - cost: nan\n",
            "Iteration: 32800 - cost: nan\n",
            "Iteration: 32900 - cost: nan\n",
            "Iteration: 33000 - cost: nan\n",
            "Iteration: 33100 - cost: nan\n",
            "Iteration: 33200 - cost: nan\n",
            "Iteration: 33300 - cost: nan\n",
            "Iteration: 33400 - cost: nan\n",
            "Iteration: 33500 - cost: nan\n",
            "Iteration: 33600 - cost: nan\n",
            "Iteration: 33700 - cost: nan\n",
            "Iteration: 33800 - cost: nan\n",
            "Iteration: 33900 - cost: nan\n",
            "Iteration: 34000 - cost: nan\n",
            "Iteration: 34100 - cost: nan\n",
            "Iteration: 34200 - cost: nan\n",
            "Iteration: 34300 - cost: nan\n",
            "Iteration: 34400 - cost: nan\n",
            "Iteration: 34500 - cost: nan\n",
            "Iteration: 34600 - cost: nan\n",
            "Iteration: 34700 - cost: nan\n",
            "Iteration: 34800 - cost: nan\n",
            "Iteration: 34900 - cost: nan\n",
            "Iteration: 35000 - cost: nan\n",
            "Iteration: 35100 - cost: nan\n",
            "Iteration: 35200 - cost: nan\n",
            "Iteration: 35300 - cost: nan\n",
            "Iteration: 35400 - cost: nan\n",
            "Iteration: 35500 - cost: nan\n",
            "Iteration: 35600 - cost: nan\n",
            "Iteration: 35700 - cost: nan\n",
            "Iteration: 35800 - cost: nan\n",
            "Iteration: 35900 - cost: nan\n",
            "Iteration: 36000 - cost: nan\n",
            "Iteration: 36100 - cost: nan\n",
            "Iteration: 36200 - cost: nan\n",
            "Iteration: 36300 - cost: nan\n",
            "Iteration: 36400 - cost: nan\n",
            "Iteration: 36500 - cost: nan\n",
            "Iteration: 36600 - cost: nan\n",
            "Iteration: 36700 - cost: nan\n",
            "Iteration: 36800 - cost: nan\n",
            "Iteration: 36900 - cost: nan\n",
            "Iteration: 37000 - cost: nan\n",
            "Iteration: 37100 - cost: nan\n",
            "Iteration: 37200 - cost: nan\n",
            "Iteration: 37300 - cost: nan\n",
            "Iteration: 37400 - cost: nan\n",
            "Iteration: 37500 - cost: nan\n",
            "Iteration: 37600 - cost: nan\n",
            "Iteration: 37700 - cost: nan\n",
            "Iteration: 37800 - cost: nan\n",
            "Iteration: 37900 - cost: nan\n",
            "Iteration: 38000 - cost: nan\n",
            "Iteration: 38100 - cost: nan\n",
            "Iteration: 38200 - cost: nan\n",
            "Iteration: 38300 - cost: nan\n",
            "Iteration: 38400 - cost: nan\n",
            "Iteration: 38500 - cost: nan\n",
            "Iteration: 38600 - cost: nan\n",
            "Iteration: 38700 - cost: nan\n",
            "Iteration: 38800 - cost: nan\n",
            "Iteration: 38900 - cost: nan\n",
            "Iteration: 39000 - cost: nan\n",
            "Iteration: 39100 - cost: nan\n",
            "Iteration: 39200 - cost: nan\n",
            "Iteration: 39300 - cost: nan\n",
            "Iteration: 39400 - cost: nan\n",
            "Iteration: 39500 - cost: nan\n",
            "Iteration: 39600 - cost: nan\n",
            "Iteration: 39700 - cost: nan\n",
            "Iteration: 39800 - cost: nan\n",
            "Iteration: 39900 - cost: nan\n",
            "Iteration: 40000 - cost: nan\n",
            "Iteration: 40100 - cost: nan\n",
            "Iteration: 40200 - cost: nan\n",
            "Iteration: 40300 - cost: nan\n",
            "Iteration: 40400 - cost: nan\n",
            "Iteration: 40500 - cost: nan\n",
            "Iteration: 40600 - cost: nan\n",
            "Iteration: 40700 - cost: nan\n",
            "Iteration: 40800 - cost: nan\n",
            "Iteration: 40900 - cost: nan\n",
            "Iteration: 41000 - cost: nan\n",
            "Iteration: 41100 - cost: nan\n",
            "Iteration: 41200 - cost: nan\n",
            "Iteration: 41300 - cost: nan\n",
            "Iteration: 41400 - cost: nan\n",
            "Iteration: 41500 - cost: nan\n",
            "Iteration: 41600 - cost: nan\n",
            "Iteration: 41700 - cost: nan\n",
            "Iteration: 41800 - cost: nan\n",
            "Iteration: 41900 - cost: nan\n",
            "Iteration: 42000 - cost: nan\n",
            "Iteration: 42100 - cost: nan\n",
            "Iteration: 42200 - cost: nan\n",
            "Iteration: 42300 - cost: nan\n",
            "Iteration: 42400 - cost: nan\n",
            "Iteration: 42500 - cost: nan\n",
            "Iteration: 42600 - cost: nan\n",
            "Iteration: 42700 - cost: nan\n",
            "Iteration: 42800 - cost: nan\n",
            "Iteration: 42900 - cost: nan\n",
            "Iteration: 43000 - cost: nan\n",
            "Iteration: 43100 - cost: nan\n",
            "Iteration: 43200 - cost: nan\n",
            "Iteration: 43300 - cost: nan\n",
            "Iteration: 43400 - cost: nan\n",
            "Iteration: 43500 - cost: nan\n",
            "Iteration: 43600 - cost: nan\n",
            "Iteration: 43700 - cost: nan\n",
            "Iteration: 43800 - cost: nan\n",
            "Iteration: 43900 - cost: nan\n",
            "Iteration: 44000 - cost: nan\n",
            "Iteration: 44100 - cost: nan\n",
            "Iteration: 44200 - cost: nan\n",
            "Iteration: 44300 - cost: nan\n",
            "Iteration: 44400 - cost: nan\n",
            "Iteration: 44500 - cost: nan\n",
            "Iteration: 44600 - cost: nan\n",
            "Iteration: 44700 - cost: nan\n",
            "Iteration: 44800 - cost: nan\n",
            "Iteration: 44900 - cost: nan\n",
            "Iteration: 45000 - cost: nan\n",
            "Iteration: 45100 - cost: nan\n",
            "Iteration: 45200 - cost: nan\n",
            "Iteration: 45300 - cost: nan\n",
            "Iteration: 45400 - cost: nan\n",
            "Iteration: 45500 - cost: nan\n",
            "Iteration: 45600 - cost: nan\n",
            "Iteration: 45700 - cost: nan\n",
            "Iteration: 45800 - cost: nan\n",
            "Iteration: 45900 - cost: nan\n",
            "Iteration: 46000 - cost: nan\n",
            "Iteration: 46100 - cost: nan\n",
            "Iteration: 46200 - cost: nan\n",
            "Iteration: 46300 - cost: nan\n",
            "Iteration: 46400 - cost: nan\n",
            "Iteration: 46500 - cost: nan\n",
            "Iteration: 46600 - cost: nan\n",
            "Iteration: 46700 - cost: nan\n",
            "Iteration: 46800 - cost: nan\n",
            "Iteration: 46900 - cost: nan\n",
            "Iteration: 47000 - cost: nan\n",
            "Iteration: 47100 - cost: nan\n",
            "Iteration: 47200 - cost: nan\n",
            "Iteration: 47300 - cost: nan\n",
            "Iteration: 47400 - cost: nan\n",
            "Iteration: 47500 - cost: nan\n",
            "Iteration: 47600 - cost: nan\n",
            "Iteration: 47700 - cost: nan\n",
            "Iteration: 47800 - cost: nan\n",
            "Iteration: 47900 - cost: nan\n",
            "Iteration: 48000 - cost: nan\n",
            "Iteration: 48100 - cost: nan\n",
            "Iteration: 48200 - cost: nan\n",
            "Iteration: 48300 - cost: nan\n",
            "Iteration: 48400 - cost: nan\n",
            "Iteration: 48500 - cost: nan\n",
            "Iteration: 48600 - cost: nan\n",
            "Iteration: 48700 - cost: nan\n",
            "Iteration: 48800 - cost: nan\n",
            "Iteration: 48900 - cost: nan\n",
            "Iteration: 49000 - cost: nan\n",
            "Iteration: 49100 - cost: nan\n",
            "Iteration: 49200 - cost: nan\n",
            "Iteration: 49300 - cost: nan\n",
            "Iteration: 49400 - cost: nan\n",
            "Iteration: 49500 - cost: nan\n",
            "Iteration: 49600 - cost: nan\n",
            "Iteration: 49700 - cost: nan\n",
            "Iteration: 49800 - cost: nan\n",
            "Iteration: 49900 - cost: nan\n",
            "Iteration: 50000 - cost: nan\n",
            "Iteration: 50100 - cost: nan\n",
            "Iteration: 50200 - cost: nan\n",
            "Iteration: 50300 - cost: nan\n",
            "Iteration: 50400 - cost: nan\n",
            "Iteration: 50500 - cost: nan\n",
            "Iteration: 50600 - cost: nan\n",
            "Iteration: 50700 - cost: nan\n",
            "Iteration: 50800 - cost: nan\n",
            "Iteration: 50900 - cost: nan\n",
            "Iteration: 51000 - cost: nan\n",
            "Iteration: 51100 - cost: nan\n",
            "Iteration: 51200 - cost: nan\n",
            "Iteration: 51300 - cost: nan\n",
            "Iteration: 51400 - cost: nan\n",
            "Iteration: 51500 - cost: nan\n",
            "Iteration: 51600 - cost: nan\n",
            "Iteration: 51700 - cost: nan\n",
            "Iteration: 51800 - cost: nan\n",
            "Iteration: 51900 - cost: nan\n",
            "Iteration: 52000 - cost: nan\n",
            "Iteration: 52100 - cost: nan\n",
            "Iteration: 52200 - cost: nan\n",
            "Iteration: 52300 - cost: nan\n",
            "Iteration: 52400 - cost: nan\n",
            "Iteration: 52500 - cost: nan\n",
            "Iteration: 52600 - cost: nan\n",
            "Iteration: 52700 - cost: nan\n",
            "Iteration: 52800 - cost: nan\n",
            "Iteration: 52900 - cost: nan\n",
            "Iteration: 53000 - cost: nan\n",
            "Iteration: 53100 - cost: nan\n",
            "Iteration: 53200 - cost: nan\n",
            "Iteration: 53300 - cost: nan\n",
            "Iteration: 53400 - cost: nan\n",
            "Iteration: 53500 - cost: nan\n",
            "Iteration: 53600 - cost: nan\n",
            "Iteration: 53700 - cost: nan\n",
            "Iteration: 53800 - cost: nan\n",
            "Iteration: 53900 - cost: nan\n",
            "Iteration: 54000 - cost: nan\n",
            "Iteration: 54100 - cost: nan\n",
            "Iteration: 54200 - cost: nan\n",
            "Iteration: 54300 - cost: nan\n",
            "Iteration: 54400 - cost: nan\n",
            "Iteration: 54500 - cost: nan\n",
            "Iteration: 54600 - cost: nan\n",
            "Iteration: 54700 - cost: nan\n",
            "Iteration: 54800 - cost: nan\n",
            "Iteration: 54900 - cost: nan\n",
            "Iteration: 55000 - cost: nan\n",
            "Iteration: 55100 - cost: nan\n",
            "Iteration: 55200 - cost: nan\n",
            "Iteration: 55300 - cost: nan\n",
            "Iteration: 55400 - cost: nan\n",
            "Iteration: 55500 - cost: nan\n",
            "Iteration: 55600 - cost: nan\n",
            "Iteration: 55700 - cost: nan\n",
            "Iteration: 55800 - cost: nan\n",
            "Iteration: 55900 - cost: nan\n",
            "Iteration: 56000 - cost: nan\n",
            "Iteration: 56100 - cost: nan\n",
            "Iteration: 56200 - cost: nan\n",
            "Iteration: 56300 - cost: nan\n",
            "Iteration: 56400 - cost: nan\n",
            "Iteration: 56500 - cost: nan\n",
            "Iteration: 56600 - cost: nan\n",
            "Iteration: 56700 - cost: nan\n",
            "Iteration: 56800 - cost: nan\n",
            "Iteration: 56900 - cost: nan\n",
            "Iteration: 57000 - cost: nan\n",
            "Iteration: 57100 - cost: nan\n",
            "Iteration: 57200 - cost: nan\n",
            "Iteration: 57300 - cost: nan\n",
            "Iteration: 57400 - cost: nan\n",
            "Iteration: 57500 - cost: nan\n",
            "Iteration: 57600 - cost: nan\n",
            "Iteration: 57700 - cost: nan\n",
            "Iteration: 57800 - cost: nan\n",
            "Iteration: 57900 - cost: nan\n",
            "Iteration: 58000 - cost: nan\n",
            "Iteration: 58100 - cost: nan\n",
            "Iteration: 58200 - cost: nan\n",
            "Iteration: 58300 - cost: nan\n",
            "Iteration: 58400 - cost: nan\n",
            "Iteration: 58500 - cost: nan\n",
            "Iteration: 58600 - cost: nan\n",
            "Iteration: 58700 - cost: nan\n",
            "Iteration: 58800 - cost: nan\n",
            "Iteration: 58900 - cost: nan\n",
            "Iteration: 59000 - cost: nan\n",
            "Iteration: 59100 - cost: nan\n",
            "Iteration: 59200 - cost: nan\n",
            "Iteration: 59300 - cost: nan\n",
            "Iteration: 59400 - cost: nan\n",
            "Iteration: 59500 - cost: nan\n",
            "Iteration: 59600 - cost: nan\n",
            "Iteration: 59700 - cost: nan\n",
            "Iteration: 59800 - cost: nan\n",
            "Iteration: 59900 - cost: nan\n",
            "Iteration: 60000 - cost: nan\n",
            "Iteration: 60100 - cost: nan\n",
            "Iteration: 60200 - cost: nan\n",
            "Iteration: 60300 - cost: nan\n",
            "Iteration: 60400 - cost: nan\n",
            "Iteration: 60500 - cost: nan\n",
            "Iteration: 60600 - cost: nan\n",
            "Iteration: 60700 - cost: nan\n",
            "Iteration: 60800 - cost: nan\n",
            "Iteration: 60900 - cost: nan\n",
            "Iteration: 61000 - cost: nan\n",
            "Iteration: 61100 - cost: nan\n",
            "Iteration: 61200 - cost: nan\n",
            "Iteration: 61300 - cost: nan\n",
            "Iteration: 61400 - cost: nan\n",
            "Iteration: 61500 - cost: nan\n",
            "Iteration: 61600 - cost: nan\n",
            "Iteration: 61700 - cost: nan\n",
            "Iteration: 61800 - cost: nan\n",
            "Iteration: 61900 - cost: nan\n",
            "Iteration: 62000 - cost: nan\n",
            "Iteration: 62100 - cost: nan\n",
            "Iteration: 62200 - cost: nan\n",
            "Iteration: 62300 - cost: nan\n",
            "Iteration: 62400 - cost: nan\n",
            "Iteration: 62500 - cost: nan\n",
            "Iteration: 62600 - cost: nan\n",
            "Iteration: 62700 - cost: nan\n",
            "Iteration: 62800 - cost: nan\n",
            "Iteration: 62900 - cost: nan\n",
            "Iteration: 63000 - cost: nan\n",
            "Iteration: 63100 - cost: nan\n",
            "Iteration: 63200 - cost: nan\n",
            "Iteration: 63300 - cost: nan\n",
            "Iteration: 63400 - cost: nan\n",
            "Iteration: 63500 - cost: nan\n",
            "Iteration: 63600 - cost: nan\n",
            "Iteration: 63700 - cost: nan\n",
            "Iteration: 63800 - cost: nan\n",
            "Iteration: 63900 - cost: nan\n",
            "Iteration: 64000 - cost: nan\n",
            "Iteration: 64100 - cost: nan\n",
            "Iteration: 64200 - cost: nan\n",
            "Iteration: 64300 - cost: nan\n",
            "Iteration: 64400 - cost: nan\n",
            "Iteration: 64500 - cost: nan\n",
            "Iteration: 64600 - cost: nan\n",
            "Iteration: 64700 - cost: nan\n",
            "Iteration: 64800 - cost: nan\n",
            "Iteration: 64900 - cost: nan\n",
            "Iteration: 65000 - cost: nan\n",
            "Iteration: 65100 - cost: nan\n",
            "Iteration: 65200 - cost: nan\n",
            "Iteration: 65300 - cost: nan\n",
            "Iteration: 65400 - cost: nan\n",
            "Iteration: 65500 - cost: nan\n",
            "Iteration: 65600 - cost: nan\n",
            "Iteration: 65700 - cost: nan\n",
            "Iteration: 65800 - cost: nan\n",
            "Iteration: 65900 - cost: nan\n",
            "Iteration: 66000 - cost: nan\n",
            "Iteration: 66100 - cost: nan\n",
            "Iteration: 66200 - cost: nan\n",
            "Iteration: 66300 - cost: nan\n",
            "Iteration: 66400 - cost: nan\n",
            "Iteration: 66500 - cost: nan\n",
            "Iteration: 66600 - cost: nan\n",
            "Iteration: 66700 - cost: nan\n",
            "Iteration: 66800 - cost: nan\n",
            "Iteration: 66900 - cost: nan\n",
            "Iteration: 67000 - cost: nan\n",
            "Iteration: 67100 - cost: nan\n",
            "Iteration: 67200 - cost: nan\n",
            "Iteration: 67300 - cost: nan\n",
            "Iteration: 67400 - cost: nan\n",
            "Iteration: 67500 - cost: nan\n",
            "Iteration: 67600 - cost: nan\n",
            "Iteration: 67700 - cost: nan\n",
            "Iteration: 67800 - cost: nan\n",
            "Iteration: 67900 - cost: nan\n",
            "Iteration: 68000 - cost: nan\n",
            "Iteration: 68100 - cost: nan\n",
            "Iteration: 68200 - cost: nan\n",
            "Iteration: 68300 - cost: nan\n",
            "Iteration: 68400 - cost: nan\n",
            "Iteration: 68500 - cost: nan\n",
            "Iteration: 68600 - cost: nan\n",
            "Iteration: 68700 - cost: nan\n",
            "Iteration: 68800 - cost: nan\n",
            "Iteration: 68900 - cost: nan\n",
            "Iteration: 69000 - cost: nan\n",
            "Iteration: 69100 - cost: nan\n",
            "Iteration: 69200 - cost: nan\n",
            "Iteration: 69300 - cost: nan\n",
            "Iteration: 69400 - cost: nan\n",
            "Iteration: 69500 - cost: nan\n",
            "Iteration: 69600 - cost: nan\n",
            "Iteration: 69700 - cost: nan\n",
            "Iteration: 69800 - cost: nan\n",
            "Iteration: 69900 - cost: nan\n",
            "Iteration: 70000 - cost: nan\n",
            "Iteration: 70100 - cost: nan\n",
            "Iteration: 70200 - cost: nan\n",
            "Iteration: 70300 - cost: nan\n",
            "Iteration: 70400 - cost: nan\n",
            "Iteration: 70500 - cost: nan\n",
            "Iteration: 70600 - cost: nan\n",
            "Iteration: 70700 - cost: nan\n",
            "Iteration: 70800 - cost: nan\n",
            "Iteration: 70900 - cost: nan\n",
            "Iteration: 71000 - cost: nan\n",
            "Iteration: 71100 - cost: nan\n",
            "Iteration: 71200 - cost: nan\n",
            "Iteration: 71300 - cost: nan\n",
            "Iteration: 71400 - cost: nan\n",
            "Iteration: 71500 - cost: nan\n",
            "Iteration: 71600 - cost: nan\n",
            "Iteration: 71700 - cost: nan\n",
            "Iteration: 71800 - cost: nan\n",
            "Iteration: 71900 - cost: nan\n",
            "Iteration: 72000 - cost: nan\n",
            "Iteration: 72100 - cost: nan\n",
            "Iteration: 72200 - cost: nan\n",
            "Iteration: 72300 - cost: nan\n",
            "Iteration: 72400 - cost: nan\n",
            "Iteration: 72500 - cost: nan\n",
            "Iteration: 72600 - cost: nan\n",
            "Iteration: 72700 - cost: nan\n",
            "Iteration: 72800 - cost: nan\n",
            "Iteration: 72900 - cost: nan\n",
            "Iteration: 73000 - cost: nan\n",
            "Iteration: 73100 - cost: nan\n",
            "Iteration: 73200 - cost: nan\n",
            "Iteration: 73300 - cost: nan\n",
            "Iteration: 73400 - cost: nan\n",
            "Iteration: 73500 - cost: nan\n",
            "Iteration: 73600 - cost: nan\n",
            "Iteration: 73700 - cost: nan\n",
            "Iteration: 73800 - cost: nan\n",
            "Iteration: 73900 - cost: nan\n",
            "Iteration: 74000 - cost: nan\n",
            "Iteration: 74100 - cost: nan\n",
            "Iteration: 74200 - cost: nan\n",
            "Iteration: 74300 - cost: nan\n",
            "Iteration: 74400 - cost: nan\n",
            "Iteration: 74500 - cost: nan\n",
            "Iteration: 74600 - cost: nan\n",
            "Iteration: 74700 - cost: nan\n",
            "Iteration: 74800 - cost: nan\n",
            "Iteration: 74900 - cost: nan\n",
            "Iteration: 75000 - cost: nan\n",
            "Iteration: 75100 - cost: nan\n",
            "Iteration: 75200 - cost: nan\n",
            "Iteration: 75300 - cost: nan\n",
            "Iteration: 75400 - cost: nan\n",
            "Iteration: 75500 - cost: nan\n",
            "Iteration: 75600 - cost: nan\n",
            "Iteration: 75700 - cost: nan\n",
            "Iteration: 75800 - cost: nan\n",
            "Iteration: 75900 - cost: nan\n",
            "Iteration: 76000 - cost: nan\n",
            "Iteration: 76100 - cost: nan\n",
            "Iteration: 76200 - cost: nan\n",
            "Iteration: 76300 - cost: nan\n",
            "Iteration: 76400 - cost: nan\n",
            "Iteration: 76500 - cost: nan\n",
            "Iteration: 76600 - cost: nan\n",
            "Iteration: 76700 - cost: nan\n",
            "Iteration: 76800 - cost: nan\n",
            "Iteration: 76900 - cost: nan\n",
            "Iteration: 77000 - cost: nan\n",
            "Iteration: 77100 - cost: nan\n",
            "Iteration: 77200 - cost: nan\n",
            "Iteration: 77300 - cost: nan\n",
            "Iteration: 77400 - cost: nan\n",
            "Iteration: 77500 - cost: nan\n",
            "Iteration: 77600 - cost: nan\n",
            "Iteration: 77700 - cost: nan\n",
            "Iteration: 77800 - cost: nan\n",
            "Iteration: 77900 - cost: nan\n",
            "Iteration: 78000 - cost: nan\n",
            "Iteration: 78100 - cost: nan\n",
            "Iteration: 78200 - cost: nan\n",
            "Iteration: 78300 - cost: nan\n",
            "Iteration: 78400 - cost: nan\n",
            "Iteration: 78500 - cost: nan\n",
            "Iteration: 78600 - cost: nan\n",
            "Iteration: 78700 - cost: nan\n",
            "Iteration: 78800 - cost: nan\n",
            "Iteration: 78900 - cost: nan\n",
            "Iteration: 79000 - cost: nan\n",
            "Iteration: 79100 - cost: nan\n",
            "Iteration: 79200 - cost: nan\n",
            "Iteration: 79300 - cost: nan\n",
            "Iteration: 79400 - cost: nan\n",
            "Iteration: 79500 - cost: nan\n",
            "Iteration: 79600 - cost: nan\n",
            "Iteration: 79700 - cost: nan\n",
            "Iteration: 79800 - cost: nan\n",
            "Iteration: 79900 - cost: nan\n",
            "Iteration: 80000 - cost: nan\n",
            "Iteration: 80100 - cost: nan\n",
            "Iteration: 80200 - cost: nan\n",
            "Iteration: 80300 - cost: nan\n",
            "Iteration: 80400 - cost: nan\n",
            "Iteration: 80500 - cost: nan\n",
            "Iteration: 80600 - cost: nan\n",
            "Iteration: 80700 - cost: nan\n",
            "Iteration: 80800 - cost: nan\n",
            "Iteration: 80900 - cost: nan\n",
            "Iteration: 81000 - cost: nan\n",
            "Iteration: 81100 - cost: nan\n",
            "Iteration: 81200 - cost: nan\n",
            "Iteration: 81300 - cost: nan\n",
            "Iteration: 81400 - cost: nan\n",
            "Iteration: 81500 - cost: nan\n",
            "Iteration: 81600 - cost: nan\n",
            "Iteration: 81700 - cost: nan\n",
            "Iteration: 81800 - cost: nan\n",
            "Iteration: 81900 - cost: nan\n",
            "Iteration: 82000 - cost: nan\n",
            "Iteration: 82100 - cost: nan\n",
            "Iteration: 82200 - cost: nan\n",
            "Iteration: 82300 - cost: nan\n",
            "Iteration: 82400 - cost: nan\n",
            "Iteration: 82500 - cost: nan\n",
            "Iteration: 82600 - cost: nan\n",
            "Iteration: 82700 - cost: nan\n",
            "Iteration: 82800 - cost: nan\n",
            "Iteration: 82900 - cost: nan\n",
            "Iteration: 83000 - cost: nan\n",
            "Iteration: 83100 - cost: nan\n",
            "Iteration: 83200 - cost: nan\n",
            "Iteration: 83300 - cost: nan\n",
            "Iteration: 83400 - cost: nan\n",
            "Iteration: 83500 - cost: nan\n",
            "Iteration: 83600 - cost: nan\n",
            "Iteration: 83700 - cost: nan\n",
            "Iteration: 83800 - cost: nan\n",
            "Iteration: 83900 - cost: nan\n",
            "Iteration: 84000 - cost: nan\n",
            "Iteration: 84100 - cost: nan\n",
            "Iteration: 84200 - cost: nan\n",
            "Iteration: 84300 - cost: nan\n",
            "Iteration: 84400 - cost: nan\n",
            "Iteration: 84500 - cost: nan\n",
            "Iteration: 84600 - cost: nan\n",
            "Iteration: 84700 - cost: nan\n",
            "Iteration: 84800 - cost: nan\n",
            "Iteration: 84900 - cost: nan\n",
            "Iteration: 85000 - cost: nan\n",
            "Iteration: 85100 - cost: nan\n",
            "Iteration: 85200 - cost: nan\n",
            "Iteration: 85300 - cost: nan\n",
            "Iteration: 85400 - cost: nan\n",
            "Iteration: 85500 - cost: nan\n",
            "Iteration: 85600 - cost: nan\n",
            "Iteration: 85700 - cost: nan\n",
            "Iteration: 85800 - cost: nan\n",
            "Iteration: 85900 - cost: nan\n",
            "Iteration: 86000 - cost: nan\n",
            "Iteration: 86100 - cost: nan\n",
            "Iteration: 86200 - cost: nan\n",
            "Iteration: 86300 - cost: nan\n",
            "Iteration: 86400 - cost: nan\n",
            "Iteration: 86500 - cost: nan\n",
            "Iteration: 86600 - cost: nan\n",
            "Iteration: 86700 - cost: nan\n",
            "Iteration: 86800 - cost: nan\n",
            "Iteration: 86900 - cost: nan\n",
            "Iteration: 87000 - cost: nan\n",
            "Iteration: 87100 - cost: nan\n",
            "Iteration: 87200 - cost: nan\n",
            "Iteration: 87300 - cost: nan\n",
            "Iteration: 87400 - cost: nan\n",
            "Iteration: 87500 - cost: nan\n",
            "Iteration: 87600 - cost: nan\n",
            "Iteration: 87700 - cost: nan\n",
            "Iteration: 87800 - cost: nan\n",
            "Iteration: 87900 - cost: nan\n",
            "Iteration: 88000 - cost: nan\n",
            "Iteration: 88100 - cost: nan\n",
            "Iteration: 88200 - cost: nan\n",
            "Iteration: 88300 - cost: nan\n",
            "Iteration: 88400 - cost: nan\n",
            "Iteration: 88500 - cost: nan\n",
            "Iteration: 88600 - cost: nan\n",
            "Iteration: 88700 - cost: nan\n",
            "Iteration: 88800 - cost: nan\n",
            "Iteration: 88900 - cost: nan\n",
            "Iteration: 89000 - cost: nan\n",
            "Iteration: 89100 - cost: nan\n",
            "Iteration: 89200 - cost: nan\n",
            "Iteration: 89300 - cost: nan\n",
            "Iteration: 89400 - cost: nan\n",
            "Iteration: 89500 - cost: nan\n",
            "Iteration: 89600 - cost: nan\n",
            "Iteration: 89700 - cost: nan\n",
            "Iteration: 89800 - cost: nan\n",
            "Iteration: 89900 - cost: nan\n",
            "Iteration: 90000 - cost: nan\n",
            "Iteration: 90100 - cost: nan\n",
            "Iteration: 90200 - cost: nan\n",
            "Iteration: 90300 - cost: nan\n",
            "Iteration: 90400 - cost: nan\n",
            "Iteration: 90500 - cost: nan\n",
            "Iteration: 90600 - cost: nan\n",
            "Iteration: 90700 - cost: nan\n",
            "Iteration: 90800 - cost: nan\n",
            "Iteration: 90900 - cost: nan\n",
            "Iteration: 91000 - cost: nan\n",
            "Iteration: 91100 - cost: nan\n",
            "Iteration: 91200 - cost: nan\n",
            "Iteration: 91300 - cost: nan\n",
            "Iteration: 91400 - cost: nan\n",
            "Iteration: 91500 - cost: nan\n",
            "Iteration: 91600 - cost: nan\n",
            "Iteration: 91700 - cost: nan\n",
            "Iteration: 91800 - cost: nan\n",
            "Iteration: 91900 - cost: nan\n",
            "Iteration: 92000 - cost: nan\n",
            "Iteration: 92100 - cost: nan\n",
            "Iteration: 92200 - cost: nan\n",
            "Iteration: 92300 - cost: nan\n",
            "Iteration: 92400 - cost: nan\n",
            "Iteration: 92500 - cost: nan\n",
            "Iteration: 92600 - cost: nan\n",
            "Iteration: 92700 - cost: nan\n",
            "Iteration: 92800 - cost: nan\n",
            "Iteration: 92900 - cost: nan\n",
            "Iteration: 93000 - cost: nan\n",
            "Iteration: 93100 - cost: nan\n",
            "Iteration: 93200 - cost: nan\n",
            "Iteration: 93300 - cost: nan\n",
            "Iteration: 93400 - cost: nan\n",
            "Iteration: 93500 - cost: nan\n",
            "Iteration: 93600 - cost: nan\n",
            "Iteration: 93700 - cost: nan\n",
            "Iteration: 93800 - cost: nan\n",
            "Iteration: 93900 - cost: nan\n",
            "Iteration: 94000 - cost: nan\n",
            "Iteration: 94100 - cost: nan\n",
            "Iteration: 94200 - cost: nan\n",
            "Iteration: 94300 - cost: nan\n",
            "Iteration: 94400 - cost: nan\n",
            "Iteration: 94500 - cost: nan\n",
            "Iteration: 94600 - cost: nan\n",
            "Iteration: 94700 - cost: nan\n",
            "Iteration: 94800 - cost: nan\n",
            "Iteration: 94900 - cost: nan\n",
            "Iteration: 95000 - cost: nan\n",
            "Iteration: 95100 - cost: nan\n",
            "Iteration: 95200 - cost: nan\n",
            "Iteration: 95300 - cost: nan\n",
            "Iteration: 95400 - cost: nan\n",
            "Iteration: 95500 - cost: nan\n",
            "Iteration: 95600 - cost: nan\n",
            "Iteration: 95700 - cost: nan\n",
            "Iteration: 95800 - cost: nan\n",
            "Iteration: 95900 - cost: nan\n",
            "Iteration: 96000 - cost: nan\n",
            "Iteration: 96100 - cost: nan\n",
            "Iteration: 96200 - cost: nan\n",
            "Iteration: 96300 - cost: nan\n",
            "Iteration: 96400 - cost: nan\n",
            "Iteration: 96500 - cost: nan\n",
            "Iteration: 96600 - cost: nan\n",
            "Iteration: 96700 - cost: nan\n",
            "Iteration: 96800 - cost: nan\n",
            "Iteration: 96900 - cost: nan\n",
            "Iteration: 97000 - cost: nan\n",
            "Iteration: 97100 - cost: nan\n",
            "Iteration: 97200 - cost: nan\n",
            "Iteration: 97300 - cost: nan\n",
            "Iteration: 97400 - cost: nan\n",
            "Iteration: 97500 - cost: nan\n",
            "Iteration: 97600 - cost: nan\n",
            "Iteration: 97700 - cost: nan\n",
            "Iteration: 97800 - cost: nan\n",
            "Iteration: 97900 - cost: nan\n",
            "Iteration: 98000 - cost: nan\n",
            "Iteration: 98100 - cost: nan\n",
            "Iteration: 98200 - cost: nan\n",
            "Iteration: 98300 - cost: nan\n",
            "Iteration: 98400 - cost: nan\n",
            "Iteration: 98500 - cost: nan\n",
            "Iteration: 98600 - cost: nan\n",
            "Iteration: 98700 - cost: nan\n",
            "Iteration: 98800 - cost: nan\n",
            "Iteration: 98900 - cost: nan\n",
            "Iteration: 99000 - cost: nan\n",
            "Iteration: 99100 - cost: nan\n",
            "Iteration: 99200 - cost: nan\n",
            "Iteration: 99300 - cost: nan\n",
            "Iteration: 99400 - cost: nan\n",
            "Iteration: 99500 - cost: nan\n",
            "Iteration: 99600 - cost: nan\n",
            "Iteration: 99700 - cost: nan\n",
            "Iteration: 99800 - cost: nan\n",
            "Iteration: 99900 - cost: nan\n",
            "Iteration: 100000 - cost: nan\n",
            "Iteration: 100100 - cost: nan\n",
            "Iteration: 100200 - cost: nan\n",
            "Iteration: 100300 - cost: nan\n",
            "Iteration: 100400 - cost: nan\n",
            "Iteration: 100500 - cost: nan\n",
            "Iteration: 100600 - cost: nan\n",
            "Iteration: 100700 - cost: nan\n",
            "Iteration: 100800 - cost: nan\n",
            "Iteration: 100900 - cost: nan\n",
            "Iteration: 101000 - cost: nan\n",
            "Iteration: 101100 - cost: nan\n",
            "Iteration: 101200 - cost: nan\n",
            "Iteration: 101300 - cost: nan\n",
            "Iteration: 101400 - cost: nan\n",
            "Iteration: 101500 - cost: nan\n",
            "Iteration: 101600 - cost: nan\n",
            "Iteration: 101700 - cost: nan\n",
            "Iteration: 101800 - cost: nan\n",
            "Iteration: 101900 - cost: nan\n",
            "Iteration: 102000 - cost: nan\n",
            "Iteration: 102100 - cost: nan\n",
            "Iteration: 102200 - cost: nan\n",
            "Iteration: 102300 - cost: nan\n",
            "Iteration: 102400 - cost: nan\n",
            "Iteration: 102500 - cost: nan\n",
            "Iteration: 102600 - cost: nan\n",
            "Iteration: 102700 - cost: nan\n",
            "Iteration: 102800 - cost: nan\n",
            "Iteration: 102900 - cost: nan\n",
            "Iteration: 103000 - cost: nan\n",
            "Iteration: 103100 - cost: nan\n",
            "Iteration: 103200 - cost: nan\n",
            "Iteration: 103300 - cost: nan\n",
            "Iteration: 103400 - cost: nan\n",
            "Iteration: 103500 - cost: nan\n",
            "Iteration: 103600 - cost: nan\n",
            "Iteration: 103700 - cost: nan\n",
            "Iteration: 103800 - cost: nan\n",
            "Iteration: 103900 - cost: nan\n",
            "Iteration: 104000 - cost: nan\n",
            "Iteration: 104100 - cost: nan\n",
            "Iteration: 104200 - cost: nan\n",
            "Iteration: 104300 - cost: nan\n",
            "Iteration: 104400 - cost: nan\n",
            "Iteration: 104500 - cost: nan\n",
            "Iteration: 104600 - cost: nan\n",
            "Iteration: 104700 - cost: nan\n",
            "Iteration: 104800 - cost: nan\n",
            "Iteration: 104900 - cost: nan\n",
            "Iteration: 105000 - cost: nan\n",
            "Iteration: 105100 - cost: nan\n",
            "Iteration: 105200 - cost: nan\n",
            "Iteration: 105300 - cost: nan\n",
            "Iteration: 105400 - cost: nan\n",
            "Iteration: 105500 - cost: nan\n",
            "Iteration: 105600 - cost: nan\n",
            "Iteration: 105700 - cost: nan\n",
            "Iteration: 105800 - cost: nan\n",
            "Iteration: 105900 - cost: nan\n",
            "Iteration: 106000 - cost: nan\n",
            "Iteration: 106100 - cost: nan\n",
            "Iteration: 106200 - cost: nan\n",
            "Iteration: 106300 - cost: nan\n",
            "Iteration: 106400 - cost: nan\n",
            "Iteration: 106500 - cost: nan\n",
            "Iteration: 106600 - cost: nan\n",
            "Iteration: 106700 - cost: nan\n",
            "Iteration: 106800 - cost: nan\n",
            "Iteration: 106900 - cost: nan\n",
            "Iteration: 107000 - cost: nan\n",
            "Iteration: 107100 - cost: nan\n",
            "Iteration: 107200 - cost: nan\n",
            "Iteration: 107300 - cost: nan\n",
            "Iteration: 107400 - cost: nan\n",
            "Iteration: 107500 - cost: nan\n",
            "Iteration: 107600 - cost: nan\n",
            "Iteration: 107700 - cost: nan\n",
            "Iteration: 107800 - cost: nan\n",
            "Iteration: 107900 - cost: nan\n",
            "Iteration: 108000 - cost: nan\n",
            "Iteration: 108100 - cost: nan\n",
            "Iteration: 108200 - cost: nan\n",
            "Iteration: 108300 - cost: nan\n",
            "Iteration: 108400 - cost: nan\n",
            "Iteration: 108500 - cost: nan\n",
            "Iteration: 108600 - cost: nan\n",
            "Iteration: 108700 - cost: nan\n",
            "Iteration: 108800 - cost: nan\n",
            "Iteration: 108900 - cost: nan\n",
            "Iteration: 109000 - cost: nan\n",
            "Iteration: 109100 - cost: nan\n",
            "Iteration: 109200 - cost: nan\n",
            "Iteration: 109300 - cost: nan\n",
            "Iteration: 109400 - cost: nan\n",
            "Iteration: 109500 - cost: nan\n",
            "Iteration: 109600 - cost: nan\n",
            "Iteration: 109700 - cost: nan\n",
            "Iteration: 109800 - cost: nan\n",
            "Iteration: 109900 - cost: nan\n",
            "Iteration: 110000 - cost: nan\n",
            "Iteration: 110100 - cost: nan\n",
            "Iteration: 110200 - cost: nan\n",
            "Iteration: 110300 - cost: nan\n",
            "Iteration: 110400 - cost: nan\n",
            "Iteration: 110500 - cost: nan\n",
            "Iteration: 110600 - cost: nan\n",
            "Iteration: 110700 - cost: nan\n",
            "Iteration: 110800 - cost: nan\n",
            "Iteration: 110900 - cost: nan\n",
            "Iteration: 111000 - cost: nan\n",
            "Iteration: 111100 - cost: nan\n",
            "Iteration: 111200 - cost: nan\n",
            "Iteration: 111300 - cost: nan\n",
            "Iteration: 111400 - cost: nan\n",
            "Iteration: 111500 - cost: nan\n",
            "Iteration: 111600 - cost: nan\n",
            "Iteration: 111700 - cost: nan\n",
            "Iteration: 111800 - cost: nan\n",
            "Iteration: 111900 - cost: nan\n",
            "Iteration: 112000 - cost: nan\n",
            "Iteration: 112100 - cost: nan\n",
            "Iteration: 112200 - cost: nan\n",
            "Iteration: 112300 - cost: nan\n",
            "Iteration: 112400 - cost: nan\n",
            "Iteration: 112500 - cost: nan\n",
            "Iteration: 112600 - cost: nan\n",
            "Iteration: 112700 - cost: nan\n",
            "Iteration: 112800 - cost: nan\n",
            "Iteration: 112900 - cost: nan\n",
            "Iteration: 113000 - cost: nan\n",
            "Iteration: 113100 - cost: nan\n",
            "Iteration: 113200 - cost: nan\n",
            "Iteration: 113300 - cost: nan\n",
            "Iteration: 113400 - cost: nan\n",
            "Iteration: 113500 - cost: nan\n",
            "Iteration: 113600 - cost: nan\n",
            "Iteration: 113700 - cost: nan\n",
            "Iteration: 113800 - cost: nan\n",
            "Iteration: 113900 - cost: nan\n",
            "Iteration: 114000 - cost: nan\n",
            "Iteration: 114100 - cost: nan\n",
            "Iteration: 114200 - cost: nan\n",
            "Iteration: 114300 - cost: nan\n",
            "Iteration: 114400 - cost: nan\n",
            "Iteration: 114500 - cost: nan\n",
            "Iteration: 114600 - cost: nan\n",
            "Iteration: 114700 - cost: nan\n",
            "Iteration: 114800 - cost: nan\n",
            "Iteration: 114900 - cost: nan\n",
            "Iteration: 115000 - cost: nan\n",
            "Iteration: 115100 - cost: nan\n",
            "Iteration: 115200 - cost: nan\n",
            "Iteration: 115300 - cost: nan\n",
            "Iteration: 115400 - cost: nan\n",
            "Iteration: 115500 - cost: nan\n",
            "Iteration: 115600 - cost: nan\n",
            "Iteration: 115700 - cost: nan\n",
            "Iteration: 115800 - cost: nan\n",
            "Iteration: 115900 - cost: nan\n",
            "Iteration: 116000 - cost: nan\n",
            "Iteration: 116100 - cost: nan\n",
            "Iteration: 116200 - cost: nan\n",
            "Iteration: 116300 - cost: nan\n",
            "Iteration: 116400 - cost: nan\n",
            "Iteration: 116500 - cost: nan\n",
            "Iteration: 116600 - cost: nan\n",
            "Iteration: 116700 - cost: nan\n",
            "Iteration: 116800 - cost: nan\n",
            "Iteration: 116900 - cost: nan\n",
            "Iteration: 117000 - cost: nan\n",
            "Iteration: 117100 - cost: nan\n",
            "Iteration: 117200 - cost: nan\n",
            "Iteration: 117300 - cost: nan\n",
            "Iteration: 117400 - cost: nan\n",
            "Iteration: 117500 - cost: nan\n",
            "Iteration: 117600 - cost: nan\n",
            "Iteration: 117700 - cost: nan\n",
            "Iteration: 117800 - cost: nan\n",
            "Iteration: 117900 - cost: nan\n",
            "Iteration: 118000 - cost: nan\n",
            "Iteration: 118100 - cost: nan\n",
            "Iteration: 118200 - cost: nan\n",
            "Iteration: 118300 - cost: nan\n",
            "Iteration: 118400 - cost: nan\n",
            "Iteration: 118500 - cost: nan\n",
            "Iteration: 118600 - cost: nan\n",
            "Iteration: 118700 - cost: nan\n",
            "Iteration: 118800 - cost: nan\n",
            "Iteration: 118900 - cost: nan\n",
            "Iteration: 119000 - cost: nan\n",
            "Iteration: 119100 - cost: nan\n",
            "Iteration: 119200 - cost: nan\n",
            "Iteration: 119300 - cost: nan\n",
            "Iteration: 119400 - cost: nan\n",
            "Iteration: 119500 - cost: nan\n",
            "Iteration: 119600 - cost: nan\n",
            "Iteration: 119700 - cost: nan\n",
            "Iteration: 119800 - cost: nan\n",
            "Iteration: 119900 - cost: nan\n",
            "Iteration: 120000 - cost: nan\n",
            "Iteration: 120100 - cost: nan\n",
            "Iteration: 120200 - cost: nan\n",
            "Iteration: 120300 - cost: nan\n",
            "Iteration: 120400 - cost: nan\n",
            "Iteration: 120500 - cost: nan\n",
            "Iteration: 120600 - cost: nan\n",
            "Iteration: 120700 - cost: nan\n",
            "Iteration: 120800 - cost: nan\n",
            "Iteration: 120900 - cost: nan\n",
            "Iteration: 121000 - cost: nan\n",
            "Iteration: 121100 - cost: nan\n",
            "Iteration: 121200 - cost: nan\n",
            "Iteration: 121300 - cost: nan\n",
            "Iteration: 121400 - cost: nan\n",
            "Iteration: 121500 - cost: nan\n",
            "Iteration: 121600 - cost: nan\n",
            "Iteration: 121700 - cost: nan\n",
            "Iteration: 121800 - cost: nan\n",
            "Iteration: 121900 - cost: nan\n",
            "Iteration: 122000 - cost: nan\n",
            "Iteration: 122100 - cost: nan\n",
            "Iteration: 122200 - cost: nan\n",
            "Iteration: 122300 - cost: nan\n",
            "Iteration: 122400 - cost: nan\n",
            "Iteration: 122500 - cost: nan\n",
            "Iteration: 122600 - cost: nan\n",
            "Iteration: 122700 - cost: nan\n",
            "Iteration: 122800 - cost: nan\n",
            "Iteration: 122900 - cost: nan\n",
            "Iteration: 123000 - cost: nan\n",
            "Iteration: 123100 - cost: nan\n",
            "Iteration: 123200 - cost: nan\n",
            "Iteration: 123300 - cost: nan\n",
            "Iteration: 123400 - cost: nan\n",
            "Iteration: 123500 - cost: nan\n",
            "Iteration: 123600 - cost: nan\n",
            "Iteration: 123700 - cost: nan\n",
            "Iteration: 123800 - cost: nan\n",
            "Iteration: 123900 - cost: nan\n",
            "Iteration: 124000 - cost: nan\n",
            "Iteration: 124100 - cost: nan\n",
            "Iteration: 124200 - cost: nan\n",
            "Iteration: 124300 - cost: nan\n",
            "Iteration: 124400 - cost: nan\n",
            "Iteration: 124500 - cost: nan\n",
            "Iteration: 124600 - cost: nan\n",
            "Iteration: 124700 - cost: nan\n",
            "Iteration: 124800 - cost: nan\n",
            "Iteration: 124900 - cost: nan\n",
            "Iteration: 125000 - cost: nan\n",
            "Iteration: 125100 - cost: nan\n",
            "Iteration: 125200 - cost: nan\n",
            "Iteration: 125300 - cost: nan\n",
            "Iteration: 125400 - cost: nan\n",
            "Iteration: 125500 - cost: nan\n",
            "Iteration: 125600 - cost: nan\n",
            "Iteration: 125700 - cost: nan\n",
            "Iteration: 125800 - cost: nan\n",
            "Iteration: 125900 - cost: nan\n",
            "Iteration: 126000 - cost: nan\n",
            "Iteration: 126100 - cost: nan\n",
            "Iteration: 126200 - cost: nan\n",
            "Iteration: 126300 - cost: nan\n",
            "Iteration: 126400 - cost: nan\n",
            "Iteration: 126500 - cost: nan\n",
            "Iteration: 126600 - cost: nan\n",
            "Iteration: 126700 - cost: nan\n",
            "Iteration: 126800 - cost: nan\n",
            "Iteration: 126900 - cost: nan\n",
            "Iteration: 127000 - cost: nan\n",
            "Iteration: 127100 - cost: nan\n",
            "Iteration: 127200 - cost: nan\n",
            "Iteration: 127300 - cost: nan\n",
            "Iteration: 127400 - cost: nan\n",
            "Iteration: 127500 - cost: nan\n",
            "Iteration: 127600 - cost: nan\n",
            "Iteration: 127700 - cost: nan\n",
            "Iteration: 127800 - cost: nan\n",
            "Iteration: 127900 - cost: nan\n",
            "Iteration: 128000 - cost: nan\n",
            "Iteration: 128100 - cost: nan\n",
            "Iteration: 128200 - cost: nan\n",
            "Iteration: 128300 - cost: nan\n",
            "Iteration: 128400 - cost: nan\n",
            "Iteration: 128500 - cost: nan\n",
            "Iteration: 128600 - cost: nan\n",
            "Iteration: 128700 - cost: nan\n",
            "Iteration: 128800 - cost: nan\n",
            "Iteration: 128900 - cost: nan\n",
            "Iteration: 129000 - cost: nan\n",
            "Iteration: 129100 - cost: nan\n",
            "Iteration: 129200 - cost: nan\n",
            "Iteration: 129300 - cost: nan\n",
            "Iteration: 129400 - cost: nan\n",
            "Iteration: 129500 - cost: nan\n",
            "Iteration: 129600 - cost: nan\n",
            "Iteration: 129700 - cost: nan\n",
            "Iteration: 129800 - cost: nan\n",
            "Iteration: 129900 - cost: nan\n",
            "Iteration: 130000 - cost: nan\n",
            "Iteration: 130100 - cost: nan\n",
            "Iteration: 130200 - cost: nan\n",
            "Iteration: 130300 - cost: nan\n",
            "Iteration: 130400 - cost: nan\n",
            "Iteration: 130500 - cost: nan\n",
            "Iteration: 130600 - cost: nan\n",
            "Iteration: 130700 - cost: nan\n",
            "Iteration: 130800 - cost: nan\n",
            "Iteration: 130900 - cost: nan\n",
            "Iteration: 131000 - cost: nan\n",
            "Iteration: 131100 - cost: nan\n",
            "Iteration: 131200 - cost: nan\n",
            "Iteration: 131300 - cost: nan\n",
            "Iteration: 131400 - cost: nan\n",
            "Iteration: 131500 - cost: nan\n",
            "Iteration: 131600 - cost: nan\n",
            "Iteration: 131700 - cost: nan\n",
            "Iteration: 131800 - cost: nan\n",
            "Iteration: 131900 - cost: nan\n",
            "Iteration: 132000 - cost: nan\n",
            "Iteration: 132100 - cost: nan\n",
            "Iteration: 132200 - cost: nan\n",
            "Iteration: 132300 - cost: nan\n",
            "Iteration: 132400 - cost: nan\n",
            "Iteration: 132500 - cost: nan\n",
            "Iteration: 132600 - cost: nan\n",
            "Iteration: 132700 - cost: nan\n",
            "Iteration: 132800 - cost: nan\n",
            "Iteration: 132900 - cost: nan\n",
            "Iteration: 133000 - cost: nan\n",
            "Iteration: 133100 - cost: nan\n",
            "Iteration: 133200 - cost: nan\n",
            "Iteration: 133300 - cost: nan\n",
            "Iteration: 133400 - cost: nan\n",
            "Iteration: 133500 - cost: nan\n",
            "Iteration: 133600 - cost: nan\n",
            "Iteration: 133700 - cost: nan\n",
            "Iteration: 133800 - cost: nan\n",
            "Iteration: 133900 - cost: nan\n",
            "Iteration: 134000 - cost: nan\n",
            "Iteration: 134100 - cost: nan\n",
            "Iteration: 134200 - cost: nan\n",
            "Iteration: 134300 - cost: nan\n",
            "Iteration: 134400 - cost: nan\n",
            "Iteration: 134500 - cost: nan\n",
            "Iteration: 134600 - cost: nan\n",
            "Iteration: 134700 - cost: nan\n",
            "Iteration: 134800 - cost: nan\n",
            "Iteration: 134900 - cost: nan\n",
            "Iteration: 135000 - cost: nan\n",
            "Iteration: 135100 - cost: nan\n",
            "Iteration: 135200 - cost: nan\n",
            "Iteration: 135300 - cost: nan\n",
            "Iteration: 135400 - cost: nan\n",
            "Iteration: 135500 - cost: nan\n",
            "Iteration: 135600 - cost: nan\n",
            "Iteration: 135700 - cost: nan\n",
            "Iteration: 135800 - cost: nan\n",
            "Iteration: 135900 - cost: nan\n",
            "Iteration: 136000 - cost: nan\n",
            "Iteration: 136100 - cost: nan\n",
            "Iteration: 136200 - cost: nan\n",
            "Iteration: 136300 - cost: nan\n",
            "Iteration: 136400 - cost: nan\n",
            "Iteration: 136500 - cost: nan\n",
            "Iteration: 136600 - cost: nan\n",
            "Iteration: 136700 - cost: nan\n",
            "Iteration: 136800 - cost: nan\n",
            "Iteration: 136900 - cost: nan\n",
            "Iteration: 137000 - cost: nan\n",
            "Iteration: 137100 - cost: nan\n",
            "Iteration: 137200 - cost: nan\n",
            "Iteration: 137300 - cost: nan\n",
            "Iteration: 137400 - cost: nan\n",
            "Iteration: 137500 - cost: nan\n",
            "Iteration: 137600 - cost: nan\n",
            "Iteration: 137700 - cost: nan\n",
            "Iteration: 137800 - cost: nan\n",
            "Iteration: 137900 - cost: nan\n",
            "Iteration: 138000 - cost: nan\n",
            "Iteration: 138100 - cost: nan\n",
            "Iteration: 138200 - cost: nan\n",
            "Iteration: 138300 - cost: nan\n",
            "Iteration: 138400 - cost: nan\n",
            "Iteration: 138500 - cost: nan\n",
            "Iteration: 138600 - cost: nan\n",
            "Iteration: 138700 - cost: nan\n",
            "Iteration: 138800 - cost: nan\n",
            "Iteration: 138900 - cost: nan\n",
            "Iteration: 139000 - cost: nan\n",
            "Iteration: 139100 - cost: nan\n",
            "Iteration: 139200 - cost: nan\n",
            "Iteration: 139300 - cost: nan\n",
            "Iteration: 139400 - cost: nan\n",
            "Iteration: 139500 - cost: nan\n",
            "Iteration: 139600 - cost: nan\n",
            "Iteration: 139700 - cost: nan\n",
            "Iteration: 139800 - cost: nan\n",
            "Iteration: 139900 - cost: nan\n",
            "Iteration: 140000 - cost: nan\n",
            "Iteration: 140100 - cost: nan\n",
            "Iteration: 140200 - cost: nan\n",
            "Iteration: 140300 - cost: nan\n",
            "Iteration: 140400 - cost: nan\n",
            "Iteration: 140500 - cost: nan\n",
            "Iteration: 140600 - cost: nan\n",
            "Iteration: 140700 - cost: nan\n",
            "Iteration: 140800 - cost: nan\n",
            "Iteration: 140900 - cost: nan\n",
            "Iteration: 141000 - cost: nan\n",
            "Iteration: 141100 - cost: nan\n",
            "Iteration: 141200 - cost: nan\n",
            "Iteration: 141300 - cost: nan\n",
            "Iteration: 141400 - cost: nan\n",
            "Iteration: 141500 - cost: nan\n",
            "Iteration: 141600 - cost: nan\n",
            "Iteration: 141700 - cost: nan\n",
            "Iteration: 141800 - cost: nan\n",
            "Iteration: 141900 - cost: nan\n",
            "Iteration: 142000 - cost: nan\n",
            "Iteration: 142100 - cost: nan\n",
            "Iteration: 142200 - cost: nan\n",
            "Iteration: 142300 - cost: nan\n",
            "Iteration: 142400 - cost: nan\n",
            "Iteration: 142500 - cost: nan\n",
            "Iteration: 142600 - cost: nan\n",
            "Iteration: 142700 - cost: nan\n",
            "Iteration: 142800 - cost: nan\n",
            "Iteration: 142900 - cost: nan\n",
            "Iteration: 143000 - cost: nan\n",
            "Iteration: 143100 - cost: nan\n",
            "Iteration: 143200 - cost: nan\n",
            "Iteration: 143300 - cost: nan\n",
            "Iteration: 143400 - cost: nan\n",
            "Iteration: 143500 - cost: nan\n",
            "Iteration: 143600 - cost: nan\n",
            "Iteration: 143700 - cost: nan\n",
            "Iteration: 143800 - cost: nan\n",
            "Iteration: 143900 - cost: nan\n",
            "Iteration: 144000 - cost: nan\n",
            "Iteration: 144100 - cost: nan\n",
            "Iteration: 144200 - cost: nan\n",
            "Iteration: 144300 - cost: nan\n",
            "Iteration: 144400 - cost: nan\n",
            "Iteration: 144500 - cost: nan\n",
            "Iteration: 144600 - cost: nan\n",
            "Iteration: 144700 - cost: nan\n",
            "Iteration: 144800 - cost: nan\n",
            "Iteration: 144900 - cost: nan\n",
            "Iteration: 145000 - cost: nan\n",
            "Iteration: 145100 - cost: nan\n",
            "Iteration: 145200 - cost: nan\n",
            "Iteration: 145300 - cost: nan\n",
            "Iteration: 145400 - cost: nan\n",
            "Iteration: 145500 - cost: nan\n",
            "Iteration: 145600 - cost: nan\n",
            "Iteration: 145700 - cost: nan\n",
            "Iteration: 145800 - cost: nan\n",
            "Iteration: 145900 - cost: nan\n",
            "Iteration: 146000 - cost: nan\n",
            "Iteration: 146100 - cost: nan\n",
            "Iteration: 146200 - cost: nan\n",
            "Iteration: 146300 - cost: nan\n",
            "Iteration: 146400 - cost: nan\n",
            "Iteration: 146500 - cost: nan\n",
            "Iteration: 146600 - cost: nan\n",
            "Iteration: 146700 - cost: nan\n",
            "Iteration: 146800 - cost: nan\n",
            "Iteration: 146900 - cost: nan\n",
            "Iteration: 147000 - cost: nan\n",
            "Iteration: 147100 - cost: nan\n",
            "Iteration: 147200 - cost: nan\n",
            "Iteration: 147300 - cost: nan\n",
            "Iteration: 147400 - cost: nan\n",
            "Iteration: 147500 - cost: nan\n",
            "Iteration: 147600 - cost: nan\n",
            "Iteration: 147700 - cost: nan\n",
            "Iteration: 147800 - cost: nan\n",
            "Iteration: 147900 - cost: nan\n",
            "Iteration: 148000 - cost: nan\n",
            "Iteration: 148100 - cost: nan\n",
            "Iteration: 148200 - cost: nan\n",
            "Iteration: 148300 - cost: nan\n",
            "Iteration: 148400 - cost: nan\n",
            "Iteration: 148500 - cost: nan\n",
            "Iteration: 148600 - cost: nan\n",
            "Iteration: 148700 - cost: nan\n",
            "Iteration: 148800 - cost: nan\n",
            "Iteration: 148900 - cost: nan\n",
            "Iteration: 149000 - cost: nan\n",
            "Iteration: 149100 - cost: nan\n",
            "Iteration: 149200 - cost: nan\n",
            "Iteration: 149300 - cost: nan\n",
            "Iteration: 149400 - cost: nan\n",
            "Iteration: 149500 - cost: nan\n",
            "Iteration: 149600 - cost: nan\n",
            "Iteration: 149700 - cost: nan\n",
            "Iteration: 149800 - cost: nan\n",
            "Iteration: 149900 - cost: nan\n",
            "Iteration: 150000 - cost: nan\n",
            "Iteration: 150100 - cost: nan\n",
            "Iteration: 150200 - cost: nan\n",
            "Iteration: 150300 - cost: nan\n",
            "Iteration: 150400 - cost: nan\n",
            "Iteration: 150500 - cost: nan\n",
            "Iteration: 150600 - cost: nan\n",
            "Iteration: 150700 - cost: nan\n",
            "Iteration: 150800 - cost: nan\n",
            "Iteration: 150900 - cost: nan\n",
            "Iteration: 151000 - cost: nan\n",
            "Iteration: 151100 - cost: nan\n",
            "Iteration: 151200 - cost: nan\n",
            "Iteration: 151300 - cost: nan\n",
            "Iteration: 151400 - cost: nan\n",
            "Iteration: 151500 - cost: nan\n",
            "Iteration: 151600 - cost: nan\n",
            "Iteration: 151700 - cost: nan\n",
            "Iteration: 151800 - cost: nan\n",
            "Iteration: 151900 - cost: nan\n",
            "Iteration: 152000 - cost: nan\n",
            "Iteration: 152100 - cost: nan\n",
            "Iteration: 152200 - cost: nan\n",
            "Iteration: 152300 - cost: nan\n",
            "Iteration: 152400 - cost: nan\n",
            "Iteration: 152500 - cost: nan\n",
            "Iteration: 152600 - cost: nan\n",
            "Iteration: 152700 - cost: nan\n",
            "Iteration: 152800 - cost: nan\n",
            "Iteration: 152900 - cost: nan\n",
            "Iteration: 153000 - cost: nan\n",
            "Iteration: 153100 - cost: nan\n",
            "Iteration: 153200 - cost: nan\n",
            "Iteration: 153300 - cost: nan\n",
            "Iteration: 153400 - cost: nan\n",
            "Iteration: 153500 - cost: nan\n",
            "Iteration: 153600 - cost: nan\n",
            "Iteration: 153700 - cost: nan\n",
            "Iteration: 153800 - cost: nan\n",
            "Iteration: 153900 - cost: nan\n",
            "Iteration: 154000 - cost: nan\n",
            "Iteration: 154100 - cost: nan\n",
            "Iteration: 154200 - cost: nan\n",
            "Iteration: 154300 - cost: nan\n",
            "Iteration: 154400 - cost: nan\n",
            "Iteration: 154500 - cost: nan\n",
            "Iteration: 154600 - cost: nan\n",
            "Iteration: 154700 - cost: nan\n",
            "Iteration: 154800 - cost: nan\n",
            "Iteration: 154900 - cost: nan\n",
            "Iteration: 155000 - cost: nan\n",
            "Iteration: 155100 - cost: nan\n",
            "Iteration: 155200 - cost: nan\n",
            "Iteration: 155300 - cost: nan\n",
            "Iteration: 155400 - cost: nan\n",
            "Iteration: 155500 - cost: nan\n",
            "Iteration: 155600 - cost: nan\n",
            "Iteration: 155700 - cost: nan\n",
            "Iteration: 155800 - cost: nan\n",
            "Iteration: 155900 - cost: nan\n",
            "Iteration: 156000 - cost: nan\n",
            "Iteration: 156100 - cost: nan\n",
            "Iteration: 156200 - cost: nan\n",
            "Iteration: 156300 - cost: nan\n",
            "Iteration: 156400 - cost: nan\n",
            "Iteration: 156500 - cost: nan\n",
            "Iteration: 156600 - cost: nan\n",
            "Iteration: 156700 - cost: nan\n",
            "Iteration: 156800 - cost: nan\n",
            "Iteration: 156900 - cost: nan\n",
            "Iteration: 157000 - cost: nan\n",
            "Iteration: 157100 - cost: nan\n",
            "Iteration: 157200 - cost: nan\n",
            "Iteration: 157300 - cost: nan\n",
            "Iteration: 157400 - cost: nan\n",
            "Iteration: 157500 - cost: nan\n",
            "Iteration: 157600 - cost: nan\n",
            "Iteration: 157700 - cost: nan\n",
            "Iteration: 157800 - cost: nan\n",
            "Iteration: 157900 - cost: nan\n",
            "Iteration: 158000 - cost: nan\n",
            "Iteration: 158100 - cost: nan\n",
            "Iteration: 158200 - cost: nan\n",
            "Iteration: 158300 - cost: nan\n",
            "Iteration: 158400 - cost: nan\n",
            "Iteration: 158500 - cost: nan\n",
            "Iteration: 158600 - cost: nan\n",
            "Iteration: 158700 - cost: nan\n",
            "Iteration: 158800 - cost: nan\n",
            "Iteration: 158900 - cost: nan\n",
            "Iteration: 159000 - cost: nan\n",
            "Iteration: 159100 - cost: nan\n",
            "Iteration: 159200 - cost: nan\n",
            "Iteration: 159300 - cost: nan\n",
            "Iteration: 159400 - cost: nan\n",
            "Iteration: 159500 - cost: nan\n",
            "Iteration: 159600 - cost: nan\n",
            "Iteration: 159700 - cost: nan\n",
            "Iteration: 159800 - cost: nan\n",
            "Iteration: 159900 - cost: nan\n",
            "Iteration: 160000 - cost: nan\n",
            "Iteration: 160100 - cost: nan\n",
            "Iteration: 160200 - cost: nan\n",
            "Iteration: 160300 - cost: nan\n",
            "Iteration: 160400 - cost: nan\n",
            "Iteration: 160500 - cost: nan\n",
            "Iteration: 160600 - cost: nan\n",
            "Iteration: 160700 - cost: nan\n",
            "Iteration: 160800 - cost: nan\n",
            "Iteration: 160900 - cost: nan\n",
            "Iteration: 161000 - cost: nan\n",
            "Iteration: 161100 - cost: nan\n",
            "Iteration: 161200 - cost: nan\n",
            "Iteration: 161300 - cost: nan\n",
            "Iteration: 161400 - cost: nan\n",
            "Iteration: 161500 - cost: nan\n",
            "Iteration: 161600 - cost: nan\n",
            "Iteration: 161700 - cost: nan\n",
            "Iteration: 161800 - cost: nan\n",
            "Iteration: 161900 - cost: nan\n",
            "Iteration: 162000 - cost: nan\n",
            "Iteration: 162100 - cost: nan\n",
            "Iteration: 162200 - cost: nan\n",
            "Iteration: 162300 - cost: nan\n",
            "Iteration: 162400 - cost: nan\n",
            "Iteration: 162500 - cost: nan\n",
            "Iteration: 162600 - cost: nan\n",
            "Iteration: 162700 - cost: nan\n",
            "Iteration: 162800 - cost: nan\n",
            "Iteration: 162900 - cost: nan\n",
            "Iteration: 163000 - cost: nan\n",
            "Iteration: 163100 - cost: nan\n",
            "Iteration: 163200 - cost: nan\n",
            "Iteration: 163300 - cost: nan\n",
            "Iteration: 163400 - cost: nan\n",
            "Iteration: 163500 - cost: nan\n",
            "Iteration: 163600 - cost: nan\n",
            "Iteration: 163700 - cost: nan\n",
            "Iteration: 163800 - cost: nan\n",
            "Iteration: 163900 - cost: nan\n",
            "Iteration: 164000 - cost: nan\n",
            "Iteration: 164100 - cost: nan\n",
            "Iteration: 164200 - cost: nan\n",
            "Iteration: 164300 - cost: nan\n",
            "Iteration: 164400 - cost: nan\n",
            "Iteration: 164500 - cost: nan\n",
            "Iteration: 164600 - cost: nan\n",
            "Iteration: 164700 - cost: nan\n",
            "Iteration: 164800 - cost: nan\n",
            "Iteration: 164900 - cost: nan\n",
            "Iteration: 165000 - cost: nan\n",
            "Iteration: 165100 - cost: nan\n",
            "Iteration: 165200 - cost: nan\n",
            "Iteration: 165300 - cost: nan\n",
            "Iteration: 165400 - cost: nan\n",
            "Iteration: 165500 - cost: nan\n",
            "Iteration: 165600 - cost: nan\n",
            "Iteration: 165700 - cost: nan\n",
            "Iteration: 165800 - cost: nan\n",
            "Iteration: 165900 - cost: nan\n",
            "Iteration: 166000 - cost: nan\n",
            "Iteration: 166100 - cost: nan\n",
            "Iteration: 166200 - cost: nan\n",
            "Iteration: 166300 - cost: nan\n",
            "Iteration: 166400 - cost: nan\n",
            "Iteration: 166500 - cost: nan\n",
            "Iteration: 166600 - cost: nan\n",
            "Iteration: 166700 - cost: nan\n",
            "Iteration: 166800 - cost: nan\n",
            "Iteration: 166900 - cost: nan\n",
            "Iteration: 167000 - cost: nan\n",
            "Iteration: 167100 - cost: nan\n",
            "Iteration: 167200 - cost: nan\n",
            "Iteration: 167300 - cost: nan\n",
            "Iteration: 167400 - cost: nan\n",
            "Iteration: 167500 - cost: nan\n",
            "Iteration: 167600 - cost: nan\n",
            "Iteration: 167700 - cost: nan\n",
            "Iteration: 167800 - cost: nan\n",
            "Iteration: 167900 - cost: nan\n",
            "Iteration: 168000 - cost: nan\n",
            "Iteration: 168100 - cost: nan\n",
            "Iteration: 168200 - cost: nan\n",
            "Iteration: 168300 - cost: nan\n",
            "Iteration: 168400 - cost: nan\n",
            "Iteration: 168500 - cost: nan\n",
            "Iteration: 168600 - cost: nan\n",
            "Iteration: 168700 - cost: nan\n",
            "Iteration: 168800 - cost: nan\n",
            "Iteration: 168900 - cost: nan\n",
            "Iteration: 169000 - cost: nan\n",
            "Iteration: 169100 - cost: nan\n",
            "Iteration: 169200 - cost: nan\n",
            "Iteration: 169300 - cost: nan\n",
            "Iteration: 169400 - cost: nan\n",
            "Iteration: 169500 - cost: nan\n",
            "Iteration: 169600 - cost: nan\n",
            "Iteration: 169700 - cost: nan\n",
            "Iteration: 169800 - cost: nan\n",
            "Iteration: 169900 - cost: nan\n",
            "Iteration: 170000 - cost: nan\n",
            "Iteration: 170100 - cost: nan\n",
            "Iteration: 170200 - cost: nan\n",
            "Iteration: 170300 - cost: nan\n",
            "Iteration: 170400 - cost: nan\n",
            "Iteration: 170500 - cost: nan\n",
            "Iteration: 170600 - cost: nan\n",
            "Iteration: 170700 - cost: nan\n",
            "Iteration: 170800 - cost: nan\n",
            "Iteration: 170900 - cost: nan\n",
            "Iteration: 171000 - cost: nan\n",
            "Iteration: 171100 - cost: nan\n",
            "Iteration: 171200 - cost: nan\n",
            "Iteration: 171300 - cost: nan\n",
            "Iteration: 171400 - cost: nan\n",
            "Iteration: 171500 - cost: nan\n",
            "Iteration: 171600 - cost: nan\n",
            "Iteration: 171700 - cost: nan\n",
            "Iteration: 171800 - cost: nan\n",
            "Iteration: 171900 - cost: nan\n",
            "Iteration: 172000 - cost: nan\n",
            "Iteration: 172100 - cost: nan\n",
            "Iteration: 172200 - cost: nan\n",
            "Iteration: 172300 - cost: nan\n",
            "Iteration: 172400 - cost: nan\n",
            "Iteration: 172500 - cost: nan\n",
            "Iteration: 172600 - cost: nan\n",
            "Iteration: 172700 - cost: nan\n",
            "Iteration: 172800 - cost: nan\n",
            "Iteration: 172900 - cost: nan\n",
            "Iteration: 173000 - cost: nan\n",
            "Iteration: 173100 - cost: nan\n",
            "Iteration: 173200 - cost: nan\n",
            "Iteration: 173300 - cost: nan\n",
            "Iteration: 173400 - cost: nan\n",
            "Iteration: 173500 - cost: nan\n",
            "Iteration: 173600 - cost: nan\n",
            "Iteration: 173700 - cost: nan\n",
            "Iteration: 173800 - cost: nan\n",
            "Iteration: 173900 - cost: nan\n",
            "Iteration: 174000 - cost: nan\n",
            "Iteration: 174100 - cost: nan\n",
            "Iteration: 174200 - cost: nan\n",
            "Iteration: 174300 - cost: nan\n",
            "Iteration: 174400 - cost: nan\n",
            "Iteration: 174500 - cost: nan\n",
            "Iteration: 174600 - cost: nan\n",
            "Iteration: 174700 - cost: nan\n",
            "Iteration: 174800 - cost: nan\n",
            "Iteration: 174900 - cost: nan\n",
            "Iteration: 175000 - cost: nan\n",
            "Iteration: 175100 - cost: nan\n",
            "Iteration: 175200 - cost: nan\n",
            "Iteration: 175300 - cost: nan\n",
            "Iteration: 175400 - cost: nan\n",
            "Iteration: 175500 - cost: nan\n",
            "Iteration: 175600 - cost: nan\n",
            "Iteration: 175700 - cost: nan\n",
            "Iteration: 175800 - cost: nan\n",
            "Iteration: 175900 - cost: nan\n",
            "Iteration: 176000 - cost: nan\n",
            "Iteration: 176100 - cost: nan\n",
            "Iteration: 176200 - cost: nan\n",
            "Iteration: 176300 - cost: nan\n",
            "Iteration: 176400 - cost: nan\n",
            "Iteration: 176500 - cost: nan\n",
            "Iteration: 176600 - cost: nan\n",
            "Iteration: 176700 - cost: nan\n",
            "Iteration: 176800 - cost: nan\n",
            "Iteration: 176900 - cost: nan\n",
            "Iteration: 177000 - cost: nan\n",
            "Iteration: 177100 - cost: nan\n",
            "Iteration: 177200 - cost: nan\n",
            "Iteration: 177300 - cost: nan\n",
            "Iteration: 177400 - cost: nan\n",
            "Iteration: 177500 - cost: nan\n",
            "Iteration: 177600 - cost: nan\n",
            "Iteration: 177700 - cost: nan\n",
            "Iteration: 177800 - cost: nan\n",
            "Iteration: 177900 - cost: nan\n",
            "Iteration: 178000 - cost: nan\n",
            "Iteration: 178100 - cost: nan\n",
            "Iteration: 178200 - cost: nan\n",
            "Iteration: 178300 - cost: nan\n",
            "Iteration: 178400 - cost: nan\n",
            "Iteration: 178500 - cost: nan\n",
            "Iteration: 178600 - cost: nan\n",
            "Iteration: 178700 - cost: nan\n",
            "Iteration: 178800 - cost: nan\n",
            "Iteration: 178900 - cost: nan\n",
            "Iteration: 179000 - cost: nan\n",
            "Iteration: 179100 - cost: nan\n",
            "Iteration: 179200 - cost: nan\n",
            "Iteration: 179300 - cost: nan\n",
            "Iteration: 179400 - cost: nan\n",
            "Iteration: 179500 - cost: nan\n",
            "Iteration: 179600 - cost: nan\n",
            "Iteration: 179700 - cost: nan\n",
            "Iteration: 179800 - cost: nan\n",
            "Iteration: 179900 - cost: nan\n",
            "Iteration: 180000 - cost: nan\n",
            "Iteration: 180100 - cost: nan\n",
            "Iteration: 180200 - cost: nan\n",
            "Iteration: 180300 - cost: nan\n",
            "Iteration: 180400 - cost: nan\n",
            "Iteration: 180500 - cost: nan\n",
            "Iteration: 180600 - cost: nan\n",
            "Iteration: 180700 - cost: nan\n",
            "Iteration: 180800 - cost: nan\n",
            "Iteration: 180900 - cost: nan\n",
            "Iteration: 181000 - cost: nan\n",
            "Iteration: 181100 - cost: nan\n",
            "Iteration: 181200 - cost: nan\n",
            "Iteration: 181300 - cost: nan\n",
            "Iteration: 181400 - cost: nan\n",
            "Iteration: 181500 - cost: nan\n",
            "Iteration: 181600 - cost: nan\n",
            "Iteration: 181700 - cost: nan\n",
            "Iteration: 181800 - cost: nan\n",
            "Iteration: 181900 - cost: nan\n",
            "Iteration: 182000 - cost: nan\n",
            "Iteration: 182100 - cost: nan\n",
            "Iteration: 182200 - cost: nan\n",
            "Iteration: 182300 - cost: nan\n",
            "Iteration: 182400 - cost: nan\n",
            "Iteration: 182500 - cost: nan\n",
            "Iteration: 182600 - cost: nan\n",
            "Iteration: 182700 - cost: nan\n",
            "Iteration: 182800 - cost: nan\n",
            "Iteration: 182900 - cost: nan\n",
            "Iteration: 183000 - cost: nan\n",
            "Iteration: 183100 - cost: nan\n",
            "Iteration: 183200 - cost: nan\n",
            "Iteration: 183300 - cost: nan\n",
            "Iteration: 183400 - cost: nan\n",
            "Iteration: 183500 - cost: nan\n",
            "Iteration: 183600 - cost: nan\n",
            "Iteration: 183700 - cost: nan\n",
            "Iteration: 183800 - cost: nan\n",
            "Iteration: 183900 - cost: nan\n",
            "Iteration: 184000 - cost: nan\n",
            "Iteration: 184100 - cost: nan\n",
            "Iteration: 184200 - cost: nan\n",
            "Iteration: 184300 - cost: nan\n",
            "Iteration: 184400 - cost: nan\n",
            "Iteration: 184500 - cost: nan\n",
            "Iteration: 184600 - cost: nan\n",
            "Iteration: 184700 - cost: nan\n",
            "Iteration: 184800 - cost: nan\n",
            "Iteration: 184900 - cost: nan\n",
            "Iteration: 185000 - cost: nan\n",
            "Iteration: 185100 - cost: nan\n",
            "Iteration: 185200 - cost: nan\n",
            "Iteration: 185300 - cost: nan\n",
            "Iteration: 185400 - cost: nan\n",
            "Iteration: 185500 - cost: nan\n",
            "Iteration: 185600 - cost: nan\n",
            "Iteration: 185700 - cost: nan\n",
            "Iteration: 185800 - cost: nan\n",
            "Iteration: 185900 - cost: nan\n",
            "Iteration: 186000 - cost: nan\n",
            "Iteration: 186100 - cost: nan\n",
            "Iteration: 186200 - cost: nan\n",
            "Iteration: 186300 - cost: nan\n",
            "Iteration: 186400 - cost: nan\n",
            "Iteration: 186500 - cost: nan\n",
            "Iteration: 186600 - cost: nan\n",
            "Iteration: 186700 - cost: nan\n",
            "Iteration: 186800 - cost: nan\n",
            "Iteration: 186900 - cost: nan\n",
            "Iteration: 187000 - cost: nan\n",
            "Iteration: 187100 - cost: nan\n",
            "Iteration: 187200 - cost: nan\n",
            "Iteration: 187300 - cost: nan\n",
            "Iteration: 187400 - cost: nan\n",
            "Iteration: 187500 - cost: nan\n",
            "Iteration: 187600 - cost: nan\n",
            "Iteration: 187700 - cost: nan\n",
            "Iteration: 187800 - cost: nan\n",
            "Iteration: 187900 - cost: nan\n",
            "Iteration: 188000 - cost: nan\n",
            "Iteration: 188100 - cost: nan\n",
            "Iteration: 188200 - cost: nan\n",
            "Iteration: 188300 - cost: nan\n",
            "Iteration: 188400 - cost: nan\n",
            "Iteration: 188500 - cost: nan\n",
            "Iteration: 188600 - cost: nan\n",
            "Iteration: 188700 - cost: nan\n",
            "Iteration: 188800 - cost: nan\n",
            "Iteration: 188900 - cost: nan\n",
            "Iteration: 189000 - cost: nan\n",
            "Iteration: 189100 - cost: nan\n",
            "Iteration: 189200 - cost: nan\n",
            "Iteration: 189300 - cost: nan\n",
            "Iteration: 189400 - cost: nan\n",
            "Iteration: 189500 - cost: nan\n",
            "Iteration: 189600 - cost: nan\n",
            "Iteration: 189700 - cost: nan\n",
            "Iteration: 189800 - cost: nan\n",
            "Iteration: 189900 - cost: nan\n",
            "Iteration: 190000 - cost: nan\n",
            "Iteration: 190100 - cost: nan\n",
            "Iteration: 190200 - cost: nan\n",
            "Iteration: 190300 - cost: nan\n",
            "Iteration: 190400 - cost: nan\n",
            "Iteration: 190500 - cost: nan\n",
            "Iteration: 190600 - cost: nan\n",
            "Iteration: 190700 - cost: nan\n",
            "Iteration: 190800 - cost: nan\n",
            "Iteration: 190900 - cost: nan\n",
            "Iteration: 191000 - cost: nan\n",
            "Iteration: 191100 - cost: nan\n",
            "Iteration: 191200 - cost: nan\n",
            "Iteration: 191300 - cost: nan\n",
            "Iteration: 191400 - cost: nan\n",
            "Iteration: 191500 - cost: nan\n",
            "Iteration: 191600 - cost: nan\n",
            "Iteration: 191700 - cost: nan\n",
            "Iteration: 191800 - cost: nan\n",
            "Iteration: 191900 - cost: nan\n",
            "Iteration: 192000 - cost: nan\n",
            "Iteration: 192100 - cost: nan\n",
            "Iteration: 192200 - cost: nan\n",
            "Iteration: 192300 - cost: nan\n",
            "Iteration: 192400 - cost: nan\n",
            "Iteration: 192500 - cost: nan\n",
            "Iteration: 192600 - cost: nan\n",
            "Iteration: 192700 - cost: nan\n",
            "Iteration: 192800 - cost: nan\n",
            "Iteration: 192900 - cost: nan\n",
            "Iteration: 193000 - cost: nan\n",
            "Iteration: 193100 - cost: nan\n",
            "Iteration: 193200 - cost: nan\n",
            "Iteration: 193300 - cost: nan\n",
            "Iteration: 193400 - cost: nan\n",
            "Iteration: 193500 - cost: nan\n",
            "Iteration: 193600 - cost: nan\n",
            "Iteration: 193700 - cost: nan\n",
            "Iteration: 193800 - cost: nan\n",
            "Iteration: 193900 - cost: nan\n",
            "Iteration: 194000 - cost: nan\n",
            "Iteration: 194100 - cost: nan\n",
            "Iteration: 194200 - cost: nan\n",
            "Iteration: 194300 - cost: nan\n",
            "Iteration: 194400 - cost: nan\n",
            "Iteration: 194500 - cost: nan\n",
            "Iteration: 194600 - cost: nan\n",
            "Iteration: 194700 - cost: nan\n",
            "Iteration: 194800 - cost: nan\n",
            "Iteration: 194900 - cost: nan\n",
            "Iteration: 195000 - cost: nan\n",
            "Iteration: 195100 - cost: nan\n",
            "Iteration: 195200 - cost: nan\n",
            "Iteration: 195300 - cost: nan\n",
            "Iteration: 195400 - cost: nan\n",
            "Iteration: 195500 - cost: nan\n",
            "Iteration: 195600 - cost: nan\n",
            "Iteration: 195700 - cost: nan\n",
            "Iteration: 195800 - cost: nan\n",
            "Iteration: 195900 - cost: nan\n",
            "Iteration: 196000 - cost: nan\n",
            "Iteration: 196100 - cost: nan\n",
            "Iteration: 196200 - cost: nan\n",
            "Iteration: 196300 - cost: nan\n",
            "Iteration: 196400 - cost: nan\n",
            "Iteration: 196500 - cost: nan\n",
            "Iteration: 196600 - cost: nan\n",
            "Iteration: 196700 - cost: nan\n",
            "Iteration: 196800 - cost: nan\n",
            "Iteration: 196900 - cost: nan\n",
            "Iteration: 197000 - cost: nan\n",
            "Iteration: 197100 - cost: nan\n",
            "Iteration: 197200 - cost: nan\n",
            "Iteration: 197300 - cost: nan\n",
            "Iteration: 197400 - cost: nan\n",
            "Iteration: 197500 - cost: nan\n",
            "Iteration: 197600 - cost: nan\n",
            "Iteration: 197700 - cost: nan\n",
            "Iteration: 197800 - cost: nan\n",
            "Iteration: 197900 - cost: nan\n",
            "Iteration: 198000 - cost: nan\n",
            "Iteration: 198100 - cost: nan\n",
            "Iteration: 198200 - cost: nan\n",
            "Iteration: 198300 - cost: nan\n",
            "Iteration: 198400 - cost: nan\n",
            "Iteration: 198500 - cost: nan\n",
            "Iteration: 198600 - cost: nan\n",
            "Iteration: 198700 - cost: nan\n",
            "Iteration: 198800 - cost: nan\n",
            "Iteration: 198900 - cost: nan\n",
            "Iteration: 199000 - cost: nan\n",
            "Iteration: 199100 - cost: nan\n",
            "Iteration: 199200 - cost: nan\n",
            "Iteration: 199300 - cost: nan\n",
            "Iteration: 199400 - cost: nan\n",
            "Iteration: 199500 - cost: nan\n",
            "Iteration: 199600 - cost: nan\n",
            "Iteration: 199700 - cost: nan\n",
            "Iteration: 199800 - cost: nan\n",
            "Iteration: 199900 - cost: nan\n",
            "Iteration: 200000 - cost: nan\n",
            "Iteration: 200100 - cost: nan\n",
            "Iteration: 200200 - cost: nan\n",
            "Iteration: 200300 - cost: nan\n",
            "Iteration: 200400 - cost: nan\n",
            "Iteration: 200500 - cost: nan\n",
            "Iteration: 200600 - cost: nan\n",
            "Iteration: 200700 - cost: nan\n",
            "Iteration: 200800 - cost: nan\n",
            "Iteration: 200900 - cost: nan\n",
            "Iteration: 201000 - cost: nan\n",
            "Iteration: 201100 - cost: nan\n",
            "Iteration: 201200 - cost: nan\n",
            "Iteration: 201300 - cost: nan\n",
            "Iteration: 201400 - cost: nan\n",
            "Iteration: 201500 - cost: nan\n",
            "Iteration: 201600 - cost: nan\n",
            "Iteration: 201700 - cost: nan\n",
            "Iteration: 201800 - cost: nan\n",
            "Iteration: 201900 - cost: nan\n",
            "Iteration: 202000 - cost: nan\n",
            "Iteration: 202100 - cost: nan\n",
            "Iteration: 202200 - cost: nan\n",
            "Iteration: 202300 - cost: nan\n",
            "Iteration: 202400 - cost: nan\n",
            "Iteration: 202500 - cost: nan\n",
            "Iteration: 202600 - cost: nan\n",
            "Iteration: 202700 - cost: nan\n",
            "Iteration: 202800 - cost: nan\n",
            "Iteration: 202900 - cost: nan\n",
            "Iteration: 203000 - cost: nan\n",
            "Iteration: 203100 - cost: nan\n",
            "Iteration: 203200 - cost: nan\n",
            "Iteration: 203300 - cost: nan\n",
            "Iteration: 203400 - cost: nan\n",
            "Iteration: 203500 - cost: nan\n",
            "Iteration: 203600 - cost: nan\n",
            "Iteration: 203700 - cost: nan\n",
            "Iteration: 203800 - cost: nan\n",
            "Iteration: 203900 - cost: nan\n",
            "Iteration: 204000 - cost: nan\n",
            "Iteration: 204100 - cost: nan\n",
            "Iteration: 204200 - cost: nan\n",
            "Iteration: 204300 - cost: nan\n",
            "Iteration: 204400 - cost: nan\n",
            "Iteration: 204500 - cost: nan\n",
            "Iteration: 204600 - cost: nan\n",
            "Iteration: 204700 - cost: nan\n",
            "Iteration: 204800 - cost: nan\n",
            "Iteration: 204900 - cost: nan\n",
            "Iteration: 205000 - cost: nan\n",
            "Iteration: 205100 - cost: nan\n",
            "Iteration: 205200 - cost: nan\n",
            "Iteration: 205300 - cost: nan\n",
            "Iteration: 205400 - cost: nan\n",
            "Iteration: 205500 - cost: nan\n",
            "Iteration: 205600 - cost: nan\n",
            "Iteration: 205700 - cost: nan\n",
            "Iteration: 205800 - cost: nan\n",
            "Iteration: 205900 - cost: nan\n",
            "Iteration: 206000 - cost: nan\n",
            "Iteration: 206100 - cost: nan\n",
            "Iteration: 206200 - cost: nan\n",
            "Iteration: 206300 - cost: nan\n",
            "Iteration: 206400 - cost: nan\n",
            "Iteration: 206500 - cost: nan\n",
            "Iteration: 206600 - cost: nan\n",
            "Iteration: 206700 - cost: nan\n",
            "Iteration: 206800 - cost: nan\n",
            "Iteration: 206900 - cost: nan\n",
            "Iteration: 207000 - cost: nan\n",
            "Iteration: 207100 - cost: nan\n",
            "Iteration: 207200 - cost: nan\n",
            "Iteration: 207300 - cost: nan\n",
            "Iteration: 207400 - cost: nan\n",
            "Iteration: 207500 - cost: nan\n",
            "Iteration: 207600 - cost: nan\n",
            "Iteration: 207700 - cost: nan\n",
            "Iteration: 207800 - cost: nan\n",
            "Iteration: 207900 - cost: nan\n",
            "Iteration: 208000 - cost: nan\n",
            "Iteration: 208100 - cost: nan\n",
            "Iteration: 208200 - cost: nan\n",
            "Iteration: 208300 - cost: nan\n",
            "Iteration: 208400 - cost: nan\n",
            "Iteration: 208500 - cost: nan\n",
            "Iteration: 208600 - cost: nan\n",
            "Iteration: 208700 - cost: nan\n",
            "Iteration: 208800 - cost: nan\n",
            "Iteration: 208900 - cost: nan\n",
            "Iteration: 209000 - cost: nan\n",
            "Iteration: 209100 - cost: nan\n",
            "Iteration: 209200 - cost: nan\n",
            "Iteration: 209300 - cost: nan\n",
            "Iteration: 209400 - cost: nan\n",
            "Iteration: 209500 - cost: nan\n",
            "Iteration: 209600 - cost: nan\n",
            "Iteration: 209700 - cost: nan\n",
            "Iteration: 209800 - cost: nan\n",
            "Iteration: 209900 - cost: nan\n",
            "Iteration: 210000 - cost: nan\n",
            "Iteration: 210100 - cost: nan\n",
            "Iteration: 210200 - cost: nan\n",
            "Iteration: 210300 - cost: nan\n",
            "Iteration: 210400 - cost: nan\n",
            "Iteration: 210500 - cost: nan\n",
            "Iteration: 210600 - cost: nan\n",
            "Iteration: 210700 - cost: nan\n",
            "Iteration: 210800 - cost: nan\n",
            "Iteration: 210900 - cost: nan\n",
            "Iteration: 211000 - cost: nan\n",
            "Iteration: 211100 - cost: nan\n",
            "Iteration: 211200 - cost: nan\n",
            "Iteration: 211300 - cost: nan\n",
            "Iteration: 211400 - cost: nan\n",
            "Iteration: 211500 - cost: nan\n",
            "Iteration: 211600 - cost: nan\n",
            "Iteration: 211700 - cost: nan\n",
            "Iteration: 211800 - cost: nan\n",
            "Iteration: 211900 - cost: nan\n",
            "Iteration: 212000 - cost: nan\n",
            "Iteration: 212100 - cost: nan\n",
            "Iteration: 212200 - cost: nan\n",
            "Iteration: 212300 - cost: nan\n",
            "Iteration: 212400 - cost: nan\n",
            "Iteration: 212500 - cost: nan\n",
            "Iteration: 212600 - cost: nan\n",
            "Iteration: 212700 - cost: nan\n",
            "Iteration: 212800 - cost: nan\n",
            "Iteration: 212900 - cost: nan\n",
            "Iteration: 213000 - cost: nan\n",
            "Iteration: 213100 - cost: nan\n",
            "Iteration: 213200 - cost: nan\n",
            "Iteration: 213300 - cost: nan\n",
            "Iteration: 213400 - cost: nan\n",
            "Iteration: 213500 - cost: nan\n",
            "Iteration: 213600 - cost: nan\n",
            "Iteration: 213700 - cost: nan\n",
            "Iteration: 213800 - cost: nan\n",
            "Iteration: 213900 - cost: nan\n",
            "Iteration: 214000 - cost: nan\n",
            "Iteration: 214100 - cost: nan\n",
            "Iteration: 214200 - cost: nan\n",
            "Iteration: 214300 - cost: nan\n",
            "Iteration: 214400 - cost: nan\n",
            "Iteration: 214500 - cost: nan\n",
            "Iteration: 214600 - cost: nan\n",
            "Iteration: 214700 - cost: nan\n",
            "Iteration: 214800 - cost: nan\n",
            "Iteration: 214900 - cost: nan\n",
            "Iteration: 215000 - cost: nan\n",
            "Iteration: 215100 - cost: nan\n",
            "Iteration: 215200 - cost: nan\n",
            "Iteration: 215300 - cost: nan\n",
            "Iteration: 215400 - cost: nan\n",
            "Iteration: 215500 - cost: nan\n",
            "Iteration: 215600 - cost: nan\n",
            "Iteration: 215700 - cost: nan\n",
            "Iteration: 215800 - cost: nan\n",
            "Iteration: 215900 - cost: nan\n",
            "Iteration: 216000 - cost: nan\n",
            "Iteration: 216100 - cost: nan\n",
            "Iteration: 216200 - cost: nan\n",
            "Iteration: 216300 - cost: nan\n",
            "Iteration: 216400 - cost: nan\n",
            "Iteration: 216500 - cost: nan\n",
            "Iteration: 216600 - cost: nan\n",
            "Iteration: 216700 - cost: nan\n",
            "Iteration: 216800 - cost: nan\n",
            "Iteration: 216900 - cost: nan\n",
            "Iteration: 217000 - cost: nan\n",
            "Iteration: 217100 - cost: nan\n",
            "Iteration: 217200 - cost: nan\n",
            "Iteration: 217300 - cost: nan\n",
            "Iteration: 217400 - cost: nan\n",
            "Iteration: 217500 - cost: nan\n",
            "Iteration: 217600 - cost: nan\n",
            "Iteration: 217700 - cost: nan\n",
            "Iteration: 217800 - cost: nan\n",
            "Iteration: 217900 - cost: nan\n",
            "Iteration: 218000 - cost: nan\n",
            "Iteration: 218100 - cost: nan\n",
            "Iteration: 218200 - cost: nan\n",
            "Iteration: 218300 - cost: nan\n",
            "Iteration: 218400 - cost: nan\n",
            "Iteration: 218500 - cost: nan\n",
            "Iteration: 218600 - cost: nan\n",
            "Iteration: 218700 - cost: nan\n",
            "Iteration: 218800 - cost: nan\n",
            "Iteration: 218900 - cost: nan\n",
            "Iteration: 219000 - cost: nan\n",
            "Iteration: 219100 - cost: nan\n",
            "Iteration: 219200 - cost: nan\n",
            "Iteration: 219300 - cost: nan\n",
            "Iteration: 219400 - cost: nan\n",
            "Iteration: 219500 - cost: nan\n",
            "Iteration: 219600 - cost: nan\n",
            "Iteration: 219700 - cost: nan\n",
            "Iteration: 219800 - cost: nan\n",
            "Iteration: 219900 - cost: nan\n",
            "Iteration: 220000 - cost: nan\n",
            "Iteration: 220100 - cost: nan\n",
            "Iteration: 220200 - cost: nan\n",
            "Iteration: 220300 - cost: nan\n",
            "Iteration: 220400 - cost: nan\n",
            "Iteration: 220500 - cost: nan\n",
            "Iteration: 220600 - cost: nan\n",
            "Iteration: 220700 - cost: nan\n",
            "Iteration: 220800 - cost: nan\n",
            "Iteration: 220900 - cost: nan\n",
            "Iteration: 221000 - cost: nan\n",
            "Iteration: 221100 - cost: nan\n",
            "Iteration: 221200 - cost: nan\n",
            "Iteration: 221300 - cost: nan\n",
            "Iteration: 221400 - cost: nan\n",
            "Iteration: 221500 - cost: nan\n",
            "Iteration: 221600 - cost: nan\n",
            "Iteration: 221700 - cost: nan\n",
            "Iteration: 221800 - cost: nan\n",
            "Iteration: 221900 - cost: nan\n",
            "Iteration: 222000 - cost: nan\n",
            "Iteration: 222100 - cost: nan\n",
            "Iteration: 222200 - cost: nan\n",
            "Iteration: 222300 - cost: nan\n",
            "Iteration: 222400 - cost: nan\n",
            "Iteration: 222500 - cost: nan\n",
            "Iteration: 222600 - cost: nan\n",
            "Iteration: 222700 - cost: nan\n",
            "Iteration: 222800 - cost: nan\n",
            "Iteration: 222900 - cost: nan\n",
            "Iteration: 223000 - cost: nan\n",
            "Iteration: 223100 - cost: nan\n",
            "Iteration: 223200 - cost: nan\n",
            "Iteration: 223300 - cost: nan\n",
            "Iteration: 223400 - cost: nan\n",
            "Iteration: 223500 - cost: nan\n",
            "Iteration: 223600 - cost: nan\n",
            "Iteration: 223700 - cost: nan\n",
            "Iteration: 223800 - cost: nan\n",
            "Iteration: 223900 - cost: nan\n",
            "Iteration: 224000 - cost: nan\n",
            "Iteration: 224100 - cost: nan\n",
            "Iteration: 224200 - cost: nan\n",
            "Iteration: 224300 - cost: nan\n",
            "Iteration: 224400 - cost: nan\n",
            "Iteration: 224500 - cost: nan\n",
            "Iteration: 224600 - cost: nan\n",
            "Iteration: 224700 - cost: nan\n",
            "Iteration: 224800 - cost: nan\n",
            "Iteration: 224900 - cost: nan\n",
            "Iteration: 225000 - cost: nan\n",
            "Iteration: 225100 - cost: nan\n",
            "Iteration: 225200 - cost: nan\n",
            "Iteration: 225300 - cost: nan\n",
            "Iteration: 225400 - cost: nan\n",
            "Iteration: 225500 - cost: nan\n",
            "Iteration: 225600 - cost: nan\n",
            "Iteration: 225700 - cost: nan\n",
            "Iteration: 225800 - cost: nan\n",
            "Iteration: 225900 - cost: nan\n",
            "Iteration: 226000 - cost: nan\n",
            "Iteration: 226100 - cost: nan\n",
            "Iteration: 226200 - cost: nan\n",
            "Iteration: 226300 - cost: nan\n",
            "Iteration: 226400 - cost: nan\n",
            "Iteration: 226500 - cost: nan\n",
            "Iteration: 226600 - cost: nan\n",
            "Iteration: 226700 - cost: nan\n",
            "Iteration: 226800 - cost: nan\n",
            "Iteration: 226900 - cost: nan\n",
            "Iteration: 227000 - cost: nan\n",
            "Iteration: 227100 - cost: nan\n",
            "Iteration: 227200 - cost: nan\n",
            "Iteration: 227300 - cost: nan\n",
            "Iteration: 227400 - cost: nan\n",
            "Iteration: 227500 - cost: nan\n",
            "Iteration: 227600 - cost: nan\n",
            "Iteration: 227700 - cost: nan\n",
            "Iteration: 227800 - cost: nan\n",
            "Iteration: 227900 - cost: nan\n",
            "Iteration: 228000 - cost: nan\n",
            "Iteration: 228100 - cost: nan\n",
            "Iteration: 228200 - cost: nan\n",
            "Iteration: 228300 - cost: nan\n",
            "Iteration: 228400 - cost: nan\n",
            "Iteration: 228500 - cost: nan\n",
            "Iteration: 228600 - cost: nan\n",
            "Iteration: 228700 - cost: nan\n",
            "Iteration: 228800 - cost: nan\n",
            "Iteration: 228900 - cost: nan\n",
            "Iteration: 229000 - cost: nan\n",
            "Iteration: 229100 - cost: nan\n",
            "Iteration: 229200 - cost: nan\n",
            "Iteration: 229300 - cost: nan\n",
            "Iteration: 229400 - cost: nan\n",
            "Iteration: 229500 - cost: nan\n",
            "Iteration: 229600 - cost: nan\n",
            "Iteration: 229700 - cost: nan\n",
            "Iteration: 229800 - cost: nan\n",
            "Iteration: 229900 - cost: nan\n",
            "Iteration: 230000 - cost: nan\n",
            "Iteration: 230100 - cost: nan\n",
            "Iteration: 230200 - cost: nan\n",
            "Iteration: 230300 - cost: nan\n",
            "Iteration: 230400 - cost: nan\n",
            "Iteration: 230500 - cost: nan\n",
            "Iteration: 230600 - cost: nan\n",
            "Iteration: 230700 - cost: nan\n",
            "Iteration: 230800 - cost: nan\n",
            "Iteration: 230900 - cost: nan\n",
            "Iteration: 231000 - cost: nan\n",
            "Iteration: 231100 - cost: nan\n",
            "Iteration: 231200 - cost: nan\n",
            "Iteration: 231300 - cost: nan\n",
            "Iteration: 231400 - cost: nan\n",
            "Iteration: 231500 - cost: nan\n",
            "Iteration: 231600 - cost: nan\n",
            "Iteration: 231700 - cost: nan\n",
            "Iteration: 231800 - cost: nan\n",
            "Iteration: 231900 - cost: nan\n",
            "Iteration: 232000 - cost: nan\n",
            "Iteration: 232100 - cost: nan\n",
            "Iteration: 232200 - cost: nan\n",
            "Iteration: 232300 - cost: nan\n",
            "Iteration: 232400 - cost: nan\n",
            "Iteration: 232500 - cost: nan\n",
            "Iteration: 232600 - cost: nan\n",
            "Iteration: 232700 - cost: nan\n",
            "Iteration: 232800 - cost: nan\n",
            "Iteration: 232900 - cost: nan\n",
            "Iteration: 233000 - cost: nan\n",
            "Iteration: 233100 - cost: nan\n",
            "Iteration: 233200 - cost: nan\n",
            "Iteration: 233300 - cost: nan\n",
            "Iteration: 233400 - cost: nan\n",
            "Iteration: 233500 - cost: nan\n",
            "Iteration: 233600 - cost: nan\n",
            "Iteration: 233700 - cost: nan\n",
            "Iteration: 233800 - cost: nan\n",
            "Iteration: 233900 - cost: nan\n",
            "Iteration: 234000 - cost: nan\n",
            "Iteration: 234100 - cost: nan\n",
            "Iteration: 234200 - cost: nan\n",
            "Iteration: 234300 - cost: nan\n",
            "Iteration: 234400 - cost: nan\n",
            "Iteration: 234500 - cost: nan\n",
            "Iteration: 234600 - cost: nan\n",
            "Iteration: 234700 - cost: nan\n",
            "Iteration: 234800 - cost: nan\n",
            "Iteration: 234900 - cost: nan\n",
            "Iteration: 235000 - cost: nan\n",
            "Iteration: 235100 - cost: nan\n",
            "Iteration: 235200 - cost: nan\n",
            "Iteration: 235300 - cost: nan\n",
            "Iteration: 235400 - cost: nan\n",
            "Iteration: 235500 - cost: nan\n",
            "Iteration: 235600 - cost: nan\n",
            "Iteration: 235700 - cost: nan\n",
            "Iteration: 235800 - cost: nan\n",
            "Iteration: 235900 - cost: nan\n",
            "Iteration: 236000 - cost: nan\n",
            "Iteration: 236100 - cost: nan\n",
            "Iteration: 236200 - cost: nan\n",
            "Iteration: 236300 - cost: nan\n",
            "Iteration: 236400 - cost: nan\n",
            "Iteration: 236500 - cost: nan\n",
            "Iteration: 236600 - cost: nan\n",
            "Iteration: 236700 - cost: nan\n",
            "Iteration: 236800 - cost: nan\n",
            "Iteration: 236900 - cost: nan\n",
            "Iteration: 237000 - cost: nan\n",
            "Iteration: 237100 - cost: nan\n",
            "Iteration: 237200 - cost: nan\n",
            "Iteration: 237300 - cost: nan\n",
            "Iteration: 237400 - cost: nan\n",
            "Iteration: 237500 - cost: nan\n",
            "Iteration: 237600 - cost: nan\n",
            "Iteration: 237700 - cost: nan\n",
            "Iteration: 237800 - cost: nan\n",
            "Iteration: 237900 - cost: nan\n",
            "Iteration: 238000 - cost: nan\n",
            "Iteration: 238100 - cost: nan\n",
            "Iteration: 238200 - cost: nan\n",
            "Iteration: 238300 - cost: nan\n",
            "Iteration: 238400 - cost: nan\n",
            "Iteration: 238500 - cost: nan\n",
            "Iteration: 238600 - cost: nan\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "error",
          "ename": "KeyboardInterrupt",
          "evalue": "ignored",
          "traceback": [
            "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[0;31mKeyboardInterrupt\u001b[0m                         Traceback (most recent call last)",
            "\u001b[0;32m<ipython-input-3-0740d2b96e01>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m()\u001b[0m\n\u001b[1;32m     49\u001b[0m \u001b[0mx\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0marray\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m2\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m4\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m8\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m16\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m3\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m9\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m27\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m81\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m4\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m16\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m64\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m256\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m5\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m25\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m125\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m625\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     50\u001b[0m \u001b[0mt\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0marray\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m5\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m31\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m121\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m341\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m781\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 51\u001b[0;31m \u001b[0mprint\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mgradientDescentMethod\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m",
            "\u001b[0;32m<ipython-input-3-0740d2b96e01>\u001b[0m in \u001b[0;36mgradientDescentMethod\u001b[0;34m(x, t, alpha, tolerance)\u001b[0m\n\u001b[1;32m     35\u001b[0m     \u001b[0mw_cost\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m[\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mcost\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     36\u001b[0m     \u001b[0;32mwhile\u001b[0m \u001b[0;32mTrue\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 37\u001b[0;31m         \u001b[0mdw\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mgetGradient\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     38\u001b[0m         \u001b[0mw_k\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mw\u001b[0m \u001b[0;34m-\u001b[0m \u001b[0malpha\u001b[0m \u001b[0;34m*\u001b[0m \u001b[0mdw\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     39\u001b[0m         \u001b[0mw_cost\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mappend\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mcost\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m<ipython-input-3-0740d2b96e01>\u001b[0m in \u001b[0;36mgetGradient\u001b[0;34m(x, w, t)\u001b[0m\n\u001b[1;32m     23\u001b[0m \u001b[0;32mdef\u001b[0m \u001b[0mgetGradient\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     24\u001b[0m     \u001b[0mN\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mD\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mshape\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 25\u001b[0;31m     \u001b[0mgradient\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0;36m1.0\u001b[0m\u001b[0;34m/\u001b[0m \u001b[0mfloat\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mN\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;34m*\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mmatmul\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mtranspose\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mloss\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     26\u001b[0m     \u001b[0;32mreturn\u001b[0m \u001b[0mgradient\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     27\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m<ipython-input-3-0740d2b96e01>\u001b[0m in \u001b[0;36mloss\u001b[0;34m(x, w, t)\u001b[0m\n\u001b[1;32m      5\u001b[0m \u001b[0;32mdef\u001b[0m \u001b[0mloss\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mw\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      6\u001b[0m     \u001b[0mN\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mD\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mshape\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 7\u001b[0;31m     \u001b[0my\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mmatmul\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mx\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0mw\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      8\u001b[0m     \u001b[0mloss\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0my\u001b[0m \u001b[0;34m-\u001b[0m \u001b[0mt\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      9\u001b[0m     \u001b[0;32mreturn\u001b[0m \u001b[0mloss\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mKeyboardInterrupt\u001b[0m: "
          ]
        }
      ]
    }
  ]
}