|
161 | 161 | "We'll use the 7B model here, the 2B model isn't great and was suffering from reading comprehension challenges."
|
162 | 162 | ]
|
163 | 163 | },
|
| 164 | + { |
| 165 | + "cell_type": "markdown", |
| 166 | + "metadata": {}, |
| 167 | + "source": [ |
| 168 | + "## Downloading the Navrasa LLM\n", |
| 169 | + "\n", |
| 170 | + "We'll download the Navrasa LLM from TeluguLLM-Labs. This is a 7B model with PEFT." |
| 171 | + ] |
| 172 | + }, |
164 | 173 | {
|
165 | 174 | "cell_type": "code",
|
166 | 175 | "execution_count": null,
|
|
196 | 205 | ]
|
197 | 206 | },
|
198 | 207 | {
|
199 |
| - "cell_type": "code", |
200 |
| - "execution_count": null, |
| 208 | + "cell_type": "markdown", |
201 | 209 | "metadata": {
|
202 |
| - "id": "4T-n_3TAj2VA" |
| 210 | + "id": "LWVHPXIFzzgW" |
203 | 211 | },
|
204 |
| - "outputs": [], |
205 | 212 | "source": [
|
206 |
| - "questions, contexts = list(ds['question']), list(ds['context'])" |
| 213 | + "## Embed the Context into Vectors" |
207 | 214 | ]
|
208 | 215 | },
|
209 | 216 | {
|
210 |
| - "cell_type": "markdown", |
211 |
| - "metadata": { |
212 |
| - "id": "LWVHPXIFzzgW" |
213 |
| - }, |
| 217 | + "cell_type": "code", |
| 218 | + "execution_count": null, |
| 219 | + "metadata": {}, |
| 220 | + "outputs": [], |
214 | 221 | "source": [
|
215 |
| - "## Embed the Context into Vectors" |
| 222 | + "questions, contexts = list(ds['question']), list(ds['context'])" |
216 | 223 | ]
|
217 | 224 | },
|
218 | 225 | {
|
|
310 | 317 | "search_client.upsert(collection_name=\"hindi_tamil_contexts\", points=context_points)"
|
311 | 318 | ]
|
312 | 319 | },
|
| 320 | + { |
| 321 | + "cell_type": "markdown", |
| 322 | + "metadata": {}, |
| 323 | + "source": [ |
| 324 | + "## Selecting a Question\n", |
| 325 | + "\n", |
| 326 | + "I've randomly selected a question here, with a specific and we then find the answer to it. We have the correct answer for it too -- so we can compare the two when you run the code." |
| 327 | + ] |
| 328 | + }, |
313 | 329 | {
|
314 | 330 | "cell_type": "code",
|
315 | 331 | "execution_count": null,
|
|
345 | 361 | "len(search_context_text)"
|
346 | 362 | ]
|
347 | 363 | },
|
| 364 | + { |
| 365 | + "cell_type": "markdown", |
| 366 | + "metadata": {}, |
| 367 | + "source": [ |
| 368 | + "## Running the Model with a Question & Context" |
| 369 | + ] |
| 370 | + }, |
348 | 371 | {
|
349 | 372 | "cell_type": "code",
|
350 | 373 | "execution_count": null,
|
|
0 commit comments