Skip to content

Commit 42a6474

Browse files
authored
Merge pull request #1913 from janhq/function-calling-improvement
Enhanced Function Calling Guide and the main README, removed warnings at different places where Cortex is stable already, and tweaked the images to showcase current functionality without `tensorrt-llm`.
2 parents 596eb94 + 125a115 commit 42a6474

26 files changed

+276
-771
lines changed

README.md

Lines changed: 98 additions & 378 deletions
Large diffs are not rendered by default.

assets/cortex-banner.png

11.7 KB
Loading

docs/docs/architecture.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,10 +5,6 @@ slug: "architecture"
55
draft: true
66
---
77

8-
:::warning
9-
🚧 Cortex.cpp is currently under development. Our documentation outlines the intended behavior of Cortex, which may not yet be fully implemented in the codebase.
10-
:::
11-
128
## Introduction
139

1410
Cortex is a C++ AI engine designed to operate entirely on your local hardware infrastructure. This headless backend platform is also engineered to support TensorRT-LLM, ensuring high-performance machine-learning model execution. It is packaged with a Docker-inspired command-line interface and a Typescript client library.

docs/docs/architecture/cortex-db.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,6 @@ slug: "cortex-db"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the intended behavior
12-
of Cortex, which may not yet be fully implemented in the codebase.
13-
:::
1410

1511
![sqlite-view](/img/sqlite_view_harlequin.png)
1612
**db view via [Harlequin](https://harlequin.sh/)**

docs/docs/architecture/cortexrc.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,6 @@ slug: "cortexrc"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the intended behavior of
12-
Cortex, which may not be fully implemented in the codebase yet.
13-
:::
1410

1511
Cortex supports using a config-based approach to configuring most of its functionality. During the
1612
installation process, a `.cortexrc` will be generated with some sensible defaults in it. Using this

docs/docs/architecture/data-folder.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,6 @@ slug: "data-folder"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the
12-
intended behavior of Cortex and some functionality may not be fully implemented yet.
13-
:::
1410

1511
When you install Cortex.cpp, three types of files will be generated on your device:
1612

docs/docs/architecture/updater.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,6 @@ slug: "updater"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the intended behavior of
12-
Cortex, which may not yet be fully implemented in the codebase.
13-
:::
1410

1511
This document outlines the architectural design for a C++ updater responsible for downloading and executing
1612
the installers for the CLI and Server binaries.

docs/docs/chat-completions.mdx

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -6,9 +6,6 @@ description: Chat Completions Feature
66
import Tabs from "@theme/Tabs";
77
import TabItem from "@theme/TabItem";
88

9-
:::warning
10-
🚧 Cortex.cpp is currently under development. Our documentation outlines the intended behavior of Cortex, which may not yet be fully implemented in the codebase.
11-
:::
129

1310
Cortex's Chat API is compatible with OpenAI’s [Chat Completions](https://platform.openai.com/docs/api-reference/chat) endpoint. It is a drop-in replacement for local inference.
1411

@@ -23,8 +20,8 @@ Cortex routes requests to multiple APIs for remote inference while providing a s
2320
## Usage
2421
### CLI
2522

26-
```bash
27-
# Streaming
23+
```bash
24+
# Streaming
2825
cortex chat --model mistral
2926
```
3027
### API

docs/docs/configurations/cors.mdx

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -7,11 +7,6 @@ slug: "cors"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the intended behavior of
12-
Cortex, which may not yet be fully implemented in the codebase.
13-
:::
14-
1510
This document describes how to configure Cross-Origin Resource Sharing (CORS) settings for the API server
1611
using the CLI commands and the HTTP API endpoints.
1712

docs/docs/configurations/proxy.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,6 @@ slug: "proxy"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the intended
12-
behavior of Cortex, which may not yet be fully implemented in the codebase.
13-
:::
1410

1511
# Proxy Configuration Guide
1612

docs/docs/configurations/token.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,6 @@ slug: "token"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under active development. Our documentation outlines the intended behavior of
12-
Cortex, which may not yet be fully implemented in the codebase.
13-
:::
1410

1511
A lot of the models available today can be found on HuggingFace. This page describes how to configure
1612
HuggingFace token settings for Cortex.

docs/docs/cortex-cpp.md

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,6 @@ description: Cortex.cpp Architecture
44
slug: "cortex-cpp"
55
---
66

7-
:::warning
8-
🚧 Cortex.cpp is currently under development. Our documentation outlines the intended behavior of Cortex, which may not yet be fully implemented in the codebase.
9-
:::
10-
117
Cortex.cpp is a Local AI engine that is used to run and customize LLMs. Cortex can be deployed as a standalone server, or integrated into apps like [Jan.ai](https://jan.ai/)
128

139
Cortex's roadmap is to eventually support full OpenAI API-equivalence.

docs/docs/cortex-llamacpp.mdx

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -7,9 +7,6 @@ slug: "cortex-llamacpp"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under development. Our documentation outlines the intended behavior of Cortex, which may not yet be fully implemented in the codebase.
12-
:::
1310

1411
:::info
1512
`llamacpp` is formerly called "Nitro".
@@ -67,9 +64,9 @@ The command will check, download, and install these dependencies:
6764
- Cuda 12.2:
6865
- libcublas.so.12
6966
- libcublasLt.so.12
70-
- libcudart.so.12
67+
- libcudart.so.12
7168
- Cuda 12.4:
72-
- libcublasLt.so.12
69+
- libcublasLt.so.12
7370
- libcublas.so.12
7471
```
7572
</TabItem>

docs/docs/embeddings.mdx

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,18 +7,15 @@ slug: "embeddings"
77
import Tabs from "@theme/Tabs";
88
import TabItem from "@theme/TabItem";
99

10-
:::warning
11-
🚧 Cortex.cpp is currently under development. Our documentation outlines the intended behavior of Cortex, which may not yet be fully implemented in the codebase.
12-
:::
13-
1410
An embedding is a vector that represents a piece of text, with the distance between vectors indicating similarity, which means closer distances mean more similar texts, while farther distances mean less similar texts.
11+
1512
:::note
1613
The Cortex Embeddings feature is fully compatible with OpenAI's [Embeddings API](https://platform.openai.com/docs/api-reference/embeddings) endpoints.
1714
:::
1815

1916
## Usage
2017
### CLI
21-
```bash
18+
```bash
2219
# Without Flag
2320
cortex embeddings "Hello World"
2421
# With model_id Flag
@@ -84,4 +81,4 @@ For a complete list of models, please visit the [Cortex Hub](https://huggingface
8481
Learn more about Embeddings capabilities:
8582
- [Embeddings API Reference](/api-reference#tag/embeddings/post/embeddings)
8683
- [Embeddings CLI command](/docs/cli/embeddings)
87-
:::
84+
:::

0 commit comments

Comments
 (0)