Skip to content

Commit c1c31fa

Browse files
vgrlfelicitymaysunbryemchammer01
authored
GitHub Models Billing for GitHub Paper Customers [Public Preview] (#56168)
Co-authored-by: Felicity Chapman <[email protected]> Co-authored-by: Sunbrye Ly <[email protected]> Co-authored-by: sunbrye <[email protected]> Co-authored-by: mc <[email protected]>
1 parent 48f820b commit c1c31fa

File tree

16 files changed

+227
-6
lines changed

16 files changed

+227
-6
lines changed

‎content/admin/data-residency/feature-overview-for-github-enterprise-cloud-with-data-residency.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,7 @@ The following features are currently unavailable on {% data variables.enterprise
3030
| {% data variables.product.prodname_copilot_short %} Metrics API | Currently unavailable | [AUTOTITLE](/rest/copilot/copilot-metrics) |
3131
| {% data variables.copilot.copilot_coding_agent %} | Currently unavailable | [AUTOTITLE](/copilot/using-github-copilot/coding-agent/about-assigning-tasks-to-copilot) |
3232
| Restricting {% data variables.product.prodname_actions %} policies to verified creators | Currently unavailable | [AUTOTITLE](/admin/enforcing-policies/enforcing-policies-for-your-enterprise/enforcing-policies-for-github-actions-in-your-enterprise#allow-enterprise-and-select-non-enterprise-actions-and-reusable-workflows) |
33+
| {% data variables.product.prodname_github_models %} | Currently unavailable | [AUTOTITLE](/github-models/about-github-models) |
3334
| Some features currently in {% data variables.release-phases.public_preview %} or {% data variables.release-phases.private_preview %} | Certain features that are in a preview phase on {% data variables.product.prodname_dotcom_the_website %} may not be available on {% data variables.enterprise.data_residency_site %} | |
3435

3536
## Features that work differently

‎content/billing/managing-billing-for-your-products/about-billing-for-github-models.md

Lines changed: 142 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,142 @@
1+
---
2+
title: About billing for GitHub Models
3+
shortTitle: GitHub Models
4+
intro: If you want to use {% data variables.product.prodname_github_models %} beyond the free usage included in your account, you can choose to opt in to paid usage.
5+
versions:
6+
feature: github-models
7+
topics:
8+
- Enterprise
9+
- Billing
10+
allowTitleToDifferFromFilename: true
11+
---
12+
13+
> [!NOTE]
14+
> * {% data variables.product.prodname_github_models %} for organizations and repositories is in {% data variables.release-phases.public_preview %} and subject to change.
15+
> * Billing for {% data variables.product.prodname_github_models %} is separate from billing for {% data variables.product.prodname_copilot %}. For more information about how models in {% data variables.product.prodname_copilot %} are billed, see [AUTOTITLE](/billing/managing-billing-for-your-products/about-billing-for-github-copilot).
16+
17+
## About {% data variables.product.prodname_github_models %} billing on {% data variables.product.github %}
18+
19+
Billing for {% data variables.product.prodname_github_models %} is designed to be flexible and to allow you to use your preferred model providers, while also providing the ability to control your spending. Model usage is powered by the Azure OpenAI Service and billed through {% data variables.product.github %} using the same global pay-as-you-go pricing as [Azure OpenAI Service](https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/).
20+
21+
Alternatively, you can bring your own API keys (BYOK) from different providers, such as OpenAI or Azure AI, see [AUTOTITLE](/github-models/github-models-at-scale/set-up-custom-model-integration-models-byok). Model inference runs directly through your provider, and usage is billed and tracked through your provider account. For example, Azure API key usage is billed and tracked through your Azure Subscription ID.
22+
23+
Each {% data variables.product.github %} account receives a certain amount of included free but rate-limited usage of {% data variables.product.prodname_github_models %}, see [Rate limits](/github-models/use-github-models/prototyping-with-ai-models#rate-limits).
24+
25+
The use of {% data variables.product.prodname_github_models %} from the {% data variables.product.prodname_marketplace %} catalog is subject to the free rate limits, and is not billed.
26+
27+
## Available models
28+
29+
The table below lists the currently available models. Each model supported by {% data variables.product.prodname_github_models %} has an input and output multiplier that determines the number of token units for each request. For more information on token units, see [Pricing for paid usage](#pricing-for-paid-usage).
30+
31+
| Model name | Input multiplier | Cached input multiplier | Output multiplier | Input price (per 1M token units) | Cached input price (per 1M token units) | Output price (per 1M token units) |
32+
| --------------------------------- | ---------------- | ----------------------- | ----------------- |----------------------------------|-----------------------------------------|-----------------------------------|
33+
| OpenAI GPT-4o | 0.25 | 0.125 | 1.0 | $2.50 | $1.25 | $10.00 |
34+
| OpenAI GPT-4o mini | 0.015 | 0.0075 | 0.06 | $0.15 | $0.08 | $0.60 |
35+
| OpenAI GPT-4.1-mini | 0.04 | 0.01 | 0.16 | $0.40 | $0.10 | $1.60 |
36+
| OpenAI GPT-4.1 | 0.2 | 0.05 | 0.8 | $2.00 | $0.50 | $8.00 |
37+
| Phi-3.5-MoE instruct (128k) | 0.016 | N/A | 0.064 | $0.16 | N/A | $0.64 |
38+
| Phi-3.5-mini instruct (128k) | 0.013 | N/A | 0.052 | $0.13 | N/A | $0.52 |
39+
| Phi-3.5-vision instruct (128k) | 0.013 | N/A | 0.052 | $0.13 | N/A | $0.52 |
40+
| Phi-3-medium instruct (4k) | 0.017 | N/A | 0.068 | $0.17 | N/A | $0.68 |
41+
| Phi-3-medium instruct (128k) | 0.017 | N/A | 0.068 | $0.17 | N/A | $0.68 |
42+
| Phi-3-mini instruct (4k) | 0.013 | N/A | 0.052 | $0.13 | N/A | $0.52 |
43+
| Phi-3-mini instruct (128k) | 0.013 | N/A | 0.052 | $0.13 | N/A | $0.52 |
44+
| Phi-3-small instruct (8k) | 0.015 | N/A | 0.06 | $0.15 | N/A | $0.60 |
45+
| Phi-3-small instruct (128k) | 0.015 | N/A | 0.06 | $0.15 | N/A | $0.60 |
46+
| Phi-4 | 0.0125 | N/A | 0.05 | $0.13 | N/A | $0.50 |
47+
| Phi-4-mini-instruct | 0.0075 | N/A | 0.03 | $0.08 | N/A | $0.30 |
48+
| Phi-4-multimodal-instruct | 0.008 | N/A | 0.032 | $0.08 | N/A | $0.32 |
49+
| DeepSeek-R1 | 0.135 | N/A | 0.54 | $1.35 | N/A | $5.40 |
50+
| DeepSeek-R1-0528 | 0.135 | N/A | 0.54 | $1.35 | N/A | $5.40 |
51+
| DeepSeek-V3-0324 | 0.114 | N/A | 0.456 | $1.14 | N/A | $4.56 |
52+
| MAI-DS-R1 | 0.135 | N/A | 0.54 | $1.35 | N/A | $5.40 |
53+
| Grok 3 Mini | 0.025 | N/A | 0.127 | $0.25 | N/A | $1.27 |
54+
| Grok 3 | 0.3 | N/A | 1.5 | $3.00 | N/A | $15.00 |
55+
| Llama 4 Maverick 17B Instruct FP8 | 0.025 | N/A | 0.1 | $0.25 | N/A | $1.00 |
56+
| Llama-3.3-70B-Instruct | 0.071 | N/A | 0.071 | $0.71 | N/A | $0.71 |
57+
58+
For accounts that use a custom model with a third-party model provider, billing is managed through the provider and is subject to the provider’s own pricing. For more information, see the official pricing documentation for your chosen provider.
59+
60+
## Opting in to paid usage
61+
62+
> [!NOTE] Once you opt in to paid usage, you will have access to production grade rate limits and be billed for all usage thereafter. For more information about these rate limits, see [Azure AI Foundry Models quotas and limits](https://learn.microsoft.com/en-us/azure/ai-foundry/model-inference/quotas-limits) in the Azure documentation.
63+
64+
Enterprises and organizations can opt in to paid usage to access expanded model capabilities, including increased request allowances and larger context windows. You can manage their spending by setting a budget.
65+
66+
By default, organizations and personal accounts that opt in to paid usage have a spending limit of $0 US dollars (USD) until the budget is increased.
67+
68+
For more information, see [AUTOTITLE](/billing/managing-your-billing/using-budgets-control-spending).
69+
70+
### How do I pay for {% data variables.product.prodname_github_models %}?
71+
72+
{% data variables.product.prodname_github_models %} usage can be paid for by one or more of the following methods:
73+
74+
* For enterprises, organizations, or personal accounts directly billed by {% data variables.product.github %}, the billing of {% data variables.product.prodname_github_models %} is based on your metered usage for each billing period, and pricing varies by the number of model requests, tokens, and the model multiplier.
75+
* For invoiced accounts, contact {% data variables.contact.contact_enterprise_sales %} to discuss billing for {% data variables.product.prodname_github_models %} usage.
76+
* When using custom models with your own API keys, the billing of {% data variables.product.prodname_github_models %} is based on the model provider's pricing, and not {% data variables.product.github %}.
77+
* Accounts with an existing Azure subscription can use that subscription to pay for model inference by bringing their own API key for custom models. In this case, billing is based on the model provider’s pricing and is managed through the Azure subscription. See [AUTOTITLE](/github-models/github-models-at-scale/set-up-custom-model-integration-models-byok).
78+
79+
> [!TIP]
80+
> You are considered to be directly billed by {% data variables.product.github %} if you pay for {% data variables.product.github %} using a credit card, PayPal, or by invoice.
81+
82+
## Pricing for paid usage
83+
84+
{% data variables.product.prodname_github_models %} pricing is based on the number of token units used, at a fixed price of $0.00001 USD per token unit.
85+
86+
A token unit is calculated by multiplying the number of input and output tokens by their respective model multipliers. All model usage, regardless of the underlying provider or model, is measured in token units. While some providers display prices per 1,000 or per 1,000,000 tokens, {% data variables.product.prodname_github_models %} standardizes billing to the token unit level. This means you are billed using a single SKU and a unified price per token unit, no matter which supported model you use.
87+
88+
Your cost is calculated by multiplying the number of token units you use by the unified token unit price.
89+
90+
At the end of your billing cycle, {% data variables.product.github %} calculates the cost of token units used, starting from your first request after opting in to paid usage.
91+
92+
The number of model requests and tokens you have used are reset every billing cycle.
93+
94+
### Sample models cost calculation
95+
96+
The following table displays how the total cost is calculated for a request using OpenAI GPT-4o:
97+
98+
| Model | Input tokens used | Output tokens used | Input multiplier | Output multiplier | Total token units | Price per token unit | Total cost |
99+
|---------------| ----------------- | ------------------ | ---------------- | ----------------- |-------------------|----------------------|------------|
100+
| OpenAI GPT-4o | 1,000,000 | 1,000,000 | 0.25 | 1 | 1,250,000 | $0.00001 | $12.50 |
101+
102+
### Calculating model costs
103+
104+
The following steps demonstrate how the total cost is calculated:
105+
106+
1. **Calculate input tokens:**
107+
Multiply the number of input tokens by the input multiplier.
108+
`1,000,000 tokens × 0.25 = 250,000 input token units`
109+
110+
1. **Calculate billable output tokens:**
111+
Multiply the number of output tokens by the output multiplier.
112+
`1,000,000 tokens × 1 = 1,000,000 output token units`
113+
114+
1. **Add billable tokens:**
115+
Add the billable input and output tokens.
116+
`250,000 (input) + 1,000,000 (output) = 1,250,000 total token units`
117+
118+
1. **Charges by type:**
119+
* **Input charge:** `250,000 × $0.00001 = $2.50`
120+
* **Output charge:** `1,000,000 × $0.00001 = $10.00`
121+
122+
1. **Calculate the total cost:**
123+
Multiply the total token units by the token unit price.
124+
`1,250,000 × $0.00001 = $12.50 for this request`
125+
126+
## Opting out of paid usage
127+
128+
{% data variables.product.prodname_github_models %} billing is disabled by default for enterprises and organizations. An enterprise must enable paid usage before any organization within it can opt in to billing. Once an enterprise or organization has opted in to paid usage, the billing is enabled for all repositories owned by the enterprise or organization, including repositories owned by {% data variables.product.prodname_emus %} (EMUs).
129+
130+
Enterprises control whether paid usage for {% data variables.product.prodname_github_models %} is available to organizations they own. An enterprise must opt in to paid usage before any organization within it can opt in and be billed. If the enterprise disables billing, no organizations in the enterprise can enable or use paid features.
131+
132+
Organizations can opt out of paid usage by setting a budget, or instead choose to disable {% data variables.product.prodname_github_models %} entirely by disabling the product in the organization's settings, see [Controlling model usage in your organization](/github-models/github-models-at-scale/manage-models-at-scale#controlling-model-usage-in-your-organization).
133+
134+
If an enterprise has opted in to billing for {% data variables.product.prodname_github_models %}, but an organization within the enterprise has opted out of billing, then paid {% data variables.product.prodname_github_models %} usage is disabled for the organization, including for repositories owned by {% data variables.product.prodname_emus %} and the enterprise.
135+
136+
For personal repositories, a user's own settings determine whether paid usage is enabled, unless the user is managed by an enterprise (EMU). In that case, the enterprise’s settings apply.
137+
138+
For more information about the billing hierarchy between enterprises and organizations, see [AUTOTITLE](/billing/managing-the-plan-for-your-github-account/about-billing-for-plans).
139+
140+
## Further reading
141+
142+
* [AUTOTITLE](/billing/managing-billing-for-your-products/viewing-your-product-usage)

‎content/billing/managing-billing-for-your-products/index.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ children:
1414
- /about-billing-for-github-codespaces
1515
- /about-billing-for-github-copilot
1616
- /about-billing-for-github-packages
17+
- /about-billing-for-github-models
1718
- /managing-billing-for-github-advanced-security
1819
- /managing-billing-for-git-large-file-storage
1920
- /managing-billing-for-github-marketplace-apps

‎content/billing/managing-your-billing/about-the-new-billing-platform.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ The products shown in the new billing platform are determined by your {% data va
3232
* {% data variables.product.prodname_registry %}
3333
* {% data variables.large_files.product_name_long %}
3434
* {% data variables.product.prodname_marketplace %}
35+
* {% data variables.product.prodname_github_models %}
3536
* {% data variables.product.prodname_sponsors %}
3637

3738
{% endif %}
@@ -42,6 +43,7 @@ The products shown in the new billing platform are determined by your {% data va
4243
* {% data variables.product.prodname_GH_cs_and_sp %} (only available with {% data variables.product.prodname_team %})
4344
* {% data variables.product.prodname_github_codespaces %}
4445
* {% data variables.product.prodname_copilot %}
46+
* {% data variables.product.prodname_github_models %}
4547
* {% data variables.product.prodname_registry %}
4648
* {% data variables.large_files.product_name_long %}
4749

@@ -54,6 +56,7 @@ The products shown in the new billing platform are determined by your {% data va
5456
* {% data variables.product.prodname_github_codespaces %}
5557
* {% data variables.product.prodname_copilot %}
5658
* {% data variables.product.prodname_enterprise %}
59+
* {% data variables.product.prodname_github_models %}
5760
* {% data variables.product.prodname_registry %}
5861
* {% data variables.large_files.product_name_long %}
5962

‎content/github-models/github-models-at-scale/index.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,5 @@ versions:
66
children:
77
- /use-models-at-scale
88
- /manage-models-at-scale
9+
- /set-up-custom-model-integration-models-byok
910
---

‎content/github-models/github-models-at-scale/manage-models-at-scale.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,4 +47,6 @@ While {% data variables.product.prodname_github_models %} for organizations and
4747

4848
{% data reusables.models.enterprise-change-models-settings %}
4949

50+
{% data reusables.models.enable-select-models-intro %}
51+
5052
{% data reusables.models.enable-select-models-in-org %}

0 commit comments

Comments
 (0)