Skip to content

Commit f30f9b6

Browse files
Chasen-ZhangChasen-Zhang
committed
feat: init
1 parent 7144957 commit f30f9b6

File tree

1,127 files changed

+72815
-2
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

1,127 files changed

+72815
-2
lines changed

‎.editorconfig

+14
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
# EditorConfig is awesome: https://EditorConfig.org
2+
3+
# top-most EditorConfig file
4+
root = true
5+
6+
# Unix-style newlines with a newline ending every file
7+
[*]
8+
end_of_line = lf
9+
insert_final_newline = true
10+
trim_trailing_whitespace = true
11+
12+
# Make sure all code is in utf-8 charset
13+
[*.{rs,js,toml,py,yml}]
14+
charset = utf-8

‎.gitattributes

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
docker/** -text
2+
scripts/** -text
3+
website/databend/** -text

‎.gitignore

+20
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
# Dependencies
2+
/node_modules
3+
4+
# Production
5+
/build
6+
7+
# Generated files
8+
.docusaurus
9+
.cache-loader
10+
11+
# Misc
12+
.DS_Store
13+
.env.local
14+
.env.development.local
15+
.env.test.local
16+
.env.production.local
17+
18+
npm-debug.log*
19+
yarn-debug.log*
20+
yarn-error.log*

‎.nvmrc

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
18.12.1

‎.remarkrc.yml

+33
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
plugins:
2+
- remark-validate-links
3+
- [
4+
remark-lint-no-dead-urls,
5+
{
6+
skipLocalhost: true,
7+
skipUrlPatterns:
8+
[
9+
'/^https:\/\/(.*)github\.com/',
10+
/^https:\/\/link\.databend\.rs/,
11+
/^https:\/\/(.*)vldb\.org/,
12+
/^https:\/\/(.*)arxiv\.org/,
13+
/^https:\/\/asciinema\.org/,
14+
"https://asciinema.org",
15+
"https://github.com",
16+
"https://link.databend.rs",
17+
],
18+
gotOptions:
19+
{
20+
concurrency: 1,
21+
timeout:
22+
{
23+
lookup: 100,
24+
connect: 100,
25+
secureConnect: 50,
26+
socket: 1000,
27+
send: 5000,
28+
response: 1000,
29+
},
30+
},
31+
},
32+
]
33+
# https://github.com/remarkjs/remark-lint/blob/main/doc/rules.md

‎README.md

+61-2
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,61 @@
1-
# databend-docs-
2-
Databend user documentation
1+
# Website
2+
3+
This website is built using [Docusaurus 2](https://docusaurus.io/), a modern static website generator.
4+
5+
## Get Started
6+
7+
Specify node version
8+
9+
```shell
10+
nvm use
11+
```
12+
13+
Install dependencies
14+
15+
```shell
16+
yarn install
17+
```
18+
19+
Local preview
20+
21+
```shell
22+
yarn start
23+
```
24+
25+
Production build
26+
27+
```shell
28+
yarn build
29+
```
30+
31+
## Features
32+
33+
### Tabs
34+
35+
```markdown
36+
import Tabs from '@theme/Tabs';
37+
import TabItem from '@theme/TabItem';
38+
39+
<Tabs>
40+
<TabItem value="binary" label="Release binary" default>
41+
...
42+
</TabItem>
43+
<TabItem value="docker" label="Run with Docker(Recommended)">
44+
...
45+
</TabItem>
46+
</Tabs>
47+
```
48+
49+
Take [Deploy](../docs/user/index.md) for example. Visit [Docusaurus - Tabs](https://docusaurus.io/docs/markdown-features/tabs) for detailed reference.
50+
51+
### Admonitions
52+
53+
```markdown
54+
:::tip
55+
56+
Some **content** with _markdown_ `syntax`.
57+
58+
:::
59+
```
60+
61+
Take [Deploy](../docs/user/index.md) for example. Visit [Docusaurus - Admonitions](https://docusaurus.io/docs/markdown-features/admonitions) for detailed reference.

‎babel.config.js

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
module.exports = {
2+
presets: [require.resolve('@docusaurus/core/lib/babel/preset')],
3+
};

‎blog/2022-03-28-databend-v0.7-release.md

+69
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
---
2+
title: Announcing Databend v0.7.0 - Deploy easier, query faster
3+
description: This is my first post on Docusaurus 2.
4+
slug: databend-0-7-0-release
5+
date: 2022-03-28
6+
tags: [databend, v0.7.0]
7+
cover_url: databend-vseven.png
8+
authors:
9+
- name: BohuTANG
10+
url: https://github.com/BohuTANG
11+
image_url: https://github.com/BohuTANG.png
12+
---
13+
14+
**Continuing breaking ground, activate your object storage for big data analytics in sub-second!**
15+
16+
<!--truncate-->
17+
18+
Thank you to everyone for the work over the past 4 months!
19+
20+
With our latest release, Databend v0.7.0, this release includes several new user-facing features, performance optimizations, and many other improvements, activate your object storage for big data analytics!
21+
22+
## Highlights
23+
24+
0.7.0 release brings Databend architecture to a stable stage
25+
26+
* Simple primitive data type framework
27+
* New Pull&Push-Based Processor framework
28+
* Git-Like table format with snapshot transaction isolation
29+
* Announce [OpenDAL](https://github.com/datafuselabs/opendal) for object storage data access
30+
* Announce [OpenRaft](https://github.com/datafuselabs/openraft) to improve raft as the next generation consensus protocol
31+
32+
## New Features
33+
34+
* [Query] Add DateTime64 data type
35+
* [Query] Add Semi-Structured variant data type
36+
* [Query] Add `group by` nullable column
37+
* [Query] Add filter push-down for `read datasource`
38+
* [Query] Add function monotonicity check
39+
* [Query] Add support for Java/Python/Golang client and JDBC driver
40+
* [Query] Add support for github external datasource
41+
* [Query] Add support for `CREATE TABLE [IF NOT EXISTS] [db.]table LIKE [db.]origin_table AS SELECT query`
42+
* [Query] Add support for `Copy INTO <table> from external location`
43+
* [Query] Add support for `COPY INTO <table> FROM internal/external stage`
44+
* [Query] Add support for `ALTER TABLE [ IF EXISTS ] <name> RENAME TO <new_table_name>`
45+
* [Query] Add support for `[NOT] IN (a, b, c, ...) InList`
46+
* [Query] Add user defined functions
47+
* [Query] Add `system.query_log` for multi-tenant query statistics
48+
* [Query] Add `CALL` procedure for administrator operation
49+
* [Query] Add support for CSV/Parquet/Json file streaming load
50+
* [Query] Add embed markdown dos into `system.functions`
51+
* [Query] Add support for config file format json, yaml, toml
52+
* [Query] Add support for column specify an expression as default value
53+
* [User] Add support for basic RBAC privileges
54+
* [Storage] Add database_id/table_id to data file prefix
55+
* [Storage] Add version to storage layout for upgrade
56+
* [Meta] Add support for multi tenant
57+
* [Meta] Replace arrow flight service with gRPC
58+
59+
## Improvements
60+
* [Query] Change Pull-Based to New Pull&Push-Based processor
61+
* [Query] Improve parallel write performance
62+
* [Doc] Better documentation https://databend.rs
63+
64+
## Reference
65+
66+
* [How to Deploy Databend](https://databend.rs/doc/deploy)
67+
* [How to Load Data to Databend](https://databend.rs/doc/load-data/load)
68+
* [Benchmark Reports](https://databend.rs/blog/clickbench-databend-top)
69+
* [Databend v0.7.0 Release Notes](https://github.com/datafuselabs/databend/releases/tag/v0.7.0-nightly)

‎blog/2022-06-09-quick-deploy.md

+141
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,141 @@
1+
---
2+
title: Deploying Databend on Your Laptop in Minutes
3+
description: A quick Databend deployment guide
4+
slug: deploy-databend-on-laptop
5+
date: 2022-06-09
6+
tags: [databend, deploy]
7+
cover_url: deploying-databend-on-laptop.png
8+
authors:
9+
- name: Eric
10+
url: https://github.com/soyeric128
11+
image_url: https://github.com/soyeric128.png
12+
---
13+
14+
**Deploying Databend on Your Laptop in Minutes**
15+
16+
17+
Deploying a data warehouse sounds like a big job to you? Definitely NOT. Databend can be deployed to your laptop and uses the local file system as storage. You can complete the deployment in a few minutes even if you're new to Databend.
18+
Now let's get started!
19+
20+
:::tip
21+
22+
Databend requires a scalable storage (for example, object storage) to work. This blog uses local file system to provide you a hands-on experience. Never use a local file system as storage for production purposes.
23+
24+
:::
25+
26+
27+
## STEP 1. Downloading Databend
28+
29+
a. Create a folder named `databend` in the directory `/usr/local`. Then create the following subfolders in the folder `databend`:
30+
31+
* *bin*
32+
* *data*
33+
* *etc*
34+
* *logs*
35+
36+
b. Download and extract the latest Databend package for your platform from [https://github.com/datafuselabs/databend/releases](https://github.com/datafuselabs/databend/releases).
37+
38+
c. Move the extracted files `databend-meta` and `databend-query` to the folder `/usr/local/databend/bin`.
39+
40+
## STEP 2. Deploying a Standalone databend-meta
41+
42+
a. Create a file named `databend-meta.toml` in the folder `/usr/local/databend/etc` with the following content:
43+
44+
```toml
45+
dir = "metadata/_logs"
46+
admin_api_address = "127.0.0.1:8101"
47+
grpc_api_address = "127.0.0.1:9101"
48+
49+
[raft_config]
50+
id = 1
51+
single = true
52+
raft_dir = "metadata/datas"
53+
54+
```
55+
56+
b. Open a terminal window and navigate to the folder `/usr/local/databend/bin`.
57+
58+
c. Run the following command to start databend-meta:
59+
60+
```shell
61+
./databend-meta -c ../etc/databend-meta.toml > meta.log 2>&1 &
62+
```
63+
64+
d. Run the following command to check if databend-meta was started successfully:
65+
66+
```shell
67+
curl -I http://127.0.0.1:8101/v1/health
68+
```
69+
70+
## STEP 3. Deploying a Standalone databend-query
71+
72+
a. Create a file named `databend-query.toml` in the folder `/usr/local/databend/etc` with the following content:
73+
74+
```toml
75+
[log]
76+
level = "INFO"
77+
dir = "benddata/_logs"
78+
79+
[query]
80+
# For admin RESET API.
81+
admin_api_address = "127.0.0.1:8001"
82+
83+
# Metrics.
84+
metric_api_address = "127.0.0.1:7071"
85+
86+
# Cluster flight RPC.
87+
flight_api_address = "127.0.0.1:9091"
88+
89+
# Query MySQL Handler.
90+
mysql_handler_host = "127.0.0.1"
91+
mysql_handler_port = 3307
92+
93+
94+
# Query HTTP Handler.
95+
http_handler_host = "127.0.0.1"
96+
http_handler_port = 8081
97+
98+
tenant_id = "tenant1"
99+
cluster_id = "cluster1"
100+
101+
[meta]
102+
address = "127.0.0.1:9101"
103+
username = "root"
104+
password = "root"
105+
106+
[storage]
107+
# s3
108+
type = "fs"
109+
110+
[storage.fs]
111+
data_path = "benddata/datas"
112+
```
113+
114+
b. Open a terminal window and navigate to the folder `/usr/local/databend/bin`.
115+
116+
c. Run the following command to start databend-meta:
117+
118+
```shell
119+
./databend-query -c ../etc/databend-query.toml > query.log 2>&1 &
120+
```
121+
122+
d. Run the following command to check if databend-meta was started successfully:
123+
124+
```shell
125+
curl -I http://127.0.0.1:8001/v1/health
126+
```
127+
128+
129+
There you go! You have successfully deployed Databend on your computer. If you have a SQL client on your computer, try the steps below to verify the deployment:
130+
131+
a. Create a connection to 127.0.0.1 from your SQL client. In the connection, set the port to `3307`, and set the username to `root`.
132+
133+
b. Run the following commands to check if the query is successful:
134+
135+
```sql
136+
CREATE TABLE t1(a int);
137+
138+
INSERT INTO t1 VALUES(1), (2);
139+
140+
SELECT * FROM t1;
141+
```

0 commit comments

Comments
 (0)