Skip to content

Commit eb6b687

Browse files
Merge pull request #1394 from fluent/alexakreizinger/sc-94919/replace-input-image-with-mermaid-chart
Replace "Concepts" images with Mermaid charts
2 parents 10372f9 + 3c5311a commit eb6b687

File tree

6 files changed

+81
-8
lines changed

6 files changed

+81
-8
lines changed

concepts/data-pipeline/buffer.md

+13-1
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,19 @@ Previously defined in the [Buffering](../buffering.md) concept section, the `buf
88

99
The `buffer` phase already contains the data in an immutable state, meaning, no other filter can be applied.
1010

11-
![](<../../.gitbook/assets/logging\_pipeline\_buffer (1) (1) (2) (2) (2) (2) (2) (2) (2) (1).png>)
11+
```mermaid
12+
graph LR
13+
accTitle: Fluent Bit data pipeline
14+
accDescr: The Fluent Bit data pipeline includes input, a parser, a filter, a buffer, routing, and various outputs.
15+
A[Input] --> B[Parser]
16+
B --> C[Filter]
17+
C --> D[Buffer]
18+
D --> E((Routing))
19+
E --> F[Output 1]
20+
E --> G[Output 2]
21+
E --> H[Output 3]
22+
style D stroke:darkred,stroke-width:2px;
23+
```
1224

1325
{% hint style="info" %}
1426
Note that buffered data is not raw text, it's in Fluent Bit's internal binary representation.

concepts/data-pipeline/filter.md

+13-1
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,19 @@ description: Modify, Enrich or Drop your records
66

77
In production environments we want to have full control of the data we are collecting, filtering is an important feature that allows us to **alter** the data before delivering it to some destination.
88

9-
![](<../../.gitbook/assets/logging\_pipeline\_filter (1) (2) (2) (2) (2) (2) (2) (1).png>)
9+
```mermaid
10+
graph LR
11+
accTitle: Fluent Bit data pipeline
12+
accDescr: The Fluent Bit data pipeline includes input, a parser, a filter, a buffer, routing, and various outputs.
13+
A[Input] --> B[Parser]
14+
B --> C[Filter]
15+
C --> D[Buffer]
16+
D --> E((Routing))
17+
E --> F[Output 1]
18+
E --> G[Output 2]
19+
E --> H[Output 3]
20+
style C stroke:darkred,stroke-width:2px;
21+
```
1022

1123
Filtering is implemented through plugins, so each filter available could be used to match, exclude or enrich your logs with some specific metadata.
1224

concepts/data-pipeline/input.md

+13-1
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,19 @@ description: The way to gather data from your sources
66

77
[Fluent Bit](http://fluentbit.io) provides different _Input Plugins_ to gather information from different sources, some of them just collect data from log files while others can gather metrics information from the operating system. There are many plugins for different needs.
88

9-
![](<../../.gitbook/assets/logging\_pipeline\_input (1) (2) (2) (2) (2) (2) (2) (2) (1).png>)
9+
```mermaid
10+
graph LR
11+
accTitle: Fluent Bit data pipeline
12+
accDescr: The Fluent Bit data pipeline includes input, a parser, a filter, a buffer, routing, and various outputs.
13+
A[Input] --> B[Parser]
14+
B --> C[Filter]
15+
C --> D[Buffer]
16+
D --> E((Routing))
17+
E --> F[Output 1]
18+
E --> G[Output 2]
19+
E --> H[Output 3]
20+
style A stroke:darkred,stroke-width:2px;
21+
```
1022

1123
When an input plugin is loaded, an internal _instance_ is created. Every instance has its own and independent configuration. Configuration keys are often called **properties**.
1224

concepts/data-pipeline/output.md

+15-1
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,21 @@ description: 'Destinations for your data: databases, cloud services and more!'
66

77
The output interface allows us to define destinations for the data. Common destinations are remote services, local file system or standard interface with others. Outputs are implemented as plugins and there are many available.
88

9-
![](<../../.gitbook/assets/logging\_pipeline\_output (1) (1).png>)
9+
```mermaid
10+
graph LR
11+
accTitle: Fluent Bit data pipeline
12+
accDescr: The Fluent Bit data pipeline includes input, a parser, a filter, a buffer, routing, and various outputs.
13+
A[Input] --> B[Parser]
14+
B --> C[Filter]
15+
C --> D[Buffer]
16+
D --> E((Routing))
17+
E --> F[Output 1]
18+
E --> G[Output 2]
19+
E --> H[Output 3]
20+
style F stroke:darkred,stroke-width:2px;
21+
style G stroke:darkred,stroke-width:2px;
22+
style H stroke:darkred,stroke-width:2px;
23+
```
1024

1125
When an output plugin is loaded, an internal _instance_ is created. Every instance has its own independent configuration. Configuration keys are often called **properties**.
1226

concepts/data-pipeline/parser.md

+13-2
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,19 @@ description: Convert Unstructured to Structured messages
66

77
Dealing with raw strings or unstructured messages is a constant pain; having a structure is highly desired. Ideally we want to set a structure to the incoming data by the Input Plugins as soon as they are collected:
88

9-
![](<../../.gitbook/assets/logging\_pipeline\_parser (1) (1) (1) (1) (2) (2) (2) (3) (3) (3) (3) (3) (1).png>)
10-
9+
```mermaid
10+
graph LR
11+
accTitle: Fluent Bit data pipeline
12+
accDescr: The Fluent Bit data pipeline includes input, a parser, a filter, a buffer, routing, and various outputs.
13+
A[Input] --> B[Parser]
14+
B --> C[Filter]
15+
C --> D[Buffer]
16+
D --> E((Routing))
17+
E --> F[Output 1]
18+
E --> G[Output 2]
19+
E --> H[Output 3]
20+
style B stroke:darkred,stroke-width:2px;
21+
```
1122
The Parser allows you to convert from unstructured to structured data. As a demonstrative example consider the following Apache (HTTP Server) log entry:
1223

1324
```

concepts/data-pipeline/router.md

+14-2
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,19 @@ description: Create flexible routing rules
66

77
Routing is a core feature that allows to **route** your data through Filters and finally to one or multiple destinations. The router relies on the concept of [Tags](../key-concepts.md) and [Matching](../key-concepts.md) rules
88

9-
![](<../../.gitbook/assets/logging\_pipeline\_routing (1) (1) (2) (2) (2) (2) (2) (2) (2) (1) (1).png>)
9+
```mermaid
10+
graph LR
11+
accTitle: Fluent Bit data pipeline
12+
accDescr: The Fluent Bit data pipeline includes input, a parser, a filter, a buffer, routing, and various outputs.
13+
A[Input] --> B[Parser]
14+
B --> C[Filter]
15+
C --> D[Buffer]
16+
D --> E((Routing))
17+
E --> F[Output 1]
18+
E --> G[Output 2]
19+
E --> H[Output 3]
20+
style E stroke:darkred,stroke-width:2px;
21+
```
1022

1123
There are two important concepts in Routing:
1224

@@ -77,7 +89,7 @@ The following example demonstrates how to route data from sources based on a reg
7789
7890
[OUTPUT]
7991
Name stdout
80-
Match_regex .*_sensor_[AB]
92+
Match_regex .*_sensor_[AB]
8193
```
8294

8395
In this configuration, the **Match_regex** rule is set to `.*_sensor_[AB]`. This regular expression will match any Tag that ends with "_sensor_A" or "_sensor_B", regardless of what precedes it.

0 commit comments

Comments
 (0)