Skip to content

Commit ab47a9a

Browse files
committed
Update config reference
1 parent 71c397e commit ab47a9a

File tree

1 file changed

+20
-2
lines changed
  • docs/api-reference/loaders-storage-targets/bigquery-loader/configuration-reference

1 file changed

+20
-2
lines changed

Diff for: docs/api-reference/loaders-storage-targets/bigquery-loader/configuration-reference/_common_config.md

+20-2
Original file line numberDiff line numberDiff line change
@@ -11,8 +11,26 @@ import Link from '@docusaurus/Link';
1111
<td>Optional. Default value <code>1 second</code>. Events are emitted to BigQuery after a maximum of this duration, even if the <code>maxBytes</code> size has not been reached</td>
1212
</tr>
1313
<tr>
14-
<td><code>batching.uploadConcurrency</code></td>
15-
<td>Optional. Default value 3. How many batches can we send simultaneously over the network to BigQuery</td>
14+
<td><code>batching.writeBatchConcurrency</code></td>
15+
<td>Optional. Default value 2. How many batches can we send simultaneously over the network to BigQuery</td>
16+
</tr>
17+
<tr>
18+
<td><code>cpuParallelism.parseBytesFactor</code></td>
19+
<td>
20+
Optional. Default value <code>0.1</code>.
21+
Controls how many batches of bytes we can parse into enriched events simultaneously.
22+
E.g. If there are 2 cores and <code>parseBytesFactor = 0.1</code> then only one batch gets processed at a time.
23+
Adjusting this value can cause the app to use more or less of the available CPU.
24+
</td>
25+
</tr>
26+
<tr>
27+
<td><code>cpuParallelism.transformFactor</code></td>
28+
<td>
29+
Optional. Default value <code>0.75</code>.
30+
Controls how many batches of enriched events we can transform into BigQuery format simultaneously.
31+
E.g. If there are 4 cores and <code>transformFactor = 0.75</code> then 3 batches gets processed in parallel.
32+
Adjusting this value can cause the app to use more or less of the available CPU.
33+
</td>
1634
</tr>
1735
<tr>
1836
<td><code>retries.setupErrors.delay</code></td>

0 commit comments

Comments
 (0)