Skip to content

Commit 7a2e439

Browse files
committed
[ZEPPELIN-6709] Document paragraph output worker settings
1 parent 16a13ae commit 7a2e439

2 files changed

Lines changed: 18 additions & 5 deletions

File tree

‎conf/zeppelin-site.xml.template‎

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -442,16 +442,17 @@
442442
<property>
443443
<name>zeppelin.interpreter.output.worker.count</name>
444444
<value>4</value>
445-
<description>Number of workers in each of the server output and checkpoint pools. Each note is
446-
processed serially; independent notes may run concurrently, and checkpoint saves do not occupy
447-
output workers. Tune for listener and repository latency and available server resources.</description>
445+
<description>Number of workers in each server pool: one pool delivers paragraph output, and the
446+
other saves output checkpoints. Output for a note stays in order, while different notes can be
447+
processed concurrently. Checkpoint saves do not occupy output workers.</description>
448448
</property>
449449

450450
<property>
451451
<name>zeppelin.interpreter.output.events.per.batch</name>
452452
<value>1000</value>
453-
<description>Maximum output events processed for one note before yielding to other ready notes.
454-
This controls scheduling granularity, not queue capacity or output truncation.</description>
453+
<description>Maximum output events a worker processes for one note before giving other ready
454+
notes a turn. Smaller batches can reduce their wait but add scheduling overhead. This setting
455+
does not limit queued events or truncate output.</description>
455456
</property>
456457

457458
<property>

‎docs/setup/operation/configuration.md‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -370,6 +370,18 @@ Sources descending by priority:
370370
<td>102400</td>
371371
<td>Output message from interpreter exceeding the limit will be truncated</td>
372372
</tr>
373+
<tr>
374+
<td><h6 class="properties">ZEPPELIN_INTERPRETER_OUTPUT_WORKER_COUNT</h6></td>
375+
<td><h6 class="properties">zeppelin.interpreter.output.worker.count</h6></td>
376+
<td>4</td>
377+
<td>Number of workers in each server pool: one pool delivers paragraph output, and the other saves output checkpoints. Output for a note stays in order, while different notes can be processed concurrently. Checkpoint saves do not occupy output workers.</td>
378+
</tr>
379+
<tr>
380+
<td><h6 class="properties">ZEPPELIN_INTERPRETER_OUTPUT_EVENTS_PER_BATCH</h6></td>
381+
<td><h6 class="properties">zeppelin.interpreter.output.events.per.batch</h6></td>
382+
<td>1000</td>
383+
<td>Maximum output events a worker processes for one note before giving other ready notes a turn. Smaller batches can reduce their wait but add scheduling overhead. This setting does not limit queued events or truncate output.</td>
384+
</tr>
373385
<tr>
374386
<td><h6 class="properties">ZEPPELIN_INTERPRETER_CONNECT_TIMEOUT</h6></td>
375387
<td><h6 class="properties">zeppelin.interpreter.connect.timeout</h6></td>

0 commit comments

Comments
 (0)