Skip to content

scenarios: add otap-rust collector scenario - #19

Open
bwplotka wants to merge 3 commits into
mainfrom
bwplotka/add-otap-rust-scenario
Open

bwplotka wants to merge 3 commits into
mainfrom
bwplotka/add-otap-rust-scenario

Conversation

@bwplotka

@bwplotka bwplotka commented Nov 4, 2026 •

Copy link
Copy Markdown
Owner

Adds the otap-rust scenario under manifests/scenarios/otap-rust to benchmark the Rust OTAP Dataflow Engine (df_engine) scraping avalanche with urn:otel:receiver:prometheus (prometheus/scrape.rs, open-telemetry/otel-arrow#4630) and exporting via urn:otel:exporter:otlp_grpc + urn:otel:extension:gcp_auth (open-telemetry/otel-arrow#4650) to Google Cloud Telemetry (https://telemetry.googleapis.com:443).

@bwplotka
bwplotka force-pushed the bwplotka/add-otap-rust-scenario branch from 0dec0c2 to 98a483b Compare November 4, 2026 15:32
@bwplotka bwplotka changed the title scenarios: add otap-rust and gmp-otap-rust collector scenarios scenarios: add otap-rust collector scenario Nov 4, 2026
@bwplotka
bwplotka force-pushed the bwplotka/add-otap-rust-scenario branch 2 times, most recently from 8bd066f to b0b124f Compare November 4, 2026 17:10
Adds the manifests/scenarios/otap-rust benchmark scenario for the Rust OTAP Dataflow Engine (df_engine) scraping the 16-pod avalanche deployment via urn:otel:receiver:prometheus (backed by prometheus/expfmt-rs) -> exporter:noop to measure HTTP scrape and Arrow decoding throughput, CPU, and memory in isolation.

Also adds a headless Kubernetes Service for avalanche so DNS service discovery resolves all 16 avalanche pod IPs, and updates core Prometheus/Parca configs to scrape df_engine's /api/v1/metrics endpoint and profile the otap-collector container.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
@bwplotka
bwplotka force-pushed the bwplotka/add-otap-rust-scenario branch from b0b124f to 87eb88e Compare November 4, 2026 17:14
…y.googleapis.com

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
…tch limit

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant