Title: Living Benchmark Dashboard · RFP · EthSystems

URL Source: https://original.es-internal.pages.dev/rfps/rfp-benchmark-dashboard/

Markdown Content:
---
description: Privacy L2 vendors claim 25k+ TPS, but institutions have no way to verify these claims for their specific workloads. One-off benchmark reports expire quickly (hard forks, client updates invalidate results within months). Institutions need continuously-updated, reproducible benchmarks they can trust.
title: Living Benchmark Dashboard · RFP · EthSystems
image: https://original.es-internal.pages.dev/og.png
---

[Skip to content](#main-content) 

# RFP: Living Benchmark Dashboard

## Why It Matters

* Replaces "trust the vendor" with "run this yourself"
* Provides credible data for institutional architecture decisions
* Creates accountability: vendors can't make unverifiable claims
* Supports ongoing comparison as systems mature

## Scope

### In-Scope

* Automated benchmark pipeline (CI/CD) that runs weekly on latest builds
* Benchmark harnesses for institutional workloads:
  * Private transfer (shielded send with nullifier update)
  * DvP settlement pattern
  * Batch operations (10, 100, 1000 txs)
  * Compliance proof generation
* Target systems (public testnets where available):
  * **Privacy L2s**:
    * _Public L2_: Aztec, Miden, Intmax
    * _AppChain SDK_: Prividium, EY Nightfall, Scroll Cloak
  * **Privacy App Layers**:
    * Zama fhEVM (coprocessor)
    * Kaleido/Paladin (L1 privacy)
    * Railgun (L1 shielded pool)
* Metrics per system:
  * **Performance**: Throughput (TPSPublic/TPSPrivate), latency, finality
  * **Cost**: Gas usage, bridging costs, forced exit costs
  * **Privacy**: What is hidden, from whom, trust model
  * **Security**: Sequencer decentralization, censorship resistance, upgrade process
  * Trust dimensions (from [Trust Assurance](/use-cases/rfp-trust-assurance/))
* Dockerized reproduction: anyone can run `docker-compose up` to verify

### Out-of-Scope

* Proprietary/closed systems without public access
* Legal analysis of results
* Optimization recommendations (that's vendor work)

## Deliverables

* Benchmark harness repo (open source, Docker-based)
* CI pipeline that runs weekly and publishes results
* Comparison dashboard (static site or markdown in EthSystems Map)
* Methodology document (how to interpret results, caveats)
* Integration with EthSystems Map vendor pages (automated updates)

## Dependencies

**Requires:**

* Public testnet access for target systems
* Clear workload definitions (coordinate with EthSystems team)
* Trust schema from [Trust Assurance](/use-cases/rfp-trust-assurance/) for complete picture

**Enables:**

* Data-driven vendor comparisons
* Input to [L2 Privacy Comparison Matrix](https://github.com/ethsystems/map/issues/27)
* Credible "reality check" for institutional presentations

## See Also

* [GitHub Issue #27](https://github.com/ethsystems/map/issues/27) — Performance and trust assumptions mapping
* [Vendors](../vendors/) — Systems to benchmark
* [Pattern: DvP Settlement](/patterns/pattern-dvp-erc7573/) — Example workload

#### Referenced by

RFPs1
* [Trust Assurance Framework](/rfps/rfp-trust-assurance/)

×

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://ethsystems.org/#organization","name":"EthSystems","url":"https://ethsystems.org/","logo":"https://ethsystems.org/icon-maskable.png","sameAs":["https://x.com/eth_systems","https://www.linkedin.com/company/ethsystems/","https://github.com/ethsystems"]},{"@type":"WebSite","@id":"https://ethsystems.org/#website","url":"https://ethsystems.org/","name":"EthSystems","publisher":{"@id":"https://ethsystems.org/#organization"}}]}
```