Vote for your favorite SkillMD. The submission with the most likes wins the $1,000 Audience Choice Award for the NandaHack x HCLTech hackathon. Voting is open through September 25.Vote now →

Reference
benchmark runs by
scenario.

Side-by-side metrics from the core team’s reference runs, listed newest first. Compare entries within the same scenario. Runs are deterministic, so a scenario re-run with its recorded seed produces the same result under Tier 1 conditions.

Scenario
Sort by
RunNameScenarioAgentsDeliveryDealLatencyThroughputDate
01Marketplace v3 (optimized)Marketplace100
100%
68.4%2.1t42.3 m/t2026-05-14
02Auction with dynamic pricingAuction20
100%
56%1.8t31.2 m/t2026-05-13
03Quorum Consensus (20 nodes)Consensus20
100%
1t15.6 m/t2026-05-12
04Supply chain (4-hop)Supply chain4
100%
4t7.8 m/t2026-05-11
05Voting with 18 votersVoting20
100%
1.2t22.3 m/t2026-05-10
06Reputation (4 of 21 malicious)Reputation21
100%
2.4t11.7 m/t2026-05-09
07Marketplace baselineMarketplace100
100%
52.1%2.8t9.9 m/t2026-05-08
08Consensus under partitionConsensus20
95.2%
6.3t4.5 m/t2026-05-07

Methodology

About these
runs.

Delivery rate

Fraction of sent messages that were received. Not a measure of protocol success.

Deal rate

Percentage of buy requests that resulted in a successful trade. Marketplace and auction only.

Latency

Mean ticks between send and receive for correlated message pairs.

Throughput

Messages processed per tick across all agents.