ChatGPT Plugin

Bencher

Continuous Benchmarking

Brand: Bencher

Category: Developer Tools
Primary Subcategory: Test Automation & QA

Integration details

Description

Bencher is a continuous benchmarking platform that helps systems software engineers catch performance regressions before they merge. How Bencher Works: 1. Run: Run your benchmarks locally or in CI using the exact same bare metal runners and your favorite benchmarking tools. The `bencher` CLI orchestrates running your benchmarks on bare metal and stores the results. 2. Track: Track the results of your benchmarks over time. Monitor, query, and graph the results using the Bencher web console based on the source branch, testbed, benchmark, and measure. 3. Catch: Catch performance regressions locally or in CI using the exact same bare metal hardware. Bencher uses state of the art, customizable analytics to detect performance regressions before they merge. For the same reasons that unit tests are run to prevent feature regressions, benchmarks should be run with Bencher to prevent performance regressions. Performance bugs are bugs!

Integration type: Plugin
Verification status: Not applicable
Platform: ChatGPT
Category: Developer Tools
Primary Subcategory: Test Automation & QA
Secondary Subcategories: None listed
Brand: Bencher
Access: Account optional
First tracked: 2026-10-28
Tool count: 36
Market: US

Agent DiscoverabilityChatGPT Plugin Discovery Score

ChatGPT organic discovery is live

Your score is coming

ChatGPT now suggests Plugins on its own when they match a user's request.Your Plugin Discovery Score measures how often yours appears, and it will show here as soon as it’s ready.

ChatGPT recommends Airtable when a user asks it to update a CRM. — ChatGPT surfaces Airtable because it matches the user's request.

Primary Subcategory

Competing in ChatGPT Test Automation & QA

View Category

Listed in alphabetical order

Primary Subcategory

Accessibility Checker WCAGComing soonGet notified

Accessibility RepairComing soonGet notified

AfterwardComing soonGet notified

BencherComing soonGet notified

BrowserStackComing soonGet notified

Tools

36 tools agents can invoke

Create a benchmark for a project.
create_benchmark
Create a branch for a project.
create_branch
Create a measure for a project.
create_measure
Create a report from raw benchmark results for an existing branch and testbed. Prefer `submit_run` unless the branch and testbed are already known to exist.
create_report
Create a testbed for a project.
create_testbed
Create a threshold for a project: a branch, testbed, and measure with a statistical model used to detect performance regressions. `parameters` is the filter over variants, and a variant is checked when any entry in the filter is a subset of its parameters; the default checks every variant. `metric` names the metric the threshold checks and defaults to `value`. Every threshold that matches a metric row runs, so a row may earn several boundaries and several alerts.
create_threshold
List performance alerts for a project, generated when a threshold boundary is exceeded.
list_alerts
List benchmarks for a project.
list_benchmarks
List branches for a project.
list_branches
List bare metal runner jobs for a project.
list_jobs
List measures for a project (e.g. latency, throughput).
list_measures
List saved dashboard plots for a project.
list_plots
List an organization's projects. The `organization` argument accepts an organization slug or UUID. With a project API key (`bencher_run_`), only that project is returned; with a user API key, every project in the organization is returned.
list_projects
List reports for a project, sorted by date time in reverse chronological order by default. Results and alerts are collapsed to counts unless `expand` is set to true.
list_reports
List testbeds for a project.
list_testbeds
List thresholds for a project. A threshold is a branch, testbed, and measure with a statistical model, checking a filter over the benchmark's variants and one metric name.
list_thresholds
Query benchmark metrics over time for a project. This is the primary tool for investigating performance history and regressions. `branches`, `testbeds`, `benchmarks`, and `measures` are comma-separated lists of UUIDs; use the corresponding list tools to find them. `start_time` and `end_time` bound the results in milliseconds since epoch.
query_perf
Render a perf plot image (JPEG) for a project. Takes the same query arguments as `query_perf`, plus an optional `title`.
perf_image
Submit benchmark results to create a run. The `results` field takes the raw output of a benchmark harness as strings; the server parses them using the adapter in `settings.adapter` (defaults to `magic` auto-detection). Branch, testbed, and thresholds are created on the fly if they do not exist. Prefer the `bencher run` CLI when benchmarks are executed from a local checkout; use this tool when the results are already in hand.
submit_run
Update an alert. Project API keys (`bencher_run_`) can only update the alert status (e.g. acknowledge or dismiss).
update_alert
Update a benchmark. Project API keys (`bencher_run_`) cannot rename benchmarks.
update_benchmark
Update a branch. Project API keys (`bencher_run_`) cannot rename branches.
update_branch
Update a measure. Project API keys (`bencher_run_`) cannot rename measures.
update_measure
Update a testbed. Project API keys (`bencher_run_`) cannot rename testbeds.
update_testbed
Update a threshold's statistical model, or remove the model by setting it to null.
update_threshold
View an alert, including the boundary that was exceeded. The `alert` argument is an alert UUID.
view_alert
View a benchmark. The `benchmark` argument accepts a benchmark slug or UUID.
view_benchmark
View a branch. The `branch` argument accepts a branch slug or UUID.
view_branch
View a bare metal runner job. The `job` argument is a job UUID.
view_job
View a measure. The `measure` argument accepts a measure slug or UUID.
view_measure
View a single metric with its full context: report, branch, testbed, benchmark, measure, and any threshold boundary. The `metric` argument is a metric UUID.
view_metric
View a saved dashboard plot. The `plot` argument is a plot UUID.
view_plot
View a project. The `project` argument accepts a project slug or UUID.
view_project
View a report, including its full results and any alerts.
view_report
View a testbed. The `testbed` argument accepts a testbed slug or UUID.
view_testbed
View a threshold. The `threshold` argument is a threshold UUID.
view_threshold

FAQs

Bencher ChatGPT Plugin FAQ

How the directory, categories and Discoverability Score work.

Read the methodology

How do I improve Bencher's ChatGPT Plugin discoverability?

The levers are the listing surface agents actually read: names, descriptions, keywords, tool metadata, and registry health. Which lever matters depends on where discovery breaks, which is what continuous measurement shows.

What are Bencher alternatives on ChatGPT?

As of 2026-10-28, Bencher competes with Accessibility Checker WCAG, Accessibility Repair, Afterward, BrowserStack, Cobalt Capture, CodSpeed, Currents, Greptile and 15 more in ChatGPT Test Automation & QA, ranked by public Discoverability Score.

Where is this profile measured?

This profile uses the geography attached to the latest public registry snapshot: US. Locale tags are intentionally omitted.