Artillery

Changelog

Feature updates and improvements to Artillery.

Dashboard

Metrics page improvements

We have improved the Metrics page, it should load much faster and be easier and quicker to navigate. Here are the changes:

Bugs fixes & improvements

Edmundo SantosEdmundo Santos
Dashboard

Introducing new Chart builder widget

You can now create custom charts with any metrics from your test run. Charts created with the new chart builder are available across different test runs with the same name. Custom charts can also be viewed by other members of your team.

Chart navigator

For long test runs, a navigator is available to help you zoom-in and inspect different phases of your load test. The new navigator is available on the bottom of the chart, and the zoom level is synchronized across all charts, including the newly introduced custom charts.

Bugs fixes & improvements

Edmundo SantosEdmundo Santos
Dashboard

Team members view redesign

You can now invite new team members and manage existing membership from one screen.

See usage stats and limits

Usage stats and limits

You can see how much of your plan’s quota your organization is using in the new usage stats section in the Billing page. There’s also a new FAQ section to help with any questions you might have around usage limits.

Filter by Date improvements

Filter by date gets a new navigation, with improvements for selecting dates across multiple months. There’s a new Last 7 days shortcut too.

Organization dropdown updates

Organization dropdown

There’s a new quick access area with links to Billing, Team Members, and API Keys in the organization dropdown. You can now see your current billing plan too.

Dashboard

Load phases on Page performance widget

Load Test reports improvements

Charts improvements

Bug fixes and improvements

Dashboard

Shared test reports

Unique sharing URLs can now be generated for test reports. This is useful for sharing test reports with people outside of your team on Artillery Cloud.

Page performance improvements

Page performance scores

We have updated the colors for the Page performance widget so they are consistent across all charts that have the same metrics. We now show the score (good, fair, bad) for every metric on all tooltips and on also the “Performance breakdown by URL” table.

Metrics explorer improvements

Metrics explorer

When plotting two separate metrics with the same aggregation (e.g. p95) for comparisons, the series lines now show a distinctive style to improve readability.

Dashboard

See usage stats at a glance

You can now see an overview of your team’s load testing activity at a glance:

Stats for all time activity are shown by default, but you can also see stats for the last 30 days.

Dashboard

Stop running tests from the dashboard

Sometimes you need to stop a test that is currently running. You can now do this directly from the dashboard.

This works for all Artillery tests that run on AWS Fargate, regardless of whether they are triggered from a developer’s machine or from a CI/CD pipeline.

This feature requires that Artillery CLI v2.0.1 or later is used to run the test.

Dashboard

Chart improvements

Load summary widget

In order to enhance readability and efficiency, we have made the following updates to charts:

Improve load phase visualization

We have also improved the design of load phases on all charts. Changes include:

HTTP performance widget

We have introduced a new HTTP performance widget that displays information for all HTTP requests. This widget offers the following enhancements:

Dashboard

Load phases information

Display load phase information on all time series charts when you hover over the load phase name.

Improvements to HTTP Requests and Errors widgets

Widgets improvements

Page performance chart previews

Show sparkline chart preview of Page performance scores per URL over time. This is useful to help you identify any spikes without needing to expand the chart.

Page performance

Bug fixes & improvements

Dashboard

Load Test view improvements

Custom favicons

We have added custom favicons that show the current test status right in your browser tab. Helps you keep tabs on your running tests and for those with multiple tabs opened.

Custom favicons

In-progress test view improvements

Improve loading states for HTTP requests and HTTP response distribution widgets.

Bug fixes & improvements

Dashboard

Group views

Group views make it much easier to scan through your Load Tests page, specially for users that run a high volume of tests. We have added grouping by date, test status, test name, and user.

In-progress test view improvements

We have improved loading states and help copy on Checks, Errors, and Load Summary widgets.

Loading screen improvements

Improve performance of loading screens and update its design.

Bug fixes & improvements

Dashboard

New Activity widget

This update is focused on improving visibility of test phases for tests in progress.

New Activity widget

Improve Test Logs

Bug fixes & Improvements

Dashboard

Dashboard improvements

This update is focused on many small improvements to improve overall information density and make it easier to understand load testing activity at a glance, as well as to make it easier to analyze individual load test runs.

New features

Test list view

Load test view

Bug fixes & Improvements

Dashboard

Improvements to notes and metadata display

Metadata and Notes improvements

We’ve reorganized the layout of individual test reports to make notes more prominent, improved readability of the metadata section, and created more room for useful visualizations in the main area.

Test view sidebar

Notes

Notes provide a way to annotate test runs with useful information such as links to external logs and dashboards, and for recording results of investigations into performance issues found by load tests.

We’ve now pulled them out from a separate view to make them more accessible.

Other fixes & improvements:

Metadata display

Load test visualizations & insights

Other fixes & improvements

Dashboard

Improved Page performance visualizations

Page performance improvements

See how Core Web Vitals change under load

You can now see Core Web Vitals measurements for an entire test run, and understand how user experience is affected by high load.

Core Web Vitals under high load

Switch between p99, p95 and median

We have added the ability to switch between p99, p95 and median aggregations for visualizing Core Web Vitals metrics.

Other improvements

New quickstart wizard

We have added a new quickstart wizard which lets you go from first sign-in to running a load test in 3 steps.

Artillery Cloud getting started wizard

Other fixes & improvements

Dashboard

Frontend performance metrics

front-end performance metrics

Core Web Vitals is a set of key frontend performance metrics that measure user-perceived performance of a web application.

The dashboard will now visualize the performance of every page for load tests that use Artillery’s Playwright integration. This will help you understand how user-perceived performance is affected by high load.

Core Web Vitals visualization

Fixes & Improvements

Dashboard

Ensure checks results at a glance

Artillery ensure checks Checks on dashboard

The main load test list now shows the results of ensure checks so that you can see at a glance which tests succeeded and which ones did not meet performance thresholds.

We recommend using ensure checks for all regular tests to help make sure that performance goals are met.

Simplified status filters

We have reduced the number of status filters down to just four: Succeeded, Failed, Cancelled, and In Progress. A test run that sets ensure checks is marked as Succeeded only if all checks are successful.

Filter by status

A fresh lick of paint

We have done a comprehensive overhaul across the whole interface of the application, updating component surfaces, font sizes, animations, and more, to make the UI feel more consistent, accessible, and easy on the eyes.

Settings management

Organization Details and System Theme

The Settings area has been updated to make navigation easier and now includes the ability to edit organization and personal details.

It’s now also possible to pick a “system theme” which makes our UI follow your operating system’s light/dark theme.

Fixes & improvements

Dashboard

Introducing Saved views

To make getting to the information you want faster, the dashboard supports Saved Views now. Any combination of tag filters, date filters, and test status filters can be named and saved as a view.

Creating a saved view

Team member and auth management

You can now manage current team members, and the GitHub allowlist that determines who may join your organization from the Settings area.

Live test updates

Overview pages are now live and can be used to follow the progress of an in-progress load test.

Denser and more scannable list view

We improved information density and scannability of the main load test list view. The default page size has also been increased from 10 to 50.

API key management

Create API keys to use with the Artillery CLI or to create custom integrations with Artillery Cloud.

Performance and reliability improvements

We spent a lot of time on refactoring and optimization. End result: a leaner, snappier and more responsive UI.

Fixes & Improvements

Dashboard

Load test insights in Artillery Dashboard

We have released a big update to the Artillery Dashboard with a focus on improving the Overview section and our charting engine to let you understand load test results faster.

Load Test Overview

Combined load summary chart

HTTP response code breakdown by URL

Metric explorer

Fixes, Tweaks and Polish

Dashboard

Artillery Dashboard v0.10.0 is out

Artillery Dashboard v0.10.0

New Overview section

The new Overview section provides at-a-glance view of what happened during a load test, including:

Load test overview

Notes

Capture the results of performance investigations and link to relevant external resources such as Datadog dashboards, Kibana logs, or JIRA tickets. With full Markdown support, and ability to post notes via the CLI.

Load test notes

Charting improvements

Light mode

And finally, if dark mode isn’t your thing, the dashboard has a light mode now. Toggle it on via Profile -> Light Mode.

Dashboard

Aurora Serverless support and bug fixes to our dashboard

Aurora serverless support

Aurora Serverless v1 Support

An Aurora Serverless database cluster may now be used as the backing store for Artillery Pro.

This requires Data API to be enabled on the cluster. Only Aurora Serverless v1 is supported right now.

Dashboard

Improved menus

Fixes & Improvements

Artillery Pro

Artillery Pro v3.0.0-10 has been released (full changelog)

New

Fixes & Improvements

Dashboard

Introducing authentication to our dashboard and beyond

Authentication on Artillery dashboard

Dashboard

A long requested feature of our dashboard has been the ability to login with GitHub. A layer of authentication removing the need for VPN’s on your end.

Revamped statuses

With the latest we’re shipping:

Artillery Probe

Kubectl

Dashboard

Docs, dashboard, CLI and more

docs and dashboard updates

Docs

Searching Artillery docs

Dashboard

Polish & fixes:

Artillery CLI

Artillery Operator

New kubectl plugin! Use kubectl artillery scaffold to scaffold tests for existing Kube services. Available from GitHub releases ›

Dashboard

Delete test results you don’t need

delete test results

Dashboard

Delete load test results

Sometimes you don’t need to keep a test result around - maybe the run did not complete and you don’t need the report, or perhaps you ran the test in the wrong environment and the results are meaningless. Whatever the reason, you can now delete test results you don’t need.

Deleting a load test run in action

In case you missed it in the previous changelog, this can be done from the CLI too with the - Add delete-test-run command.

Artillery CLI

Artillery v2.0.0-13 has been released:

Dashboard

A whole lot of polish for the dashboard and a new version of Artillery Pro CLI

dashboard polish and new CLI version

Dashboard v0.5.0

(Artillery Pro Dashboard is in early beta with a small number of Artillery Pro customers. If you'd like to join the beta, please let us know via team@artillery.io)

Last week we made a few changes focused on improving querying & filtering, providing more context around test run data, and adding a bit of extra polish.

More powerful filtering

You can now search & filter by:

We also improved the tag filtering input and made tag filter query easier to read.

New filter display in action

Customize main load test view

You can now customize the columns shown in the main load test view to be able to find what you’re looking for faster.

Column toggling in action

More test metadata

We’ve exposed more metadata for test runs in the sidebar. You can now see more information for each test run now, such as:

Sidebar in action

Progress indicators

Sometimes filtering and searching can take a bit of time, especially for more complex queries. We’ve added loading indicators in a few places to make it clear that the UI is busy doing the thing you asked it to do.

Progress indicators in action

Fixes

Artillery Pro v3.0.0-6

Dashboard

Introducing our brand new changelog

new changelog

Welcome to our brand new changelog where we will keep you updated on new releases, features, fixes and improvements in our products.

Artillery Pro Dashboard

Searching & Filtering

You can now filter the list of load test results by multiple tags.

Dashboard tag filters in action

You can further refine a tag filter with test status. For example to show all test runs tagged with team:sre and service:checkout-service which did not complete successfully.

Chart navigation

You can now jump straight to a chart for a specific metric from the sidebar.

Chart navigation in action

Zooming and panning

We added support for zooming and panning to metric charts.

Chart zooming in action

Update notifications

When a new release of the dashboard is available, the app will show a notification in the top-right corner, along with a link to the changelog and upgrade instructions.

Notification tab in action

Kubernetes Support

We have released an early preview of the Artillery Operator for Kubernetes. The goal of the project is to make Kubernetes-specific workflows easier with Artillery. We’d love to hear your feedback, comments, and suggestions.

Read the announcement ›