Artillery

Improved page performance visualizations

See how Core Web Vitals change under load

You can now see Core Web Vitals measurements for an entire test run, and understand how user experience is affected by high load.

Switch between p99, p95 and median

We have added the ability to switch between p99, p95 and median aggregations for visualizing Core Web Vitals metrics.

Other improvements

• Improved layout and spacing for tooltips and charts
• Improved handling of overlapping text.
• Improved readability with tweaks to x axis labels and URL formatting
• Improved toggle interactions and animations

New quickstart wizard

We have added a new quickstart wizard which lets you go from first sign-in to running a load test in 3 steps.

Other fixes & improvements

• Display the user who triggered a test in the metadata sidebar
• Add option to display the user who triggered the test in the test list view
• Fix issue where dialogs could close themselves accidentally
• Fix incorrect default labels on some charts
• Improve default error pages
• Fix regression on response time widget displaying an unnecessary count metric

Frontend performance metrics

Core Web Vitals is a set of key frontend performance metrics that measure user-perceived performance of a web application.

The dashboard will now visualize the performance of every page for load tests that use Artillery's Playwright integration. This will help you understand how user-perceived performance is affected by high load.

Fixes & Improvements

• Add syntaxt highlighting on JSON report views
• Tail text logs for in-progress load tests
• Replace popover with inline editing for notes
• Notes can now be posted with Ctrl + Enter

Apdex scores

The load test summary view will now calculate and display Apdex scores for load tests that make use the built-in apdex plugin.

Apdex (Application Performance Index) is an open standard for measuring performance of HTTP services. The Apdex score converts response times into a single score that reflects user satisfaction with the service.

Fixes & Improvements

App-wide

• Update colors to improve legibility and consistency
• Add exit animations for all dropdown-like elements
• Improve loading states on all buttons
• Improve consistency of dialogs everywhere
• Improve consistency of spacing between elements across the app

Main view

• Tweak the display of Artillery’s logo in the navbar
• Fix responsiveness on Load Tests view
• Improve UX for Saved Views and the Filter Bar with long input strings
• Match test run ID icon in filter dropdown to one used elsewhere

Load test view

• Make font sizes consistent in metadata panel
• Improve styling of text log view, JSON log view, and table components
• Fix issue with loading default CLI avatar images on notes
• Fix issue with scroll gradient covering first note in the notes list
• Improve spacing on Edit Note dialog

Charts

• Add intelligent X axis scaling depending on duration of the test
• Improve Y axis layout on Load Summary chart

AWS Fargate support

This release adds support for running tests on AWS Fargate. Scale out your load tests horizontally from any of the six supported regions.

artillery run-fargate --count 10 --region us-east-1 my-script.yml

Supported regions:

• us-east-1
• us-west-1
• eu-west-1
• eu-central-1
• ap-south-1
• ap-northeast-1

AWS Fargate is a serverless solution that requires no infrastructure to be managed, and unlike AWS Lambda does not impose a restriction on the duration of your load tests.

Artillery's Playwright integration is fully supported on Fargate, to let you run browser-based load tests at scale with ease.

Playwright support

Playwright support is now built into Artillery. The integration in artillery-engine-playwright is now bundled into the Artillery CLI.

• The version of Playwright used by the integration has been updated to v1.3.4
• Web Vitals tracking has been improved to provide more accurate measurements
• Playwright scenario file may now be loaded via testFunction attribute rather than flowFunction
• flow attribute may now be omitted in Playwright engine scenarios

Other fixes & improvements

• Pass lambdaRoleArn to AWS Lambda engine correctly
• Fix issue with returning matched groups from regexp capture
• Track & report downloaded data in HTTP tests via http.downloaded_bytes metric
• Environment variables may now be accessed through the special $env variable (the current way of accessing those via $processEnvironment is still supported but will be deprecated in future)
• Dependency updates to address deprecation and security notices