
We have released Artillery `v2.0.0-28`, which adds support for AWS CloudWatch, and features a number of performance and stability improvements.

(GitHub release page: https://github.com/artilleryio/artillery/releases/tag/artillery-2.0.0-28)

## Breaking changes

* AWS Lambda: the default IAM role and policy are now versioned. If you attached any custom permissions to the `artilleryio-default-lambda-role` role, you will need to re-attach it to the new `artilleryio-default-lambda-role-20230116` role
* CLI: The `probe` command has been removed from the CLI. The functionality has been moved to the new [Skytrace CLI](https://github.com/artilleryio/artillery/tree/main/packages/skytrace)

## New features

* Add support for publishing test metrics to AWS CloudWatch
* HTTP - compressed responses (e.g. `gzip`) will be decompressed by default now. (Set `gzip: false` to disable automatic decompression if required to improve performance.)
* CLI - suggest closest match if a command name is mistyped

### AWS Lambda

* Print custom role ARN if provided
* Add versioning to default Lambda role and policy created for running tests

## Fixes & improvements

* Fix arrival phases with `arrivalRate` and `rampTo` set to `0`
* Improve `rampTo` logic to result in more predictable and deterministic ramps
* Fix issue with `maxVusers` setting that would lead to unexpected number of VUs to be generated
* Fix wildcard message handling support in Socket.io
* Fix issue with setting some properties on the global `artillery` object

### AWS Lambda

* Improve test startup logic: workers will wait for each other to be ready before kicking off the test run
* Fix some intermediate metrics not being flushed & reported
* Fix handling of `memory-size` and `security-group-ids` options


We have released a big update to the Artillery Dashboard with a focus on improving the Overview section and our charting engine to let you understand load test results faster.

## Load Test Overview

- Show Peak RPS achieved during a load test run
- Display errors (if any) at the top of the screen
- New "Load Summary" chart to visualize request rate, response time, and VUs created across the test run

![Combined load summary chart](/images/changelog/2023-01-12/load-summary.png)

- Show a breakdown of HTTP codes by URL

![HTTP response code breakdown by URL](/images/changelog/2023-01-12/http-codes-by-url.png)

- New "Metric Explorer" widget to let you chart and compare any metric (including custom metrics) generated by the test run

![Metric explorer](/images/changelog/2023-01-12/metric-explorer.png)

## Fixes, Tweaks and Polish

- Layout: tweaks to spacing across the board to increase information density and make more room for what matters. Improved layout of the main test list view and individual test views.
- Charting: ability to combine multiple metrics on one chart
- Charting: show combined tooltips for each point along the time axis
- Fix for sidebar and main area overlapping at some screen sizes
- Fix issue with flash messages disappearing from view
- Improve tag list display in the main list view


## New Overview section

The new Overview section provides at-a-glance view of what happened during a load test, including:

- Status of [`ensure` checks](https://www.artillery.io/docs/guides/guides/test-script-reference#ensure---slo-checks).
- A summary view of all errors raised during the test (if any), such as request timeouts, dropped TCP connections etc.
- A summary view of HTTP codes, HTTP request rate, and response time distribution (`min`, `max`, `p999`, `p99`, and `p95`).

<div>
<div className="w-3/4 items-center">
  <img src="/images/changelog/2022-10-28/overview.png" className="mx-auto" alt="load test overview" />
</div>
</div>

## Notes

Capture the results of performance investigations and link to relevant external resources such as Datadog dashboards, Kibana logs, or JIRA tickets. With full Markdown support, and ability to [post notes via the CLI](https://www.artillery.io/docs/guides/guides/pro-cli#post-note-v3).

<div>
<div className="w-3/4 items-center">
  <img src="/images/changelog/2022-10-28/notes.png" className="mx-auto" alt="load test notes" />
</div>
</div>

## Charting improvements

* Color palette improvements to improve readability
* Fixed an issue with displaying charts for tests that generate a lot of data, such as 8-12 hour long soak tests
* Fixes to zooming and panning

## Light mode

And finally, if dark mode isn't your thing, the dashboard has a light mode now. Toggle it on via <kbd>Profile -> Light Mode</kbd>.



## Artillery CLI

### New HTML reports

 We have improved the layout and styling of reports generated with [`artillery report`](https://www.artillery.io/docs/guides/guides/command-line#report---create-an-html-report).

![Updated HTML Reports](/images/changelog/2022-07-01/updated-html-report.png)

### --dotenv flag

You can now load environment variables from a file with the `--dotenv` flag. Those env vars are available in Artillery scenarios through the [`$processEnvironment` variable](https://www.artillery.io/docs/guides/guides/test-script-reference#using-environment-varables).

## Dashboard

### Visual polish

- Improved homepage responsiveness
- Updated load test table with new context tags and new flexible tags
- Updated context menus
- Updated header styling in load test view.
- New and improved selected tags filter bar
- Show loading skeletons while data is being fetched

### CDK installer

We released an official [AWS CDK](https://aws.amazon.com/cdk/)-based installer for Artillery dashboard.

https://github.com/artilleryio/installer-aws-cdk

### Flexible deployment modes

The dashboard can now be deployed in more than one way to fit the exact requirements of your organization:

- As an internal-facing, inside a VPC. This is the default deployment mode, and it will require an existing VPN setup to access the app. TLS is optional with this setup.
- As a publig public-facing, which requires TLS with a pre-provisioned ACM certificate.
- Custom domain may be configured on top of the provisioned ALB DNS name.

### GitHub Authentication

We added support for authentication through GitHub.


## Aurora Serverless v1 Support

An Aurora Serverless database cluster may now be used as the backing store for Artillery Pro.

This requires Data API to be enabled on the cluster. Only Aurora Serverless v1 is supported right now.

## Dashboard

![Improved menus](/images/changelog/2022-06-02/menus.gif)

### Fixes & Improvements

- Improve loading states on the Settings screen
- Fix bug with context menu getting cut off
- Fix double-trigger on context menu buttons

## Artillery Pro

Artillery Pro v3.0.0-10 has been released ([full changelog](https://www.artillery.io/docs/resources/pro/changelog))

### New

- Add support for loading enviroment variables into workers from a .env file with `--dotenv` flag
- Include extra information in JSON reports: test metadata, test run ID, and ensure check results
- Include launch platform and subnet information in environment summary output
- Test runs are automatically tagged with `test_run_id tag`, which is set to the test run ID
- Print test run ID at the end of the test run

### Fixes & Improvements

- Exclude raw histogram data from JSON reports to reduce file size
- Fix an issue which could prevent ensure checks from running
- Fix an issue where only one `--secret` flag would be taken into account
- Show auto-guessed subnet IDs when subnets aren't set explicitly with `--subnet-ids` in `run-test`

Changelog

Stay up to date with the latest changes to our products