Installation and setup
In order to install Reassure run following command in your app folder:
- npm
- yarn
npm install --save-dev reassure
yarn add --dev reassure
You will also need a working Jest setup as well as one of either React Native Testing Library or React Testing Library.
You can check our example projects:
Reassure will try to detect which Testing Library you have installed. In case both React Native Testing Library and React Testing Library are present it will
warn you about that and give a precedence to React Native Testing Library. You can explicitly specify Testing Library to by used by using configure
option:
- React Native
- React.js
configure({ testingLibrary: 'react-native' });
configure({ testingLibrary: 'react' });
You should set it in your Jest setup file and you can override it in particular test files if needed.
Writing your first test
Now that the library is installed, you can write you first test scenario in a file with .perf-test.js
/.perf-test.tsx
extension:
// ComponentUnderTest.perf-test.tsx
import { measureRenders } from 'reassure';
test('Simple test', async () => {
await measureRenders(<ComponentUnderTest />);
});
This test will measure render times of ComponentUnderTest
during mounting and resulting sync effects.
Note: Reassure will automatically match test filenames using Jest's
--testMatch
option with value"<rootDir>/**/*.perf-test.[jt]s?(x)"
. However, if you would like to pass a custom--testMatch
option, you may add it to thereassure measure
script in order to pass your own glob. More about--testMatch
in Jest docs
Writing async tests
If your component contains any async logic or you want to test some interaction you should pass the scenario
option:
import { measureRenders } from 'reassure';
import { screen, fireEvent } from '@testing-library/react-native';
test('Test with scenario', async () => {
const scenario = async () => {
fireEvent.press(screen.getByText('Go'));
await screen.findByText('Done');
};
await measureRenders(<ComponentUnderTest />, { scenario });
});
The body of the scenario
function is using familiar React Native Testing Library methods.
In case of using a version of React Native Testing Library lower than v10.1.0, where screen
helper is not available, the scenario
function provides it as its first argument:
import { measureRenders } from 'reassure';
import { fireEvent } from '@testing-library/react-native';
test('Test with scenario', async () => {
const scenario = async (screen) => {
fireEvent.press(screen.getByText('Go'));
await screen.findByText('Done');
};
await measureRenders(<ComponentUnderTest />, { scenario });
});
If your test contains any async changes, you will need to make sure that the scenario waits for these changes to settle, e.g. using
findBy
queries, waitFor
or waitForElementToBeRemoved
functions from RNTL.
For more examples look into our example apps:
Measuring test performance
In order to measure your first test performance you need to run following command in terminal:
yarn reassure
This command will run your tests multiple times using Jest, gathering render statistics, and will write them to
.reassure/current.perf
file. In order to check your setup, check if the output file exists after running the
command for the first time.
Note: You can add
.reassure/
folder to your.gitignore
file to avoid accidentally committing your results.
Reassure CLI will automatically try to detect your source code branch name and commit hash when you are using Git. You can override these options, e.g. if you are using different version control system:
yarn reassure --branch [branch name] --commit-hash [commit hash]
CI setup
To make setting up Reassure more convenient we have prepared a CLI command which will generate all necessary templates for you to get started with.
Simply run:
yarn reassure init
This will generate the following file structure
├── <ROOT>
│ ├── reassure-tests.sh
│ ├── dangerfile.ts/js (or dangerfile.reassure.ts/js if dangerfile.ts/js already present)
│ └── .gitignore (append)
Options
You can also use the following options in order to further adjust the script
--verbose
(optional)
This is one of the options controlling the level of logs printed into the command prompt while running reassure scripts. It will
--silent
(optional)
Just like the previous, this option also controls the level of logs. It will suppress all logs besides explicit errors.
Scaffolding
CI Script (reassure-tests.sh
)
Basic script allowing you to run Reassure on CI. More on the importance and structure of this file in the next section.
Dangerfile
If your project already contains a dangerfile
, the CLI will not override it in any way. Instead, it will generate a dangerfile.reassure.ts
file which will allow you to compare and update your own at your own convenience.
.gitignore
If .gitignore
file is present and no mentions of reassure
appear within it, the script will append the .reassure/
directory to its end.
CI Script (reassure-tests.sh
)
In order to detect performance changes, you need to measure the performance of two versions of your code
current (your modified code), and baseline (your reference point, e.g. main
branch). In order to measure performance
on two different branches you need to either switch branches in git or clone two copies of your repository.
We want to automate this task, so it can run on the CI. In order to do that you will need to create a
performance testing script. You should save it in your repository, e.g. as reassure-tests.sh
.
A simple version of such script, using branch changing approach is as follows:
#!/usr/bin/env bash
set -e
BASELINE_BRANCH=${GITHUB_BASE_REF:="main"}
# Required for `git switch` on CI
git fetch origin
# Gather baseline perf measurements
git switch "$BASELINE_BRANCH"
yarn install
yarn reassure --baseline
# Gather current perf measurements & compare results
git switch --detach -
yarn install
yarn reassure
Integration
As a final setup step you need to configure your CI to run the performance testing script and output the result. For presenting output at the moment we integrate with Danger JS, which supports all major CI tools.
Updating existing dangerfile
You will need a working Danger JS setup.
Then add Reassure Danger JS plugin to your dangerfile :
// /<project_root>/dangerfile.reassure.ts (generated by the init script)
import path from 'path';
import { dangerReassure } from 'reassure';
dangerReassure({
inputFilePath: path.join(__dirname, '.reassure/output.md'),
});
Creating Dangerfile
If you do not have a Dangerfile (dangerfile.js
or dangerfile.ts
) yet, you can use the one generated by the reassure init
script without making any additional changes.
You can also find it in our example file Dangerfile.
Updating the CI configuration file
Finally run both performance testing script & danger in your CI config:
- name: Run performance testing script
run: ./reassure-tests.sh
- name: Run Danger.js
run: yarn danger ci
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
You can also check our example GitHub workflow.
The above example is based on GitHub Actions, but it should be similar to other CI config files and should only serve as a reference in such cases.
Note: Your performance test will run much longer than regular integration tests. It's because we run each test scenario multiple times (by default 10), and we repeat that for two branches of your code. Hence, each test will run 20 times by default. That's unless you increase that number even higher.
Optional: ESLint setup
ESLint might require you to have at least one expect
statement in each of your tests. In order to avoid this requirement
for performance tests you can add following override to your .eslintrc
file:
rules: {
'jest/expect-expect': [
'error',
{ assertFunctionNames: ['expect', 'measureRenders'] },
],
}