When using Jest as the runner framework for AskUI, it's often desired to have a report that summarises the run result neatly. Although Jest comes with a default reporter, which prints out the report in the console directly, one could wish to have a discrete report, e.g as an XML or HTML, that can be stored and shared among team members.
Jest (should be set up after following the above tutorial)
For the demonstration, we will use the website Authentication Test as an automation target.
1. Prepare the AskUI Suite within Jest
Let's say that, we want to use the AskUI Library to automate the login procedure in the example website.
Go to the example website in your web browser, and run the code provided below to automate the login:
-- CODE language-ts line-numbers --
describe('Login',()=>{
xit('annotates', async ()=>{
await aui.annotateInteractively();
});
describe('Simple Form',()=>{
it('should click the button',async ()=>{
await aui.moveMouseTo().button().contains().text().withText('Simple Form Auth').exec();
await aui.mouseLeftClick().exec(); // This first click is to get the focus on the test app
await aui.mouseLeftClick().exec(); // Thereafter, we click the button
});
it('should type in the email address',async ()=>{
await aui.typeIn('simpleForm@authenticationtest.com').textfield().contains().text().withText('E-mail Address').exec();
});
it('should type in the password',async ()=>{
await aui.typeIn('pa$$wOrd').textfield().contains().text().withText('Password').exec();
});
it('should click the login button',async ()=>{
await aui.click().button().contains().text().withText('Log In').exec();
});
});
});
If askui has run successfully, then you will see the default report printed on your console:
Now let's try to use reporters other than the default one.
2.1. Using jest-junit with AskUI
jest-junit is an npm library that creates an XML report file per test run in the format of the JUnit XML that can be understood by other development automation tools such as the Jenkins JUnit plugin. As JUnit is one of those unit test frameworks which were initially used by many Java applications as a unit test framework, jest-junit reporter facilitates a smooth integration of your test suite.
Run this command to install the reporter within your project root directory:
-- CODE language-bash line-numbers --
npm i jest-junit
Then, go to askui_example/jest.config.ts and change it as below:
-- CODE language-ts line-numbers --
npx jest test/my-first-askui-test-suite.test.ts --config ./test/jest.config.ts
By default, jest-junit will save the .xml report in your project root directory, with the file name junit.xml:
-- CODE language-xml line-numbers --
<?xml version="1.0" encoding="UTF-8"?>
<testsuites name="jest tests" tests="5" failures="0" errors="0" time="28.265">
<testsuite name="Login" errors="0" failures="0" skipped="1" timestamp="2023-01-15T17:33:04" time="28.24" tests="5">
<testcase classname="Login annotates" name="Login annotates" time="0">
<skipped/>
</testcase>
<testcase classname="Login Simple Form should click the button" name="Login Simple Form should click the button" time="7.597">
</testcase>
<testcase classname="Login Simple Form should type in the email address" name="Login Simple Form should type in the email address" time="5.468">
</testcase>
<testcase classname="Login Simple Form should type in the password" name="Login Simple Form should type in the password" time="5.356">
</testcase>
<testcase classname="Login Simple Form should click the login button" name="Login Simple Form should click the login button" time="4.937">
</testcase>
</testsuite>
</testsuites>
The jest-junit can be configured to format the resulting .xml. Try to change the askui_example/jest.config.ts, and run the code again:
To see more options for the configuration, please refer to the official README of jest-junit.
2.2. Using jest-html-reporter with AskUI
If you want to have a more friendly and readable report than XML, you can give jest-html-reporter a try. This reporter generates a HTML file that, if opened in a web browser, visualizes the run result in a much more human-friendly way.
Run the command below to install jest-html-reporter:
-- CODE language-bash line-numbers --
npm i jest-html-reporter
Then, go to askui_example/jest.config.ts and change it as below:
Again, refer to the official README to see more options for the configuration.
Then let's try to run the AskUI workflow again, but to test the new reporter, let's make a something fail.
Insert this line within any workflow in the test code:
-- CODE language-ts line-numbers --
//... some code
throw new Error("I'm an error!");
//... some more code
After running the workflow again, you will have an HTML file reports/test-report.html in your project directory. Open the HTML file in your web browser:
2.3. Using jest-html-reporters with AskUI
jest-html-reporters is another reporter that generates an HTML that summarizes the run results within Jest. It might be similar to the above-mentioned reporter. But this one, jest-html-reporters, has a feature that can attach an image to the report! Thus it can assist your debugging process, especially for UI automations.
Run the command below to install the jest-html-reporters:
-- CODE language-bash line-numbers --
npm i jest-html-reporters
Now let's configure the reporter in jest.config.ts:
publicPath: The basepath for the saved report file as a string.
filename: The file name for the saved report file as a string.
openReport: If true, it will open the generated HTML report after the test run is finished.
expand: If true, it will expand all the dropdown list in the table contained in the report.
pageTitle: The header title for the HTML report.
The options used in the above configuration are those I found useful most of the time. But since there are more options available, check out the official doc if you feel keen to use it.
The feature of the jest-html-reporters that could be nicely combined with AskUI is the feature to attach images to the report, since AskUI, as a UI automation tool, functions on top of the screenshot of the given display.
To use this feature, we import two helper functions from the reporter's package:
-- CODE language-ts line-numbers --
import { aui } from './helper/jest.setup';
import { addAttach, addMsg } from 'jest-html-reporters/helper';
describe('Login',()=>{
describe('Simple Form',()=>{
it('should click the button',async ()=>{
// First, get all the information from the annotation
// This will also save an interactive HTML file to the 'report/' folder
const annotation = await aui.annotate();
// The screenshot is contained as a string in 'base64' format
// Create a buffer with the base64 image
let buf = Buffer.from(annotation.image.split('base64,')[1], 'base64');
// Attach the image to the test report.
await addAttach({
attach: buf,
description: '',
});
// We filter only the text elements, and add it to the reporter
const textonly = annotation.detected_elements.filter((e) => e.name=="text");
// Attach the detected text elements to the reporter
await addMsg({
message: JSON.stringify(textonly, undefined, '\t'),
context:''
});
await aui.moveMouseTo().button().contains().text().withText('Simple Form Auth').exec();
await aui.mouseLeftClick().exec(); // This first click is to get the focus on the test app
await aui.mouseLeftClick().exec(); // Thereafter, we click the button
});
});
});
After running the code, your web browser will open and show the generated report. Click on the Info button on the right end of the table:
It will show the attached image beside the text elements we've added:
3. Conclusion
Although we covered only two ready-made Jest reporters in this article, reporters in Jest are fully configurable and customizable. To properly configure your pipeline, you maybe could wish to have a custom reporter that fits nicely into your pipeline. As AskUI provides a well-suited TypeScript Library, combining it with Jest and proper reporters can become a huge benefit to scaffolding a robust automation.
If you got any issues while following this tutorial, don't hesitate to ask our Community!
