@quasar/quasar-app-extension-testing-e2e-cypress
v6.1.0
Published
A Quasar App Extension for Cypress e2e
Downloads
29,233
Keywords
Readme
Cypress
You’re looking at Cypress AE v5 (Cypress 12 & 13) docs. If you're searching for Cypress AE v4 (Cypress 9) docs, head here
$ yarn quasar ext add @quasar/testing-e2e-cypress
Add into your .eslintrc.js
the following code:
{
// ...
overrides: [
{
files: ['test/cypress/**/*.{js,jsx,ts,tsx}', '**/*.cy.{js,jsx,ts,tsx}'],
extends: [
// Add Cypress-specific lint rules, globals and Cypress plugin
// See https://github.com/cypress-io/eslint-plugin-cypress#rules
'plugin:cypress/recommended',
],
},
],
}
This App Extension (AE) manages Quasar and Cypress integration for you, both for JavaScript and TypeScript.
Some custom commands are included out-of-the-box:
| Name | Usage | Description |
| ------------------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| dataCy
| cy.dataCy('my-data-id')
| Implement the selection best practice which avoids brittle tests, is equivalent to cy.get('[data-cy=my-data-id]')
|
| selectDate
| cy.get('.q-date').selectDate('2023/02/23')
| Select a given date into a QDate component, it accept either a Date
object or a string which new Date(myDate)
can parse correctly |
| testRoute
| cy.testRoute('home')
cy.testRoute('books/*/pages/*')
| Test if the current URL matches the provided string using minimatch
. Leading #
, if using router hash mode, and /
are automatically prepended. |
| within[Portal\|Menu\|SelectMenu\|Dialog]
| cy.withinSelectMenu(() => cy.get('.q-item').first().click())
cy.withinDialog({ dataCy: 'add-action-dialog', fn() { /* business haha */ } });
| Auto-scope commands into the callback within the Portal-based component and perform assertions common to all of them. |
| should('have.[color\|backgroundColor]')
| cy.get('foo').should('have.color', 'white')
cy.get('foo').should('have.backgroundColor', '#000')
cy.get('foo').should('have.color', 'var(--q-primary)')
| Provide a couple color-related custom matchers, which accept any valid CSS color format. |
Check out how to use these commands, and other recipes about testing Quasar UI components, into our automated tests suite.
You must have a running dev server in order to run integration tests. The scripts added by this AE automatically take care of this: yarn test:e2e
and yarn test:e2e:ci
will launch quasar dev
when starting up the tests and kill it when cypress process ends.
This AE is a wrapper around Cypress, you won't be able to use this or understand most of the documentation if you haven't read the official documentation.
Cypress Component Testing is supported and the AE scaffolds the code to run both "e2e" and "component" tests with Cypress.
As for "e2e" tests, you'll need to first take a look to their official documentation, or you won't understand many of the concepts described into this documentation.
Consequentially, we may rename this package from @quasar/quasar-app-extension-testing-e2e-cypress
to @quasar/quasar-app-extension-testing-cypress
in a future release.
Code coverage
We support scaffolding code coverage configuration for Cypress tests, when using Vite-based Quasar CLI.
To generate reports, run test:e2e:ci
and/or test:component:ci
scripts.
Running them both sequentially within the same command (eg. yarn test:e2e:ci && yarn test:component:ci
) will result in combined coverage report.
You'll find the generated report into coverage/lcov-report
folder.
We provide a preset configuration for the coverage report which:
- enables
all
option to include some files which are ignored by default:- dynamically imported components, such as layout and pages imported by vue-router;
- files not touched by any test.
- excludes test folders (
__tests__
) and TS declaration files (*.d.ts), which should already be excluded by default but apparently aren't; - only includes actual code files, leaving out code-like static assets (e.g. SVGs).
Check out nyc official documentation if you want to customize report generation.
You can either add options into .nycrc
file or generate reports on the fly running nyc report <options>
.
If you want to override the options that are defined by our preset configuration(or any preset), you should be aware of this nyc issue.
You can either apply this workaround or embed our preset configuration into your .nycrc
file directly, instead of extends
.
Note that we do not setup Istanbul TS configuration and its dependencies as Cypress claims it's able to manage TS code coverage out-of-the-box. Some TS files may be excluded by the report in scenarios, eg. if they aren't actually imported (dead code), if they're tree-shaked away by a bundler or if they only contain types/interfaces, and as such have no actual JS representation. Please open an issue if you notice some files are missing from generated reports in this scenario.
Upgrade from Cypress AE v5.1 to v5.2 onwards
If you're coming from v4, follow the migration guide in the next section first.
Here's all the steps you need to take while upgrading from v5.1 to v5.2:
- Upgrade
@quasar/app-webpack
/@quasar/app-vite
to its latest version: v5.2 leverage some features which are only available on@quasar/[email protected]
/@quasar/[email protected]
onwards. Notice that this means that the old@quasar/app
package (old name of@quasar/app-webpack
) isn't supported anymore. - Update
test:e2e
andtest:e2e:ci
scripts to use port "8080" OR runquasar ext invoke @quasar/testing-e2e-cypress
and specify your custom port. The AE now enforces the usage of "8080" port by default on the dev server for both@quasar/app-webpack
and@quasar/app-vite
, and for all build modes. It previously varied for each combination and Vite-based projects used "9000" port by default. - (JS projects only) Rename
cypress.config.js
tocypress.config.cjs
. This will avoid problems with future major versions of@quasar/app-webpack
/@quasar/app-vite
, in case at some point you decide to switch your project to "ESM by default" using"type": "module"
option inpackage.json
. - (TS projects only) Upgrade TypeScript to v4 or newer
- (optional) Upgrade Cypress to v13 and check out its migration guide
- (optional) Upgrade Node to v18 or newer
- (mandatory only when using Node 17, 18 or 19) replace "localhost" domain with "127.0.0.1" in
test:e2e
andtest:e2e:ci
scripts, since on Node 17-18-19 "localhost" will be resolved to "::1" on Windows and Mac, and this will make those scripts fail silently and hang indefinitely. Node 20 LTS correctly supports Happy Eyeball protocol and thus this fix shouldn't be needed
Upgrade from Cypress AE v4
if you're coming from v3, follow the migration guide for v4 and v4.1 first
All changes are related to Cypress v10-v11-v12 breaking changes, Quasar first-party helpers haven't been changed unless Cypress required it.
Alternatively to the following guide, a faster but more error-prone way for advanced developers would be to run yarn quasar ext add @quasar/testing-e2e-cypress
and yarn add -D cypress
, then let the package scaffold new files overriding the existing ones and manually merge your changes into the generated files. Even in this case, we suggest to take a look to the following migration guide and use it as a checklist, as some files must be renamed/removed.
Here's all the steps you need to take while upgrading from v4 to v5:
- upgrade to v5, then install
cypress
dependency, which has been externalized and marked as a peerDependency
yarn upgrade @quasar/quasar-app-extension-testing-e2e-cypress
yarn add -D cypress
- if your project is Webpack-based install Typescript as dev dependency, as Cypress won't correctly detect your project as a TS one unless the dependency is present in your
package.json
. You can remove the dependency at the end of this migration guide, as@quasar/app-webpack
already provides it for you.
yarn add -D typescript
- run
yarn cypress open
and follow the guided procedure - select "component testing" option and accept all proposed steps. When prompted for it, if auto-detection doesn't kick in, select
vue
framework andwebpack
/vite
bundler accordingly to what you're using. Note that, after the migration wizard completes, Cypress is expected to display an error due to it's inability to run Quasar devServer out-of-the-box - if a duplicated
component
property is generated intocypress.config.[cjs|ts]
, remove the one containingdevServer
property. - remove from
test/cypress/plugins/index.[js|ts]
the code used to inject the component dev server, and add it intocypress.config.[cjs|ts]
as
import { injectQuasarDevServerConfig } from '@quasar/quasar-app-extension-testing-e2e-cypress/cct-dev-server';
export default defineConfig({
// ...
component: {
devServer: injectQuasarDevServerConfig(),
},
});
- create a
test/cypress/support/component-index.html
file with this content - set
test/cypress/support/component-index.html
property intocypress.config.[cjs|ts]
totest/cypress/support/component-index.html
- into
test/cypress/support/component.[js|ts]
replaceimport { config } from '@vue/test-utils';
with
// Since Cypress v10 we cannot import `config` directly from VTU as Cypress bundles its own version of it
// See https://github.com/cypress-io/cypress/issues/22611
import { VueTestUtils } from 'cypress/vue';
const { config } = VueTestUtils;
- replace all
mount
occurrences to use the newcy.mount()
helper instead - set
component.specPattern
property tosrc/**/*.cy.{js,jsx,ts,tsx}
and update all your component tests names to match that pattern, replacing.spec.[js|ts]
with.cy.[js|ts]
- rename
test/cypress/integration
folder totest/cypress/e2e
and updatee2e.specPattern
accordingly - rename
test/cypress/support/index.[js|ts]
totest/cypress/support/e2e.[js|ts]
and updatee2e.supportFile
property accordingly - update your
test:e2e
andtest:e2e:ci
scripts to use--e2e
flag (open --e2e
andrun --e2e
respectively) - update your
test:component
andtest:component:ci
scripts to use--component
flag instead ofopen-ct
/run-ct
commands (open --component
andrun --component
respectively) - remove Cypress JSON schema registration from vscode settings, Cypress switched to a JS/TS config file and is now using an helper function to provide autocomplete.
- update eslint override pattern which applies to cypress files as explained into this AE installation instructions
- (optional) move any other custom configuration from
test/cypress/plugins/index.[js|ts]
tosetupNodeEvents
hooks intocypress.config.[cjs|ts]
. Note that if you're using Vite and you added code coverage, you'll need to setup code coverage plugin both into e2e and componentsetupNodeEvents
hooks cy.saveLocalStorage
andcy.restoreLocalStorage
has been removed, since Cypress 12 now provides a more stable and complete solution to persist cookies, session storage and local storage across tests.- check out Cypress 10 changelog, Cypress 11 changelog and Cypress 12 changelog, and see if something else in there affect you. We are sorry for continuously bumping Cypress peer dependency during the beta, but Cypress team released 3 major versions in a 6 months time span and we cannot afford to maintain too many major versions of this AE.
Caveats
Automatic override of Cypress commands
Many Cypress commands rely on the presence of a native DOM inputs, but many Quasar input components won't usually render them for better performance, or will use them under the hood, but hide them to the user.
This resulted in a bad DX for some Cypress commands/assertions when used on some Quasar input components, so we patched those Cypress commands/assertions on our side. Here's the list of patched methods and some limitations due to the override:
.select()
- it won't yeld anything;
- when dealing with a multiple QSelect, it will only select the provided options, it won't deselect the ones not specified;
- since option value isn't mirrored into the DOM when using QSelect, it's not possible to select options based on the option value;
- it will ignore the original command options (eg
force: true
).
.check
/.uncheck
- it won't yeld anything;
- it won't accept parameters;
.should('be.checked')
/.should('not.be.checked')
- no limitations.
Feel free to open a PR if you want to help removing these limitations.
QSelect and data-cy
QSelect automatically apply unknown props to an inner element of the component, including data-cy
.
This means that you need to use cy.dataCy('select').closest('.q-select')
to get the actual root element of the component.
While this isn't important when clicking the select to open its options menu, it is if you're checking any of its attributes (eg. aria-disabled
to see if it's enabled or not)
You can define an helper to access a QSelect element, here's an example:
function dataCySelect(dataCyId: string) {
return cy.dataCy(dataCyId).closest('.q-select');
}
Additionally, when using use-input
prop, the data-cy
is mirrored on the inner native select
too.
This can generate confusion as cy.dataCy('select')
in those cases will return a collection and you'll need to use .first()
or .last()
to get respectively the component wrapper or the native input.
Component Testing Caveats
This AE aims to be as lightweight as possible to reduce maintenance burden. That's why we currently don't provide our own helpers to manage VueRouter, Vuex and Pinia.
The good news is that we don't actually need to, since official documentation for those libraries is already available:
Using boot files
When testing components, your Quasar boot files aren't loaded. If you need some features defined in your boot files, you can manually add them in your support file.
For instance, to make an axios API client globally available, simply set it in the VueTestUtils
config.global.mocks
object (like you would do on app.config.globalProperties
in your boot file):
import { VueTestUtils } from 'cypress/vue';
import axios from 'axios';
const api = axios.create({ baseURL: 'https://api.example.com' });
VueTestUtils.config.global.mocks.$api = api;
Using vModel into your tests
Vue Test Utils doesn't provide an helper to test your components vModel, so we created our own, which even allow you use refs into your tests, based on this discussion.
const model = ref(null);
mount(QSelect, {
props: {
...vModelAdapter(model),
// or, if you're using a custom name for your vModel, use
// ...vModelAdapter(model, 'myModelName'),
options,
},
});
Check out more examples here.
Testing the AE
cd test-project-webpack # or "cd test-project-vite" or "cd test-project-app"
yarn sync:cypress # or "yarn sync:all", if it's the first time you run this command
yarn test:e2e:ci # check if e2e tests still work with the local version of the AE
yarn test:component:ci # check if component tests still work with the local version of the AE