Skip to main content
9 October 2023

2 different ways to use Baseline in your visual regression testing process

While you can directly compare two websites with VRT there is a notion of a Baseline set that you always compare against. But why would you need one?

We see two main use cases:

  1. monitoring
  2. save time in pull request testing

 

Monitoring

Let's say you set up daily monitoring. This is when you compare your screenshots always with "yesterday's" version.

Imagine there was a bug introduced on a certain day. This means that only the next day's monitoring run will trigger the error. All subsequent ones won't.

Because of the nature of VRT you do get a tendency to get false positives here and there. So you can easily accidentally skip that day with an actual error and see that tests got green back again the next day.

baseline daily monitoring use case

This is where the Baseline would help.

Instead of comparing with yesterday's version, you could compare against the Baseline. So instead of just next-day error you would see all subsequent tests turn red and it will force you to check them out and approve the change (set a new baseline) or fix the bug.

 

Pull requests testing

Once you set up testing pull requests you would like to compare their screenshots with some particular environment (for example staging).

You create screenshots from staging every time you do screenshots from your pull request environment, but instead, you could reuse screenshots from the staging environment multiple times.

You can take them only when you actually deploy changes to the staging environment and assign them as your baseline. In your pull request pipeline you will be comparing your pull request screenshots with baseline instead.

 

How to set baseline screenshots in Diffy

You can set either whole set of screenshots or individual screenshots using drop down menu.

How to set baseline in Diffy

 

 

Everything You Need To Know About Performance Testing and Its Types

The software testing process does not end with the segregation of functional and non-functional types. Therefore, to develop a thorough understanding of the SDLC, you need to dig deeper. One of the non-functional testing types is performance testing and this type is further segregated into 4 types.

4 min read

A Brief Guide to Functional Testing, Types & Examples

Apart from being an integral part of the SDLC, functional testing is defined as testing a software system's ability to meet the functional requirements of an end-to-end solution. New to the world of functional testing? You have come to the right place!

7 min read

The Complete Compatibility Testing Guide | Tools, Types & Examples

As technology advances faster than ever, software development needs aren't focused on a single platform anymore. Today, each software is developed with the aim to run cross-platform. This is where the need for compatibility testing comes into play.

For the vast majority of software types, you have to test your website’s/application’s compatibility to run on a wide range of devices. How do you do that? How can you make sure that your users can move seamlessly across devices without their experience being hampered in any way?

5 min read

Diffy helps your QA team

to ensure that websites don't get visual bugs