Diffy vs BlogVault: Visual Regression Testing Compared
BlogVault is best known as a WordPress backup service, and backups are still the core of it: its site describes the product as “backup, staging and migration for WordPress sites”. Its dashboard also works as a site-management platform, with plugin and theme updates, uptime monitoring and visual checks. Diffy does one job: visual regression testing for websites. Agencies that maintain WordPress sites see “visual regression” on both feature lists and reasonably ask whether they need two tools. The honest answer is that the two products overlap on one step of the update routine, and on very little else.
What each tool is
BlogVault is a WordPress backup and management platform. You install the BlogVault plugin on a WordPress site and it backs the site up to BlogVault’s own storage, with nine encrypted copies across two providers included in the price. On top of that it hosts staging sites, migrates sites between hosts, runs plugin, theme and core updates from its dashboard, and monitors uptime. Visual testing comes in two forms, both described in BlogVault’s help documentation:
- A visual regression test during updates. When you update plugins, themes or WordPress core from the BlogVault dashboard, you choose between a Quick, Safe or Sandbox update. BlogVault’s update guide describes the sandbox flow like this: it creates a staging copy of the live site, installs the update, runs a visual regression test and gives you a report; if the site looks right, one click replicates the update on the live site. Auto-update schedules (daily, weekly or monthly) have a “Visual regression Test” toggle next to “Take Backup Before Update”, and you get an email with the results after every run.
- Visual Monitors. Under Advanced Monitoring, each Visual Monitor watches one page URL. You pick a device profile (desktop, iPad or mobile), a check interval and a threshold. BlogVault takes a reference screenshot when you create the monitor, compares each new screenshot with it, and alerts you when the difference goes over the threshold. If a change was intended, you update the reference.
Diffy is a visual regression testing tool for any website. You create a project in a browser tab, give it a list of pages (from your sitemap, by crawling internal links, or from a text file), choose breakpoints, and run a comparison. There is nothing to install on the site. Diffy loads your pages in a real browser the way a visitor would, so it works the same on WordPress, Drupal, a headless front end or a static site. It does not take backups, host staging sites or monitor uptime.
So the first question is not which tool is better at visual testing. It is whether you are looking for a backup platform that also does visual checks, or a visual testing tool. If backups are what you need and a check after each update is a bonus, BlogVault may be all you need. If visual testing is the job, read on.
Pricing
The two products charge for different things, so the tables do not line up neatly.
BlogVault
BlogVault charges per site, per year, billed annually.
| Plan | Per site / year | List price | 5-site bundle | Backup frequency | Backup history | Staging site lasts |
|---|---|---|---|---|---|---|
| Personal | $49.50 | $99 | $149.50 | Every 24 hours | 30 days | 1 day |
| Business | $149.50 | $299 | $449.50 | Every 12 hours | 90 days | 30 days |
| WooCommerce | $249.50 | $499 | $749.50 | Hourly | 365 days | 6 months |
The prices are shown with a 50% discount that BlogVault’s pricing page labels as current. Agency pricing for more than five sites is quoted by sales, and every plan has a 14-day money-back guarantee.
Neither the plan cards nor the plan comparison table on BlogVault’s pricing page mention visual regression testing or visual monitoring. BlogVault’s API documentation says the update check needs “the matching account plan feature” and that Visual Monitors need visual monitoring plan access. In other words, which plan unlocks visual checks is not public. If they are the reason you are choosing BlogVault, confirm with their sales team before you buy.
Diffy
Diffy charges per screenshot, per month, across all your sites.
| Screenshots per month | Billed annually | Month-to-month |
|---|---|---|
| 500 (Free) | $0 | $0 |
| 2,000 | $67/mo | $80/mo |
| 8,000 | $125/mo | $150/mo |
| 30,000 | $250/mo | $300/mo |
One page at one breakpoint is one screenshot. An agency with 20 client sites, checking 10 key pages per site at three breakpoints before and after the monthly updates, uses about 1,200 screenshots a month. That fits the 2,000 plan, $67/mo billed annually, for all 20 sites. Diffy does not bill overage: if your usage outgrows your plan, we get in touch and ask you to move up a tier.
The free plan includes 500 screenshots a month, production and staging environments, and one month of history. Paid plans add custom environments, CI automation and six months of history.
BlogVault prices as published on blogvault.net/pricing in October 2026. Check both pricing pages before you commit, because everyone changes prices eventually.Before and after, or one environment against another
BlogVault’s two visual checks both compare a page with an earlier version of itself. The update check compares the site before and after an update on BlogVault’s sandbox copy. A Visual Monitor compares a page with the reference screenshot it stored. Neither is documented as comparing two environments that you host, such as your host’s staging copy against production.
Diffy does the before-and-after comparison and the monitoring, and it is organised around environments. Production and staging are built in, and on paid plans you can add custom environments. Diffy swaps the domain in every URL, so one page list covers all of them:
- Does staging still match production before we push the release?
- Did the plugin, theme or core update we just ran on staging move anything on any template?
- Does this Pantheon or Tugboat multidev match production?
- Did anything on production change overnight without a deploy? Scheduled runs compare an environment with its previous run or with a fixed baseline, on the days and at the time you choose.
The scope is different too. Each BlogVault Visual Monitor watches one URL, and BlogVault’s documentation doesn’t say which pages, or how many, the update check captures. A Diffy comparison covers every page in the project at every breakpoint, which matters because update regressions tend to appear on some templates and not others. A header that only wraps on pages without a hero image will not show up on the homepage. Our list of what breaks during WordPress and Drupal updates explains why.
Handling real-world pages
Most of the work in visual testing is not taking screenshots. It is stopping them from flagging changes that aren’t real: a cookie banner, a slider, a “latest posts” block, an embedded video. BlogVault’s API lists four settings for a Visual Monitor: the page URL, the device, the check interval and the threshold. For false alarms, BlogVault’s help docs suggest adjusting the threshold to reduce sensitivity, then contacting support if they continue. A threshold decides how much change is too much, but it can’t tell a rotating banner from a broken layout of the same size.
In Diffy, each source of noise has its own setting in the UI:
- Log in before the screenshot. Presets for WordPress, Drupal and Netlify, plus a custom option, so WooCommerce account pages and members-only areas can be tested.
- Mock dynamic content. Give Diffy a list of selectors and it replaces their contents with placeholder text, so a new blog post doesn’t show up as a change on every page.
- Remove or mask elements. Removal drops the element from the page; masking paints a visible rectangle over it so reviewers can see what was hidden. Embedded videos and maps are masked by default.
- Inject custom CSS or JavaScript to freeze sliders and animations, and set HTTP headers, cookies (for example, to dismiss a consent banner) and a custom User-Agent.
- Any breakpoint between 240px and 2000px, as many as you like, in Chrome or WebKit, the engine behind Safari. BlogVault’s monitors offer three device profiles: desktop, iPad and mobile.
- Allowlist a single IP address for sites behind Wordfence, Cloudflare or a host firewall.
When a false positive does get through, mark it in Diffy and our support team fixes it by adding custom CSS or JavaScript to your project settings. Our guide to avoiding false positives covers the common cases.
Comparison that understands vertical shifts
Pixel-by-pixel diffing has a well-known weakness on full pages: change the height of something near the top and every pixel below it moves, so the whole page lights up. BlogVault’s documentation says its system measures the percentage of change against your threshold; it doesn’t describe how content that has only shifted down the page is treated.
Diffy runs a custom algorithm that recognises vertical shifts. Add a line to your header and Diffy highlights the header, not the 4,000 pixels that merely moved down. You can switch to strict pixel-perfect comparison whenever you want it.
A review UI built for many pages
BlogVault reports update results in the task summary and, for scheduled updates, in an email after each run. Diffy’s review screen is built for going through hundreds of screenshots at once:
- Thumbnail view, with approval directly from the thumbnails
- An AI summary that groups changes by impact, so “the footer changed on all 48 pages” is one item rather than 48
- Approve an individual change, a screenshot, or a page across all breakpoints
- A before/after slider and keyboard shortcuts
- The HTML source and JavaScript console of each screenshot, for debugging
- Shareable links that work for clients and developers without a Diffy account
Integrations
- CLI for CI/CD pipelines, with worked examples for Pantheon, Tugboat and others
- GitHub and GitLab integrations that report results on pull and merge requests
- Notifications by email, Slack or webhook, with a threshold so small changes don’t wake anyone up
- Zapier, so a diff can open a ticket in Jira, Trello or Basecamp
- DDEV and Lando add-ons for comparing a local site with production
- A Claude plugin, so you can run comparisons from a conversation (see below)
BlogVault has its own public API and can send uptime alerts to a Slack channel.
Driving Diffy from Claude
Diffy publishes a Claude plugin that lets you run visual testing from a conversation instead of a dashboard. It installs from the plugin marketplace in two lines:
/plugin marketplace add diffywebsite/diffy-skills
/plugin install diffy@diffyYou can then ask Claude to create a project from a description of the site, compare staging against production, and tell you which pages changed. The plugin is MIT licensed and developed in the open on GitHub.
Where BlogVault is the better fit
We would rather you pick the right tool than the one that emails you.
- You need backups. This is BlogVault’s core product: incremental, off-site backups with storage included, one-click restores (including when the site is down) and one-click migrations. Diffy doesn’t back anything up.
- You want the staging copy hosted for you. BlogVault creates staging sites on its own servers in one click: password-protected, hidden from search engines and blocked from sending email. Its sandbox update builds that copy, tests the update there and, once you approve, replicates it on the live site. Diffy compares environments you already have, such as your host’s staging copy or a multidev, but doesn’t create them.
- You need uptime monitoring. BlogVault checks uptime as often as every 5 minutes, depending on your plan, and can alert a Slack channel. Diffy is visual only.
- You want one dashboard for WordPress care plans. Updates, backups, monitoring and client reports with your agency’s logo all live in BlogVault. If a visual check after updates is all you need, and your plan includes it, a second tool may be more than you need.
Using both
Many agencies don’t choose. They keep a backup tool to protect and restore client sites, and use Diffy as the visual step of the update routine: update staging, compare it with production across every page and breakpoint, then deploy. Diffy needs no plugin and adds nothing to the site, so it runs alongside BlogVault, or any other backup tool, without conflicts. Our WordPress visual testing guide walks through that workflow.
WordPress and Drupal experts
We know a lot about WordPress and Drupal hosting environments and update workflows. It is why Diffy ships login presets for both, and why the CLI documentation has worked examples for Pantheon and Tugboat. If that is your stack, we will make sure you get a reliable testing setup, and you can talk to the people who built Diffy when something looks wrong.
Frequently asked questions
Does BlogVault have visual regression testing?
Yes, in two forms. You can add a visual regression test to plugin, theme and core updates run from the BlogVault dashboard, including scheduled auto-updates, and you can set up Visual Monitors that compare a single page against a stored reference screenshot on a schedule. BlogVault’s pricing page does not list either feature in its Personal, Business or WooCommerce plans, and its API documentation says both depend on your plan, so check with BlogVault which plan includes them.
Can Diffy replace BlogVault?
No. Diffy does not take backups, restore sites, host staging copies or monitor uptime. It does one job: comparing screenshots of your pages and showing you what changed. If you need backups, you still need a backup tool.
Does Diffy work on sites that are not WordPress?
Yes. Diffy works from URLs, so it handles WordPress, Drupal, headless front ends and static sites the same way. BlogVault is built for WordPress and connects to your site through its plugin.
Can I use Diffy and BlogVault together?
Yes. Diffy adds nothing to your site and needs no plugin, so it does not interfere with BlogVault. A common setup is a backup tool for backups and restores, and Diffy for checking every page across environments before and after an update.
Try it
Create an account, paste your URLs, and run your first comparison. Most teams have real results inside 10 minutes, and the free plan needs no credit card.