shopifyabtests
Your store, per month:Example numbers. Enter yours and every price on the site updates.

Comparison · 167 merchant reviews read · Updated October 2026

Visually vs Shogun

Short answer

Pick Visually if you need shipping tests and offer tests and you want to start on a free plan.

Pick Shogun if you need audience targeting and profit per variant and you care about a developer that answers reviews.

VisuallyShogun
App Store rating4.8★ (147)4.2★ (45)
Cost at your traffic$80/moUp to 600 Orders covers your traffic.$39+/moCheapest plan: Pro.
How price scalesStarts at $15/month for up to 100 orders and goes up with monthly orders to $80/month for up to 600 orders; free for development stores.Starts at $39/month and goes up by plan, which mainly differs in the number of active tests and features; a free trial is available but its length isn't stated.
LaunchedJune 15, 2022March 21, 2025
App Store listingApp Store listing

Visually starts at $0 a month, Shogun at $39

Visually

  • Free - Dev StoresFree
  • Up to 100 Orders$15/mo
  • Up to 200 Orders$25/mo
  • Up to 600 Orders$80/mo

Shogun

  • Pro$39/mo
  • Advanced$119/mo
  • Unlimited$499/mo

Only Visually can run shipping tests

Read from each app's listing. A dot means the listing says it can do it.

VisuallyShogun
Price tests●●
Theme tests●●
Template tests●●
Content tests●●
URL split tests●●
Shipping tests●○
Offer tests●○
Checkout tests●●
Personalization●○
Visual editor●●
AI test ideas●●
Audience targeting○●
Profit per variant○●
Free plan●○

Shogun reviews mention bugs problems 21.4% of the time, Visually 2.2%

Share of each app's reviews that complain about the topic. Apps under 20 reviews are left out because a single review swings the number.

VisuallyShogun
Price1.4%3.6%
Billing and refunds1.4%0%
Support2.9%3.6%
Bugs2.2%21.4%
Setup0.7%0%
Dashboard0%0%
Reporting and stats0.7%3.6%
Flicker0%0%
Page speed0.7%0%
Integrations0%7.1%
What you can test0.7%3.6%
Results0%0%

The most common Visually complaint: support

Absolutely avoid them. This has been one of the worst experiences I’ve had with an app. After installing their code, it caused major issues with our Shopify store. Orders weren’t coming through properly, and tags were being applied incorrectly. I reached out and asked for the code to be removed, but even that didn’t resolve the issues. Eventually, I went ahead and removed everything myself - only…

★☆☆☆☆ · Pound Fabrics · January 23, 2026

The most common Shogun complaint: bugs

WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…

★☆☆☆☆ · Toothy ·

Shogun replies to 100% of reviews, Visually to 53%

VisuallyShogun
Reviews with a developer reply53%100%
Praise support81.3%39.3%
Complain about support2.9%3.6%

Serious problems reviewers reported

Billing disputes, broken stores, misused data and missing features. Each one is a single merchant's account.

We had a disappointing experience with Visually’s billing model. The app charges based on order volume, but this was not clearly notified in advance. We only discovered the additional fees after reviewing our invoice, which felt unexpected and unfair.

★★☆☆☆ · PowerSmart on Visually · February 3, 2026

Absolutely avoid them. This has been one of the worst experiences I’ve had with an app. After installing their code, it caused major issues with our Shopify store. Orders weren’t coming through properly, and tags were being applied incorrectly. I reached out and asked for the code to be removed, but even that didn’t resolve the issues. Eventually, I went ahead and removed everything myself - only…

★☆☆☆☆ · Pound Fabrics on Visually · January 23, 2026

There is no "Free Plan" as suggested. There is a Free Trial.

★☆☆☆☆ · Saint Piran Service Course on Visually · May 12, 2026

It's unfortunate that we've had to leave a bad review for this app. We were looking for something easy for our team to A/B test product images. After believing the misleading advertising and description that the app will allow us to test "EVERYTHING" in minutes including product images, we went ahead and installed the app. After struggling for a week to set up a simple image test we booked a…

★☆☆☆☆ · Luxo Living on Visually · October 9, 2025

WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…

★☆☆☆☆ · Toothy on Shogun ·

it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.

★☆☆☆☆ · Overlott on Shogun · June 23, 2026

Results merchants put a number on

  • 13%+ conversion rate with Visually. “driven 13%+ CRO uplift”
  • 15–27% conversion rate with Visually, testing renaming a product. “conversion lifts between 15–27%”
  • $400K revenue with Visually, testing renaming a product. “projecting over $400K in annual incremental revenue”
  • 6 figure revenue with Visually. “6 figure incremental revenue gains”
  • 3/4 other with Shogun. “3/4 bos to A”
  • 12% other with Shogun. “pull another 12%”

Add another app to this comparison

Other head-to-heads: Visually vs IntelligemsShogun vs IntelligemsVisually vs ElevateShogun vs ElevateVisually vs ShopliftShogun vs ShopliftVisually vs PersonizelyShogun vs PersonizelyVisually vs ABConvertShogun vs ABConvertVisually vs ABsolutelyShogun vs ABsolutely

Looking past Visually and Shogun? See Visually alternatives.