Comparison · 167 merchant reviews read · Updated October 2026
Visually vs Shogun
Short answer
Pick Visually if you need shipping tests and offer tests and you want to start on a free plan.
Pick Shogun if you need audience targeting and profit per variant and you care about a developer that answers reviews.
| App Store rating | 4.8★ (147) | 4.2★ (45) |
|---|---|---|
| Cost at your traffic | $80/moUp to 600 Orders covers your traffic. | $39+/moCheapest plan: Pro. |
| How price scales | Starts at $15/month for up to 100 orders and goes up with monthly orders to $80/month for up to 600 orders; free for development stores. | Starts at $39/month and goes up by plan, which mainly differs in the number of active tests and features; a free trial is available but its length isn't stated. |
| Launched | June 15, 2022 | March 21, 2025 |
| App Store listing | App Store listing |
Visually starts at $0 a month, Shogun at $39
Visually
- Free - Dev StoresFree
- Up to 100 Orders$15/mo
- Up to 200 Orders$25/mo
- Up to 600 Orders$80/mo
Shogun
- Pro$39/mo
- Advanced$119/mo
- Unlimited$499/mo
Only Visually can run shipping tests
Read from each app's listing. A dot means the listing says it can do it.
Shogun reviews mention bugs problems 21.4% of the time, Visually 2.2%
Share of each app's reviews that complain about the topic. Apps under 20 reviews are left out because a single review swings the number.
The most common Visually complaint: support
Absolutely avoid them. This has been one of the worst experiences I’ve had with an app. After installing their code, it caused major issues with our Shopify store. Orders weren’t coming through properly, and tags were being applied incorrectly. I reached out and asked for the code to be removed, but even that didn’t resolve the issues. Eventually, I went ahead and removed everything myself - only…
The most common Shogun complaint: bugs
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…
Shogun replies to 100% of reviews, Visually to 53%
Serious problems reviewers reported
Billing disputes, broken stores, misused data and missing features. Each one is a single merchant's account.
We had a disappointing experience with Visually’s billing model. The app charges based on order volume, but this was not clearly notified in advance. We only discovered the additional fees after reviewing our invoice, which felt unexpected and unfair.
Absolutely avoid them. This has been one of the worst experiences I’ve had with an app. After installing their code, it caused major issues with our Shopify store. Orders weren’t coming through properly, and tags were being applied incorrectly. I reached out and asked for the code to be removed, but even that didn’t resolve the issues. Eventually, I went ahead and removed everything myself - only…
There is no "Free Plan" as suggested. There is a Free Trial.
It's unfortunate that we've had to leave a bad review for this app. We were looking for something easy for our team to A/B test product images. After believing the misleading advertising and description that the app will allow us to test "EVERYTHING" in minutes including product images, we went ahead and installed the app. After struggling for a week to set up a simple image test we booked a…
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…
it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.
Results merchants put a number on
- 13%+ conversion rate with Visually. “driven 13%+ CRO uplift”
- 15–27% conversion rate with Visually, testing renaming a product. “conversion lifts between 15–27%”
- $400K revenue with Visually, testing renaming a product. “projecting over $400K in annual incremental revenue”
- 6 figure revenue with Visually. “6 figure incremental revenue gains”
- 3/4 other with Shogun. “3/4 bos to A”
- 12% other with Shogun. “pull another 12%”
Add another app to this comparison
Other head-to-heads: Visually vs IntelligemsShogun vs IntelligemsVisually vs ElevateShogun vs ElevateVisually vs ShopliftShogun vs ShopliftVisually vs PersonizelyShogun vs PersonizelyVisually vs ABConvertShogun vs ABConvertVisually vs ABsolutelyShogun vs ABsolutely
Looking past Visually and Shogun? See Visually alternatives.