Comparison · 75 merchant reviews read · Updated October 2026
ABsolutely vs Shogun
Short answer
Pick ABsolutely if you need shipping tests and you want the fewest bug complaints.
Pick Shogun if you need checkout tests and ai test ideas and you want the lowest starting price ($39/month).
 ABsolutely |  Shogun | |
|---|---|---|
| App Store rating | 4.9★ (47) | 4.2★ (45) |
| Cost at your traffic | $49+/moStarting price. The listing says price rises with orders but gives no tiers. | $39+/moCheapest plan: Pro. |
| How price scales | Starts at $49/month (Content Testing), $199 (Price Testing) or $499 (Advanced Testing), and goes up with your store's sitewide order volume; a free trial is available but its length isn't stated. | Starts at $39/month and goes up by plan, which mainly differs in the number of active tests and features; a free trial is available but its length isn't stated. |
| Launched | November 29, 2024 | March 21, 2025 |
| App Store listing | App Store listing |
Shogun starts at $39 a month, ABsolutely at $49
ABsolutely
- Content Testing$49/mo
- Price Testing$199/mo
- Advanced Testing$499/mo
“Starting at $49. Pricing scales based on sitewide order volume.”
Shogun
- Pro$39/mo
- Advanced$119/mo
- Unlimited$499/mo
Only ABsolutely can run shipping tests
Read from each app's listing. A dot means the listing says it can do it.
| ABsolutely | Shogun | |
|---|---|---|
| Price tests | ● | ● |
| Theme tests | ● | ● |
| Template tests | ● | ● |
| Content tests | ● | ● |
| URL split tests | ● | ● |
| Shipping tests | ● | ○ |
| Checkout tests | ○ | ● |
| Visual editor | ● | ● |
| AI test ideas | ○ | ● |
| Audience targeting | ● | ● |
| Profit per variant | ○ | ● |
Shogun reviews mention bugs problems 21.4% of the time, ABsolutely 2.1%
Share of each app's reviews that complain about the topic. Apps under 20 reviews are left out because a single review swings the number.
| ABsolutely | Shogun | |
|---|---|---|
| Price | 0% | 3.6% |
| Billing and refunds | 0% | 0% |
| Support | 4.3% | 3.6% |
| Bugs | 2.1% | 21.4% |
| Setup | 2.1% | 0% |
| Dashboard | 0% | 0% |
| Reporting and stats | 2.1% | 3.6% |
| Flicker | 0% | 0% |
| Page speed | 0% | 0% |
| Integrations | 0% | 7.1% |
| What you can test | 0% | 3.6% |
| Results | 0% | 0% |
The most common ABsolutely complaint: bugs
Update: They did reply. Most issues are unresolved but may be outside of their control. 1 issue is arguably user error / arguably UX defect (my bias as a customer is that it's a UX defect). Delay in response to a pri 1 issue seems to be from having recently switched support platforms. I need more time to evaluate and test things out, but am updating to 3 stars until I have a few days to do so. I…
The most common Shogun complaint: bugs
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…
Shogun replies to 100% of reviews. ABsolutely replies to none
| ABsolutely | Shogun | |
|---|---|---|
| Reviews with a developer reply | 0% | 100% |
| Praise support | 48.9% | 39.3% |
| Complain about support | 4.3% | 3.6% |
Serious problems reviewers reported
Billing disputes, broken stores, misused data and missing features. Each one is a single merchant's account.
Update: They did reply. Most issues are unresolved but may be outside of their control. 1 issue is arguably user error / arguably UX defect (my bias as a customer is that it's a UX defect). Delay in response to a pri 1 issue seems to be from having recently switched support platforms. I need more time to evaluate and test things out, but am updating to 3 stars until I have a few days to do so. I…
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…
it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.
Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.
I started an AB test. It deleted all of my product images and made some of my apps broken.
Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.
Results merchants put a number on
- 15% other with ABsolutely, testing lower prices. “lower prices increased our profits by 15%”
- 3/4 other with Shogun. “3/4 bos to A”
- 12% other with Shogun. “pull another 12%”
Add another app to this comparison
Other head-to-heads: ABsolutely vs IntelligemsShogun vs IntelligemsABsolutely vs VisuallyShogun vs VisuallyABsolutely vs ElevateShogun vs ElevateABsolutely vs ShopliftShogun vs ShopliftABsolutely vs PersonizelyShogun vs PersonizelyABsolutely vs ABConvertShogun vs ABConvert
Looking past ABsolutely and Shogun? See ABsolutely alternatives.