shopifyabtests
Your store, per month:Example numbers. Enter yours and every price on the site updates.

Comparison · 45 merchant reviews read · Updated October 2026

Shogun vs CustomFit AI

Short answer

Pick Shogun if you need audience targeting and profit per variant and you want the most proven option (45 reviews).

Pick CustomFit AI if you need offer tests and personalization and you want to start on a free plan.

ShogunCustomFit AI
App Store rating4.2★ (45)5★ (20)
Cost at your traffic$39+/moCheapest plan: Pro.$139+/moYour traffic is above the listed limits. Upto 10000 Monthly is the floor, expect a custom quote.
How price scalesStarts at $39/month and goes up by plan, which mainly differs in the number of active tests and features; a free trial is available but its length isn't stated.Free on dev stores for a 14-day trial, then $79/month for up to 10,000 monthly visitors, or $139/month for the plan that adds AI Copilot.
LaunchedMarch 21, 2025May 16, 2023
App Store listingApp Store listing

CustomFit AI starts at $0 a month, Shogun at $39

Shogun

  • Pro$39/mo
  • Advanced$119/mo
  • Unlimited$499/mo

CustomFit AI

  • Free (Dev stores)Free
  • 10000 visitors/mo$79/mo
  • Upto 10000 Monthly$139/mo

Only Shogun can run audience targeting

Read from each app's listing. A dot means the listing says it can do it.

ShogunCustomFit AI
Price tests●●
Theme tests●●
Template tests●●
Content tests●●
URL split tests●●
Offer tests○●
Checkout tests●●
Personalization○●
Visual editor●●
AI test ideas●●
Audience targeting●○
Profit per variant●○
Free plan○●

What reviewers complain about

Share of each app's reviews that complain about the topic. Apps under 20 reviews are left out because a single review swings the number.

Shogun
Price3.6%
Billing and refunds0%
Support3.6%
Bugs21.4%
Setup0%
Dashboard0%
Reporting and stats3.6%
Flicker0%
Page speed0%
Integrations7.1%
What you can test3.6%
Results0%

The most common Shogun complaint: bugs

WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…

★☆☆☆☆ · Toothy ·

Shogun replies to 100% of reviews. CustomFit AI replies to none

ShogunCustomFit AI
Reviews with a developer reply100%0%
Praise support39.3%64.7%
Complain about support3.6%0%

Serious problems reviewers reported

Billing disputes, broken stores, misused data and missing features. Each one is a single merchant's account.

WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…

★☆☆☆☆ · Toothy on Shogun ·

it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.

★☆☆☆☆ · Overlott on Shogun · June 23, 2026

Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.

★☆☆☆☆ · BlueV8 on Shogun · May 24, 2026

I started an AB test. It deleted all of my product images and made some of my apps broken.

★☆☆☆☆ · SparkUp™ on Shogun · May 17, 2026

Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.

★☆☆☆☆ · BlueV8 on Shogun · May 24, 2026

Results merchants put a number on

  • 3/4 other with Shogun. “3/4 bos to A”
  • 12% other with Shogun. “pull another 12%”

Add another app to this comparison

Other head-to-heads: Shogun vs IntelligemsCustomFit AI vs IntelligemsShogun vs VisuallyCustomFit AI vs VisuallyShogun vs ElevateCustomFit AI vs ElevateShogun vs ShopliftCustomFit AI vs ShopliftShogun vs PersonizelyCustomFit AI vs PersonizelyShogun vs ABConvertCustomFit AI vs ABConvert

Looking past Shogun and CustomFit AI? See Shogun alternatives.