Comparison · 44 merchant reviews read · Updated October 2026
Shogun vs Emerald Collective
Short answer
Pick Shogun if you need theme tests and template tests and you want the most proven option (45 reviews).
Pick Emerald Collective if you need shipping tests and you want to start on a free plan.
 Shogun |  Emerald Collective | |
|---|---|---|
| App Store rating | 4.2★ (45) | 2.9★ (17) |
| Cost at your traffic | $39+/moCheapest plan: Pro. | FreeCheapest plan: Free Plan. |
| How price scales | Starts at $39/month and goes up by plan, which mainly differs in the number of active tests and features; a free trial is available but its length isn't stated. | Free for up to 10 orders, or a flat $10/month for unlimited orders and 24/7 support. |
| Launched | March 21, 2025 | December 3, 2024 |
| App Store listing | App Store listing |
Emerald Collective starts at $0 a month, Shogun at $39
Shogun
- Pro$39/mo
- Advanced$119/mo
- Unlimited$499/mo
Emerald Collective
- Free PlanFree
- Premium Plan$10/mo
Only Shogun can run theme tests
Read from each app's listing. A dot means the listing says it can do it.
| Shogun | Emerald Collective | |
|---|---|---|
| Price tests | ● | ● |
| Theme tests | ● | ○ |
| Template tests | ● | ○ |
| Content tests | ● | ○ |
| URL split tests | ● | ○ |
| Shipping tests | ○ | ● |
| Checkout tests | ● | ○ |
| Visual editor | ● | ○ |
| AI test ideas | ● | ○ |
| Audience targeting | ● | ● |
| Profit per variant | ● | ○ |
| Free plan | ○ | ● |
What reviewers complain about
Share of each app's reviews that complain about the topic. Apps under 20 reviews are left out because a single review swings the number.
| Shogun | |
|---|---|
| Price | 3.6% |
| Billing and refunds | 0% |
| Support | 3.6% |
| Bugs | 21.4% |
| Setup | 0% |
| Dashboard | 0% |
| Reporting and stats | 3.6% |
| Flicker | 0% |
| Page speed | 0% |
| Integrations | 7.1% |
| What you can test | 3.6% |
| Results | 0% |
The most common Shogun complaint: bugs
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…
Shogun replies to 100% of reviews, Emerald Collective to 25%
| Shogun | Emerald Collective | |
|---|---|---|
| Reviews with a developer reply | 100% | 25% |
| Praise support | 39.3% | 31.3% |
| Complain about support | 3.6% | 25% |
Serious problems reviewers reported
Billing disputes, broken stores, misused data and missing features. Each one is a single merchant's account.
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written…
it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.
Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.
I started an AB test. It deleted all of my product images and made some of my apps broken.
Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.
purtroppo non funziona. Dopo alcune ore non ha ancora generato impression nessuna delle due varianti. Ho aperto varie chat di assistenza in cui dicono di rispondere in 16 minuti ma dopo 24 ancora non hanno risposto. Intanto l'ABtest continua a non funzionare. Disinstallo tutto
Results merchants put a number on
- 3/4 other with Shogun. “3/4 bos to A”
- 12% other with Shogun. “pull another 12%”
Add another app to this comparison
Other head-to-heads: Shogun vs IntelligemsEmerald Collective vs IntelligemsShogun vs VisuallyEmerald Collective vs VisuallyShogun vs ElevateEmerald Collective vs ElevateShogun vs ShopliftEmerald Collective vs ShopliftShogun vs PersonizelyEmerald Collective vs PersonizelyShogun vs ABConvertEmerald Collective vs ABConvert
Looking past Shogun and Emerald Collective? See Shogun alternatives.