shopifyabtests
Your store, per month:Example numbers. Enter yours and every price on the site updates.

Comparison · 156 merchant reviews read · Updated October 2026

Visually vs CustomFit AI

Short answer

Pick Visually if you need shipping tests and you want the most proven option (147 reviews).

VisuallyCustomFit AI
App Store rating4.8★ (147)5★ (20)
Cost at your traffic$80/moUp to 600 Orders covers your traffic.$139+/moYour traffic is above the listed limits. Upto 10000 Monthly is the floor, expect a custom quote.
How price scalesStarts at $15/month for up to 100 orders and goes up with monthly orders to $80/month for up to 600 orders; free for development stores.Free on dev stores for a 14-day trial, then $79/month for up to 10,000 monthly visitors, or $139/month for the plan that adds AI Copilot.
LaunchedJune 15, 2022May 16, 2023
App Store listingApp Store listing

Visually starts at $0 a month, CustomFit AI at $0

Visually

  • Free - Dev StoresFree
  • Up to 100 Orders$15/mo
  • Up to 200 Orders$25/mo
  • Up to 600 Orders$80/mo

CustomFit AI

  • Free (Dev stores)Free
  • 10000 visitors/mo$79/mo
  • Upto 10000 Monthly$139/mo

Only Visually can run shipping tests

Read from each app's listing. A dot means the listing says it can do it.

VisuallyCustomFit AI
Price tests●●
Theme tests●●
Template tests●●
Content tests●●
URL split tests●●
Shipping tests●○
Offer tests●●
Checkout tests●●
Personalization●●
Visual editor●●
AI test ideas●●
Free plan●●

What reviewers complain about

Share of each app's reviews that complain about the topic. Apps under 20 reviews are left out because a single review swings the number.

Visually
Price1.4%
Billing and refunds1.4%
Support2.9%
Bugs2.2%
Setup0.7%
Dashboard0%
Reporting and stats0.7%
Flicker0%
Page speed0.7%
Integrations0%
What you can test0.7%
Results0%

The most common Visually complaint: support

Absolutely avoid them. This has been one of the worst experiences I’ve had with an app. After installing their code, it caused major issues with our Shopify store. Orders weren’t coming through properly, and tags were being applied incorrectly. I reached out and asked for the code to be removed, but even that didn’t resolve the issues. Eventually, I went ahead and removed everything myself - only…

★☆☆☆☆ · Pound Fabrics · January 23, 2026

Visually replies to 53% of reviews. CustomFit AI replies to none

VisuallyCustomFit AI
Reviews with a developer reply53%0%
Praise support81.3%64.7%
Complain about support2.9%0%

Serious problems reviewers reported

Billing disputes, broken stores, misused data and missing features. Each one is a single merchant's account.

We had a disappointing experience with Visually’s billing model. The app charges based on order volume, but this was not clearly notified in advance. We only discovered the additional fees after reviewing our invoice, which felt unexpected and unfair.

★★☆☆☆ · PowerSmart on Visually · February 3, 2026

Absolutely avoid them. This has been one of the worst experiences I’ve had with an app. After installing their code, it caused major issues with our Shopify store. Orders weren’t coming through properly, and tags were being applied incorrectly. I reached out and asked for the code to be removed, but even that didn’t resolve the issues. Eventually, I went ahead and removed everything myself - only…

★☆☆☆☆ · Pound Fabrics on Visually · January 23, 2026

There is no "Free Plan" as suggested. There is a Free Trial.

★☆☆☆☆ · Saint Piran Service Course on Visually · May 12, 2026

It's unfortunate that we've had to leave a bad review for this app. We were looking for something easy for our team to A/B test product images. After believing the misleading advertising and description that the app will allow us to test "EVERYTHING" in minutes including product images, we went ahead and installed the app. After struggling for a week to set up a simple image test we booked a…

★☆☆☆☆ · Luxo Living on Visually · October 9, 2025

Results merchants put a number on

  • 13%+ conversion rate with Visually. “driven 13%+ CRO uplift”
  • 15–27% conversion rate with Visually, testing renaming a product. “conversion lifts between 15–27%”
  • $400K revenue with Visually, testing renaming a product. “projecting over $400K in annual incremental revenue”
  • 6 figure revenue with Visually. “6 figure incremental revenue gains”

Add another app to this comparison

Other head-to-heads: Visually vs IntelligemsCustomFit AI vs IntelligemsVisually vs ElevateCustomFit AI vs ElevateVisually vs ShopliftCustomFit AI vs ShopliftVisually vs PersonizelyCustomFit AI vs PersonizelyVisually vs ABConvertCustomFit AI vs ABConvertVisually vs ABsolutelyCustomFit AI vs ABsolutely

Looking past Visually and CustomFit AI? See Visually alternatives.