--- title: How to Beat Facebook's A/B Testing Algorithms description: Consumer Acquisition shares critical discoveries regarding creative testing on Facebook that helped it improve its creative success by 300%. image: https://web3growthassociation.com/hubfs/Screen%20Shot%202020-08-25%20at%209.35.56%20AM.png --- [![MGA Logo_Horizontal-Color-434px](https://web3growthassociation.com/hs-fs/hubfs/MGA%20Logo_Horizontal-Color-434px.png?width=217&height=26&name=MGA%20Logo_Horizontal-Color-434px.png "MGA Logo_Horizontal-Color-434px")](https://web3growthassociation.com/) Open Search Events [MGS 22 Las Vegas](https://events.bizzabo.com/358800) [Executive Connect](https://events.bizzabo.com/executiveconnect) [Women Of The Year Awards 2022](https://widgets.mobilegrowthassociation.com/events/mgs-22/page/2031094/women-of-the-year-awards) [See All Events](https://web3growthassociation.com/events) [APPLY TO SPEAK](https://web3growthassociation.com/speaker-application) APPLY TO SPONSOR Webinars & Webcasts [MGA Webinars](https://web3growthassociation.com/webinars) [APPLY TO SPEAK](https://web3growthassociation.com/speaker-application) APPLY TO SPONSOR Podcasts [Fintech Growth Talk](https://web3growthassociation.com/fintech) Channels [User Acquistion](https://www.mobilegrowthsummit.com/all-media?ua) [Retention & Engagement](https://www.mobilegrowthsummit.com/all-media?re) [Artificial Intelligence](https://www.mobilegrowthsummit.com/all-media?ai) [Monetization](https://www.mobilegrowthsummit.com/all-media?monetization) [LTV](https://www.mobilegrowthsummit.com/all-media?ltv) [Mobile Gaming](https://www.mobilegrowthsummit.com/all-media?gaming) [See All Media](https://web3growthassociation.com/all-media) [SUBMIT ARTICLE IDEA](https://share.hsforms.com/1qyaCXBsCRHyus5ftkoqRXw34v9x?__hstc=17895014.67ed4e0440429f7fd858dbdaa6017f42.1596082292944.1610407079532.1610469949158.104&__hssc=17895014.1.1610469949158&__hsfp=555322576) [Industry Jobs](https://careers.mobilegrowthassociation.com) [Join Now](https://web3growthassociation.com/membership) Open Search Close Search [  Good News For Mobile Marketers: Opt-Ins Are on the Rise](https://web3growthassociation.com/blog/good-news-for-mobile-marketers-opt-ins-are-on-the-rise) [How To Reduce The Cost Of App User Acquisition  ](https://web3growthassociation.com/blog/how-to-reduce-the-cost-of-app-user-acquisition) # How to Beat Facebook's A/B Testing Algorithms ![](https://web3growthassociation.com/hubfs/Screen%20Shot%202020-08-25%20at%209.35.56%20AM.png) [Rebecca Castellani](https://web3growthassociation.com/blog/author/rebecca-castellani) Posted Sep 2, 2020 [mailto:?subject=Check%20out%20How%20to%20Beat%20Facebook's%20A/B%20Testing%20Algorithms%20&body=Check%20out%20https://web3growthassociation.com/blog/how-to-beat-facebooks-a/b-testing-algorithms&utm_medium=social&utm_source=email](mailto:?subject=Check%20out%20How%20to%20Beat%20Facebook's%20A/B%20Testing%20Algorithms%20&body=Check%20out%20https://web3growthassociation.com/blog/how-to-beat-facebooks-a/b-testing-algorithms&utm_medium=social&utm_source=email) [User Acquisition](https://web3growthassociation.com/blog/tag/user-acquisition) At the end of 2019, Consumer Acquisition ran a test of 60 original, fully-animated videos for a gaming client. All 60 failed to beat the control’s installs per mille (IPM). Concerned, the folks at Consumer Acquisition ran an A/A test to determine if their growth hacking methodology was valid. The results might surprise you. In this webinar, Consumer Acquisition shares some critical discoveries regarding creative testing on Facebook; most significantly, that Facebook maintains creative history for control videos, meaning controls included in A/B testing have an innate advantage and will outperform others. Since Facebook’s algorithm visually groups similar concepts, creative that looks different from the control does not share its history, resulting in lower IPMs. Based on these revelations, Consumer Acquisition made some changes to its testing methodology. Here are the three phases the team implemented to improve creative success by 300%: - **Phase One: IPM Testing —** Consumer Acquisition shares several tips for updating your IPM testing, including the importance of clean test campaigns, the money-saving potential of test-proxies, culling in-app ad titles, and picking IPM winners. - **Phase Two: Initial ROAS Testing —** Once winning ads are selected, it’s time to test the return on ad spend (ROAS). Consumer Acquisition advises creating a new campaign with either Facebook app event optimization (AEO) or value optimization (VO), and once more keeping the winning control video out of the mix. Watch the webinar for more on selecting audience proxies, lifetime budget, and potential ROAS concerns. - **Phase Three: ROAS Scale —** To determine whether or not your ad spend will scale, Consumer Acquisition encourages strong campaign budget optimization (CBO). The webinar walks you through testing Phase 2 winners, oscillating the CBO budget between groups, and allowing an ad to exit the learning phase before challenging the control video. For more insights into A/B testing on Facebook and actionable tactics designed to improve your success rates, check out the full Consumer Acquisition Summer Update. Check out our [upcoming webinars](https://web3growthassociation.com/webinars) and secure your spot. #### [![](https://web3growthassociation.com/hubfs/icon-calendar.svg) Upcoming Events](https://web3growthassociation.com/events) #### [![MGA Podcasts](https://web3growthassociation.com/hubfs/icon-podcasts.png) Podcasts](https://web3growthassociation.com/podcasts) ##### [![Simplifying Taxes for Freelancers](https://web3growthassociation.com/hs-fs/hubfs/image001-2.jpg?width=300&name=image001-2.jpg) Simplifying Taxes for Freelancers Posted Feb 15, 2022](https://web3growthassociation.com/podcasts/simplifying-taxes-for-freelancers) ##### [![Unlocking the Potential of Financial Services with AI](https://web3growthassociation.com/hs-fs/hubfs/Fintech-Growth-Talk---Kevin-Levitt.jpg?width=300&name=Fintech-Growth-Talk---Kevin-Levitt.jpg) Unlocking the Potential of Financial Services with AI Posted Dec 29, 2021](https://web3growthassociation.com/podcasts/unlocking-the-potential-of-financial-services-with-ai) ##### [![AARP: The intersection of Health Tech and Fintech](https://web3growthassociation.com/hs-fs/hubfs/image001-1.jpg?width=300&name=image001-1.jpg) AARP: The intersection of Health Tech and Fintech Posted Dec 10, 2021](https://web3growthassociation.com/podcasts/aarp-the-intersection-of-health-tech-and-fintech) ##### [![FinTech and mobile strategy insights from Google](https://web3growthassociation.com/hs-fs/hubfs/Cherlene-Jolly%20V2.jpg?width=300&name=Cherlene-Jolly%20V2.jpg) FinTech and mobile strategy insights from Google Posted Nov 27, 2021](https://web3growthassociation.com/podcasts/fintech-and-mobile-strategy-insights-from-google) ##### [![Rebuilding the financial services ecosystem one API at a time](https://web3growthassociation.com/hs-fs/hubfs/Fintech---Richie-Serna.jpg?width=300&name=Fintech---Richie-Serna.jpg) Rebuilding the financial services ecosystem one API at a time Posted Nov 10, 2021](https://web3growthassociation.com/podcasts/rebuilding-the-financial-services-ecosystem-one-api-at-a-time) ### Recommended Articles #### [![Where the action and the money *really* is in mobile gaming apps](https://web3growthassociation.com/hs-fs/hubfs/Website%20Images/Podcast%20Images/All/NebojshaMitrikeski_mediaThumbnail-650x325.jpg?width=300&name=NebojshaMitrikeski_mediaThumbnail-650x325.jpg) Where the action and the money \*really\* is in ... Posted Sep 28, 2018](https://web3growthassociation.com/podcasts/2018/09/28/where-the-action-and-the-money-really-is-in-mobile-gaming-apps) #### [![How Homesnap attracted 1 million real estate agents – and keeps them coming back](https://web3growthassociation.com/hs-fs/hubfs/Website%20Images/Podcast%20Images/All/TimCondon_mediaThumbnail-650x325.jpg?width=300&name=TimCondon_mediaThumbnail-650x325.jpg) How Homesnap attracted 1 million real estate ... Posted Nov 2, 2018](https://web3growthassociation.com/podcasts/2018/11/02/how-homesnap-attracted-1-million-real-estate-agents-and-keeps-them-coming-back) #### [![Five Tips: Developing Apps for Foldable Displays](https://web3growthassociation.com/hs-fs/hubfs/mika-baumeister-vI8_06RmSC0-unsplash%20(1).jpg?width=300&name=mika-baumeister-vI8_06RmSC0-unsplash%20(1).jpg) Five Tips: Developing Apps for Foldable Displays Posted Apr 6, 2021](https://web3growthassociation.com/blog/five-tips-developing-apps-for-foldable-displays) #### [![Keeping Up with ASO Updates Impacting App Store Optimization in 2019](https://web3growthassociation.com/hs-fs/hubfs/Linda_Harnisch-01-1.png?width=300&name=Linda_Harnisch-01-1.png) Keeping Up with ASO Updates Impacting App Store ... Mobile Gaming Posted Jul 3, 2019](https://web3growthassociation.com/blog/2019/07/03/keeping-up-with-aso-updates-impacting-app-store-optimization-in-2019) #### [![Save more than money by automating your media portfolio](https://web3growthassociation.com/hs-fs/hubfs/Matt%20Sadofsky.jpg?width=300&name=Matt%20Sadofsky.jpg) Save more than money by automating your media ... Posted Dec 19, 2019](https://web3growthassociation.com/videos/save-more-than-money-by-automating-your-media-portfolio) #### [![How marketers can use keyboard apps to power effective UA and build brand](https://web3growthassociation.com/hs-fs/hubfs/Website%20Images/Video%20Images/Baidu-650x325.jpg?width=300&name=Baidu-650x325.jpg) How marketers can use keyboard apps to power ... Posted Apr 26, 2019](https://web3growthassociation.com/videos/2019/04/26/how-marketers-can-use-keyboard-apps-to-power-effective-ua-and-build-brand) ### Related Articles #### [Five mobile CRM trends to track in 2019](https://www.mobilegrowthassociation.com/blog/2019/02/26/five-mobile-crm-trends-to-track-in-2019) #### [Q&A with Rising Star Award Winner Iris Hu](https://www.mobilegrowthassociation.com/blog/qa-with-rising-star-award-winner-iris-hu) #### [How to Break into the Latin American Mobile Market](https://www.mobilegrowthassociation.com/blog/how-to-break-into-the-latin-american-mobile-market) #### [The Gaming Apps Taking LATAM by Storm](https://www.mobilegrowthassociation.com/blog/blog-1-games-apps-in-latam) Join Our Newsletter Sign-up to get the latest mobile growth news, updates, and trends directly in your inbox twice a month. [![MGA Logo_Vertical-White-400px](https://web3growthassociation.com/hs-fs/hubfs/MGA%20Logo_Vertical-White-400px.png?width=200&height=100&name=MGA%20Logo_Vertical-White-400px.png "MGA Logo_Vertical-White-400px")](https://web3growthassociation.com/) - [Events](https://www.mobilegrowthsummit.com/events) - [Media](https://www.mobilegrowthsummit.com/all-media) - [Company](https://web3growthassociation.com/company) - [Become a Sponsor](https://www.mobilegrowthsummit.com/sponsor-application) - [Apply to Speak](https://www.mobilegrowthsummit.com/speaker-application) - Subscribe to MGA Newsletter - [Advertise With Us](https://share.hsforms.com/1wSm-xNj1TZGNZ0YiR97aGA34v9x) - - - - - © 2020 MOBILE GROWTH ASSOCIATION ALL RIGHTS RESERVED. Contact us at [info@mobilegrowthsummit.com](mailto:info@mobilegrowthsummit.com) [Privacy Policy](https://web3growthassociation.com/privacy-policy) [Terms & Conditions](https://web3growthassociation.com/terms-and-conditions) #### Become a Sponsor The MGS Annual Sponsor Rewards maximizes and drives growth for our Sponsors. We are rewarding our loyal Sponsors in our seventh year of business with a comprehensive range of additional benefits and services. Enter your contact information here and we'll email you a Sponsor Kit so you can drive deal-flow and bottom-line revenue for your company. #### Apply to Speak #### Join our newsletter Sign-up to get the latest mobile growth news, updates, and trends directly in your inbox twice a month.