Facebook Ads are a predictable and scalable way to find new customers and followers. You can start with just a few dollars a day and any brand can create one. The ads just require a call to action, an image and some text. It seems so simple!
Looks can be deceiving. After setting up 48 individual ads for this test I’ve learned that they can be extremely complex. For a newcomer to the Facebook Ads platform, it can be daunting to ensure your money is being spent in the right place and on the highest-performing ad concepts. Thankfully there are hundreds of experts on just as many sites giving out advice.
But is this advice good? Much of the advice has been repeated so much, the original source and claims have been lost. And after reading a few questionable ones, we were determined to find the truth.
We picked six well publicized myths and put them through some heavy testing:
These myths focus on image choice. So to ensure no other factors affected outcomes we kept everything else the same: text, call to action, titles, demographic, budget, etc. The default ad setup is shown below:
We optimized the ads for Cost Per Click (CPC) throughout the experiment and used it to measure success. Cost Per Click charges the advertisers each time a user interacts or clicks the ads. Why is CPC important? The lower the CPC the more people you can get on your site for the same advertising budget.
With CPC, Facebook only shows the ad to the people who are most likely to actually click on it. Unlike Cost Per Impression which charges per views and is more often used for brand awareness or likes.
We ran 48 ads in total - at least 8 for each myth. In our analysis we tested all ad clicks to a statistical significance of 80%. Each graph we present does include each ad set’s 80% confidence interval for gauging accuracy.-- For more details - see the notes at the end.
In all the experiments you should be looking for a lower CPC - a lower bar. The lower the bar, the more effective the ad is. And for a myth to be statistically confirmed it has to pass the significance test. If it is inconclusive or fails the test there is no statistical difference, therefore it is busted. Now let’s get to busting some Facebook Ad myths!
Facebook ad guidelines directly instruct you to use relevant images.For example Sketchdeck would use ad images that featured technology or design. But GoPro would use images of extreme sports or the outdoors.
We are a design company, so relevant images relate naturally relate to this. We contrast these with four irrelevant images.
The irrelevant ads had a 6% lower CPC than relevant ads. And they were found to be statistically significant.
Why is this?
The second myth calls for overlaying text on the ad images. We found many experts claiming that a call to action or brand statement on the ad image will make it more successful.
This myth had three different ad sets, the first one was simple and had no text overlaid. The other two featured different brand statements, which can be seen below. Additionally to make sure actions were only influenced by the text, the same images were used throughout.
The images with no text overlaid performed consistently better with a 6-7% lower CPC.
Why is this?
Facebook brand advertising guidelines states that images of people using your product is better than just the product. Their reasoning, which makes a lot of sense, is the ad should not look out of place when on a news feed.
The two ad sets were relevant to the design and the design process. One set featured objects/products and the other featured happy people using products.
We found that there was no discernible difference between people and objects. Both averaged about the same CPC and statistically speaking there was no difference between the two ads. Therefore the myth is inconclusive!
Although objects had a lower CPC on average, there was not enough separation to declare a winner. With both sets hovering right around the average CPC of the experiment.
Why is this?
The myth claims that a smiling woman will lead to more clicks than anything. But because smiling women against the everything was too vague we tested it against a range of emotions of men.
After running the ads we found that the smiling women outperformed the unhappy men. They averaged 6% less CPC and hovered right around the experiment average.
But 5 out of the 8 ads in this set cost more than the average CPC. With 3 of them being some of the most expensive ads of the entire experiment. Which indirectly confirms our earlier findings that people do not perform better than objects.
Why is this?
Our fifth myth is all about logos, something we know a lot about already. The myth states that using a logo on ads would lead to less clicks. It is a fairly easy concept to test but could make an ad look out of place on the news feed or side bar.
There were sets with a large and small SketchDeck logo, and one set with no logo at all. Plus we used the same background images throughout, to make the logo a main focal points.
Logos are not a huge detriment for ads as long as they are small or discrete. So the myth is confirmed, kinda. The small logo set actually had the lowest cost per click on average between the two logos. But the set with no logo outperformed the large logo set.
The small logo set had a 8% lower CPC on average than the large logo set. And when the outliers were dismissed the CPC was 14% lower. The small logo set also included the most popular ad from this entire experiment. Which is one of my favorite pieces of stock photography and can be seen below:
Why is this?
Our final myth states that simple ad images in ads perform better than busy or complex images. There are two schools of thought with this myth. It could be that a simple image is best when users only have a few seconds to digest the image. But on the other hand, a complex image stands out on Facebook.
It was the perfect design myth to test, minimalist vs. eye catching. The first set, which can be seen below, would stand out against the endless updates and breaking stories of a news feed. But again they each take a while to find the true meaning.
The second set of images were simple and featured one focal point. They are easy to consume but have no real eye catching aesthetics.
We found that the simple and complex ad images cost about the same per click. There was only a minuscule difference of under one cent when the CPC were compared.
Finding that there was no statistically significant difference between the two sets confirmed our conclusion. So we can bust the myth of simple images performing better than complex ones!
There was one simple image with a low cost per click but the rest cost more than the experiment average. And 5 out of the 8 ad images from this myth cost above that average.
Why is this?
We entered this experiment very curious and ready to learn. It was as much an exercise for us to learn more as it was to help other marketers as well. And I think we definitely accomplished both of those goals.
First we confirmed how much design can impact an ad. It is the core of a Facebook Ad and the first thing prospective customers see. But it is so often relegated to a secondary status.
Also we learned to approach every ad or test with an open mind. We were pleasantly surprised with the outcomes of the irrelevant ads. Never would we predict how consistent and cost effective the results were. The same can be said with the simple and complex images. We were adamant that there would be a clear winner.
Finally, never assume that the all the expert advice will work perfectly for you brand or company. Test quickly and test often to find the best options. We were able to set this experiment up in a few hours and it was a lot larger than most tests. A simple A/B test will work for most!
But unlike the experts we pulled the myths from, our best practices are based on real data and first hand research. To have a successful Facebook ad:
1. Be unique! Avoid popular images, they do not lead to effective ads
2. Create simple but eye catching images that are well designed
3. Make sure your messaging is clear to all target users
4. Use relevant products or objects instead of people
5. Avoid text but small or discrete logos can work
6. Test everything before you invest long term
For reference our most popular ads a can be seen below:
Also our least popular ads can be seen below. They follow an interesting pattern:
To make sure that all of our conclusions were not a fluke, we tested each myth for significance. They were each tested at a significance level of 80% to confirm or deny a correlation. Because most of the myths involved rejecting the null we thought that this was a perfect test to further support our findings. Although we would have liked to have used a higher significance level, the small sample size made it difficult. For more information about significance testing please check out this great guide from Yale!