ChatGPT Versus Bard: Which Produces More Duplicate Content

AI is the craze and talk of the content.

Marketers have been using it to create content at scale.

So, we wanted to see how good ChatGPT and Bard were at creating unique content.

Because we all know that creating tons of duplicate content isn’t the best when it comes to ranking at the top of Google.

So we decided to run a fun offline experiment (we weren’t trying to manipulate search results, hence the offline experiment). Where we had both ChatGPT and Bard each write the same 1000 articles.

The articles were on various topics, and we gave each of them the same instructions.

And then we took the articles that both ChatGPT and Bard created, and we ran them through Copyscape to see how unique or plagiarized they were.

ChatGPT VS. Bard

As I mentioned above, we had ChatGPT produce 1000 articles on various topics.

Out of the 1000 articles, 81.4% were unique, and 18.6% were duplicate.

That means 814 articles were unique and 186 were duplicate.

With Bard, we also created 1000 articles on the same topics.

Out of 1000 articles, 85.1% of them were unique and 14.9% were duplicate.

To recap, 851 were unique and 149 were duplicate.

So, it’s clear that Bard produces less duplicate content, but how duplicate is the content?

Duplicate content

To be clear when I say duplicate, the majority of the time it was just a sentence or two that was duplicate. Sometimes it was a few sentences throughout the article.

Every so often it was a whole paragraph, but typically it was just a sentence or two.

We decided to take the articles that contained duplicate content to see what percentage of the overall article was duplicated.

As you can see, out of the duplicate articles, 92.08% of the text that ChatGPT produced was unique and 7.92% wasn’t.

Of the duplicate content Bard produced, within the article only 5.21% was duplicate and 94.79% was unique.

What we found is when you have either of the platforms create content for you on generic topics where there are hundreds of millions of existing web pages, it is easier for them to create more unique content.

But if it was very specific topics like “why Pluto isn’t a planet anymore”, we found the articles to be more duplicate.

I don’t know why and maybe our sample size needs to be increased, but maybe it is because there aren’t as many sources from ChatGPT or Bard to pull from.

Which one do people prefer?

Duplication aside, we thought it would be fun to see which versions people preferred.

So, we took the 1000 articles from ChatGPT and put them next to the 1000 articles from Bard.

We then paid 83 people (we tried paying 100 people, but 17 didn’t complete the task) and asked them to review 6 articles each.

3 from ChatGPT and the 3 counterparts from Bard.

We didn’t tell them how the article was created. We just asked which one they preferred. We received a total of 249 responses.

Bard articles won 188 times out of 249 times.

ChatGPT won 61 times.

And then we asked if they thought a human wrote the article or if it was created by AI.

Based on our study (with a small sample size) the majority of the time people couldn’t tell if the article was created by AI. Because most people believed that a human wrote the article.

Then we asked the 83 people if they preferred reading articles by a human or AI.

So which AI should you use to create content?

Well, I want you to first imagine reading the New York Times, BBC, or CNN, but all of the content was written purely by AI.

How would you feel?

You may not mind some of the content, but you will start getting tired of reading regurgitated content.

Because that is what you get from both ChatGPT and Bard.

Sure, it may not be “duplicate content” the majority of the time, but the stuff they crank out isn’t new or fresh.

And people want new and fresh content. They want to read stuff based on your experience. Stuff that only you would know.

Google even talks about E-E-A-T.

Experience

Expertise

Authority

Trust

It’s hard to have those 4 elements or even a few of them if your content isn’t manually written.

So, if you choose to use AI to create content for you, have a human modify it. Try to include E-E-A-T within your articles.

It will make them better.

Both the platforms are good, although I prefer Bard based on the above data plus it is more up-to-date than ChatGPT (at least for now).

So, do you use AI to write content?