NB: As soon as Yelp sees this, they will be working on fixing these specific errors, which is fine.  The point is that these exist… endlessly… throughout the site, and these were just the obvious ones I cataloged in a few hours.

I was so pleased to see a 2 star review disappear from one of my client’s pages today… one that sponsors yelp.  I doubt that means anything, because the below problem looks as if it follows zero rhyme or reason.  This looks like that algorithm really does have a secret aspect about it…. that it is irrevocably flawed.

So… this isn’t about yelp being unethical.  This isn’t about deliberate unethical behavior.  All Jeremy Stoppleman seems to do is look for blogs, waiting to defensively react against criticism… usually ending with the incredibly vapid “it’s the algorithm and it’s secret” argument.  But really, that’s harmless.

However, that argument might not hold water anymore guys.  Below is an afternoon of research, and it is hardly complete.  This could go on forever.  Hopefully… you will recognize that this is enough proof that the integrity of yelp, and it’s functionality, is endlessly flawed.  This is about a faulty algorithm, no more no less.  The below links are all too self explanatory…. pointing out profiles with reviews that are suppressed from business pages.  Whether or not it is about “maintaining the integrity of yelp” as they so often suggest is moot….

These are real people, and real reviews.  In the below documentation, I have often countered the suppressed review of a certain business by highlighting a reviewer that has a nearly similar profile that actually *has* a review posted.  What that means is that many of the profiles that have suppressed reviews are no different from reviews that are posted on the site (sometimes no avatar/pic, sometimes very few reviews, sometimes long periods between reviews)

Many of the arguments against the below research will be:

1) that they don’t have a picture…. but many of the posted reviews do not have a pic as well.  You have to start out with a fresh profile at some point.  If they aren’t giving a voice to people, why would anyone finish updating a profile anyway.

2) Yelp is protecting against “one hit wonders”…. but that won’t stand up, in that many of those people have completed profiles with many reviews that are totally legitimate.  What’s more, some businesses pages have multiple one hit wonders, just to have one of those suppressed?

I also find it interesting that, after a person voices concern on a talk thread…. the reviews magically appear.  I am not suggesting that yelp is reviewing talk threads and acting accordingly when people bring this issue up, but look for yourself…. seems a lot of the voiced reviewers’ concerns have been placated since the beginning of those threads.  I guess it is tantamount to yelp having the mistake brought to it’s attention, and fixing that error.  Admitting that the algorithm is flawed is one thing… but having to constantly correct and second guess, or act as oversite, sort of lessens any integrity or trust I had in the site.  If I have to sit and think about whether it is honest, or whether it can be trusted… well isn’t that a problem?  Many yelpers I have spoken with don’t think so.  You decide.

I have also supplied links to other talk threads where people are simply confused about flagged reviews, or why their review was taken down or isn’t showing.  I added some confused businesses to boot.

If this is your algorithm yelp, you have built your business on one of the most flawed I have seen.  Just my two cents.  If real reviews by real people is what this is all about, yelp has some serious explaining to do about the incredible flaw in their model.  I don’t think this is fixable, and I don’t think they can defend it.

Frankly, I love yelp.  I hope they can.  I think they may want to start.  I knew this wasn’t out and out unethical behaviour… it was just a deeply flawed model.

If you have any odd situations like this…. a review on your profile not existing on a business page, or confusion of the lack of transparency or communication on yelp’s part… let it be heard.

I may be way, way off on this.  But the below is interesting to me.  I hope it is for you as well.  While we wait for transparency, communication, openness, earnestness, and any ounce of interest in clearing up the confusion… Jeremy will pop into any conversation acting defensive and contradictory.  Instead of being defensive and having to always manage bad press… why not just fix it?

Funny that yelp helped destroy the original marketing model so you can no longer damage control or control any “message”…. which is precisely what yelp is retroactively doing when things like this come up.

I have said it before… you need to be an ethical business that consumers identify with, and have an ethos that draws people to “opt-in” to your offering… and not trick people into thinking you are something you are not.  If you aren’t ethical, or you aren’t run well… people will find out.

It’s possible that yelp is both.

(this was on a spreadsheet, pardon the formatting issues)
REVIEWS NOT SHOWING UP ON BUSINESS PAGES
http://www.yelp.com/user_details?userid=gyMJq4pTHJKp5yWlXi9O4g
none of her reviews show on business pages at this point… while on this talk thread it used

to be only two were missing

http://www.yelp.com/topic/chicago-yelp-removed-your-review-since-its-still-on-your-profile-nows-your-chance-to-highlight-it-anyway
http://www.yelp.com/user_details?userid=_sINwqsdoGCfAHaQncI16w
this guys “Review of the Day” doesn’t even show up on the business listing
http://www.yelp.com/topic/los-angeles-where-did-my-review-go#WB3_mpBJsWzGhkhtGwC0FQ
http://www.yelp.com/user_details?userid=lx_T-apTArjFJCPtPolcTQ
none of the review appear on any biz listing… he doesn’t realize it.
http://www.yelp.com/topic/anaheim-review-removed-why
http://www.yelp.com/user_details?userid=w_Pz5GpdCK01_PdCameyaA
hers doesn’t appear on the biz page,

but another no avatar, single reviewer does show on the biz page…

http://www.yelp.com/biz/asti-financial-management-berkeley#hrid:TMne1Er_Hl1fMLR1pMP1-g
http://www.yelp.com/user_details?userid=9VPUQC74r5e3Id87v4vNZQ
this woman has 7 reviews.  The only one that appears on a biz page is on a business that

sponsors.  That is VERY interesting to me.

http://www.yelp.com/biz/heidi-kao-lac-ms-san-francisco#hrid:rcsJKSOMaoOZmUjUVCiqCw
http://www.yelp.com/user_details_reviews_self?userid=czVgJrqYEdLsENyeedFXaw&rec_pagestart=10
his reviews do not appear on any businesses
http://www.yelp.com/user_details_reviews_self?userid=8q6T22w592Qug-gLdrjbDA
this reviewer’s 2 star review doesn’t appear on the sponsored business page:
http://www.yelp.com/biz/stanford-terrace-inn-palo-alto#hrid:6rjFikh70AdHsjBMMTU11w
http://www.yelp.com/user_details?userid=3MKBPOJGCEO6lL7wt_UbVQ
this reviewer has 2 reviews of 11 that show on business listings
http://www.yelp.com/topic/portland-whats-up-with-the-censorship-on-this-site#tqutOoU9rc82s1SOTVCGpg
http://www.yelp.com/user_details?userid=wzyPvJn5L-SqowsHr4oRSw
none of this users reviews show up on any bizzes
http://www.yelp.com/user_details?userid=3ETbUREjVDUjXL2Uv4-_zQ
his review doesn’t show up on this page:
http://www.yelp.com/biz/werecoverdata-com-new-york
http://www.yelp.com/user_details?userid=EsyNpwBnrfO8qfKAl10FNA
doesn’t show on the page:
http://www.yelp.com/biz/lola-staars-dreamland-roller-rink-brooklyn#hrid:1z1_3Ol6OrwAonHibF1PPA
http://www.yelp.com/user_details?userid=vpu-9K299_D1FqulC2Jcqg
doesn’t show on the bridal page:
http://www.yelp.com/biz/henson-bridal-galleria-and-tuxedo-san-jose#hrid:GNpWkffZuzM-JxoZzhVmMw
http://www.yelp.com/user_details?userid=oAf9OkoaeE252ijLydHUqA
complained here:
http://www.yelp.com/topic/atlanta-reviews-not-posting-in-search-results?fsid=idVLDswr1g1d8OtxfrIUnA
http://www.yelp.com/user_details?userid=BS4WefPbc08Z1tJBg1pU-A
doesn’t show up here… while other one star reviews do:
http://www.yelp.com/biz/towbin-dodge-dodge-truck-henderson#hrid:2p8yEkKVcSxDFsEBLAxC1g
http://www.yelp.com/topic/chicago-uh-one-of-my-reviews-disappeared#QMYF1_EL78EEJzegCkGedA
gent deleted reviews he was talking about, so no review proof – but the thread stands.
http://www.yelp.com/user_details?userid=iaLIHMZviMZJZikeETMQHg
none of her reviews show up… even with businesses that have people reviewing

with no avatar and less reviews (less credible)

http://www.yelp.com/biz/now-voyager-travel-agency-huntington-beach#hrid:e8P8hvyxEFm3C_sUClwQAw
REVIEWS THAT ARE NOW SHOWING AFTER

USER COMPLAINS ON TALK FORUM

http://www.yelp.com/user_details?userid=DEb2CkbiLne3c-sTqNyoGQ
complained on this thread…. that reviews weren’t showing up.  Now all of them do.
http://www.yelp.com/topic/san-francisco-why-don-t-my-reviews-show-up-under-the-places-i-ve-reviewed#_oM2gZmsjLIaoOx4hqCFgw
http://www.yelp.com/user_details?userid=4dsM6431y8gQXowb953_bQ
complained on this thread:
http://www.yelp.com/topic/portland-problem-with-posting-of-review
now it does…plus a very sad story of a GREAT reviewer that gave up… cancelled the account even while liking yelp
http://www.yelp.com/user_details_reviews_self?userid=1N54AcaexFveFQaBCKIlMA&rec_pagestart=20
complained on this thread:
http://www.yelp.com/topic/beaverton-why-arent-all-of-my-reviews-being-shown#-mnjEEUYdHopzQcpTRTemg
now all the reviews are showing up.
http://www.yelp.com/user_details?userid=nC_y1OtxQI750XVzlcZPQg
complained on this thread:
http://www.yelp.com/topic/fremont-yelp-is-doing-some-hidden-funny-things-i-started-doubting-their-integrity-now
now the grocery store review is up (I helped clue him in to that)
http://www.yelp.com/topic/new-york-yelp-supresses-reviews
complained on this thread:
http://www.yelp.com/topic/new-york-yelp-supresses-reviews
now all the reviews are up.
http://www.yelp.com/user_details?userid=t_S7p5-qmdP000VKZ4n01w
complained on this thread:
http://www.yelp.com/topic/brooklyn-glowing-review-removed#6k65NqTqXrei64O98g_aeg
now it is up
http://www.yelp.com/user_details?userid=1sK5OpYWF7Y0ZTGVpwTnOQ
complained in this thread:
http://www.yelp.com/topic/san-pablo-the-amzinf-disappearing-review#coNU_pOAtTRsMJuOuVT_xA
now it’s up
http://www.yelp.com/user_details?userid=Ol6V3-kgp0-Og9LKaud9sg
complained in this thread:
http://www.yelp.com/topic/new-york-does-yelp-censor#zA17qI4G0HgRJqnAh-Nkgw
and now the review appears
http://www.yelp.com/user_details_reviews_self?userid=7LHvEpxVKXOtkhC6Jf014w&rec_pagestart=10&review_sort=time
complained here:
http://www.yelp.com/user_details_reviews_self?userid=7LHvEpxVKXOtkhC6Jf014w&rec_pagestart=10&review_sort=time
now it appears
http://www.yelp.com/user_details?userid=wsGS2otcPx4LLkSWyWdcUw
complained here:
http://www.yelp.com/topic/agoura-hills-why-has-my-review-been-removed#bUrhfj3FzulUNqjEZS_z1g
now they are up
http://www.yelp.com/user_details_reviews_self?userid=AvweIsR_aZU69IAJDOEJAg&rec_pagestart=10&review_sort=time
complained here:
http://www.yelp.com/topic/chicago-is-yelp-doing-something-weird-to-our-reviews
now they are up
http://www.yelp.com/user_details?userid=1N54AcaexFveFQaBCKIlMA
complained… now they are up.
http://www.yelp.com/topic/beaverton-why-arent-all-of-my-reviews-being-shown#-mnjEEUYdHopzQcpTRTemg
http://www.yelp.com/user_details?userid=-qklwtEuXpF72Mvhcdh8ig
complained here:
http://www.yelp.com/topic/chicago-who-ate-my-reviews#bUdvKtzqfOYnrlVZWS1GjQ
meaning the algorithm is inherently flawed, and they are covering it up?  Not sure…. But all this is whack.
whatever the case…. Something is surely weird.
http://www.yelp.com/topic/new-york-where-did-my-review-go#MFVhBC-oDBExLGizR799YA
http://www.yelp.com/topic/new-york-shrugs-tryn-2-figure-this-out-where-is-my-post-at-on-a-review-ugg#o9oqnm-Jz8DWU2kr-yu04A
still not sure about this… contacted the person
DELETED REVIEWS / CONFUSING FLAGGING ISSUES
threads about deleted user reviews
http://www.yelp.com/topic/oakland-my-review-got-yanked#QxLuQZqGQtd3PkNTpm9-Lw
http://www.yelp.com/topic/san-francisco-silly-question—was-my-review-removed#wGmx2FY2Sl_b-WT3cMjsFA
http://www.yelp.com/topic/san-francisco-whats-up-with-bad-reviews-disappearing#g3lEZlAnjlGnFv_aMHEjPA
http://www.yelp.com/topic/san-francisco-anone-else-have-their-rotds-removed-what-is-that-all-about-yelp#kqDne9jdAJIcOMal93eQow
http://www.yelp.com/topic/san-mateo-deletion-of-reviews#eD3aFpK7JcI1jVXesUQC8w
http://www.yelp.com/topic/san-francisco-how-many-reviews-have-you-had-removed#ZSDkGYIMFb9NJU5PeIg9Lg
http://www.yelp.com/topic/oakland-negative-review-of-uhuru-removed-by-yelp#Md_El529jjZuFAvDKzbn4A
http://www.yelp.com/topic/san-francisco-why-are-my-reviews-being-removed#C3edzevtzTWa9WxwUpdjbQ
http://www.yelp.com/topic/san-francisco-so-i-just-got-an-email-from-pam-at-yelp#6wSQt44HUjynGK_962eXPQ
http://www.yelp.com/topic/hayward-yanked-reviews-by-yelp#8y-fTlqTcJq4s4l_6qZOeA
http://www.yelp.com/topic/new-york-yelp-is-mean
http://www.yelp.com/topic/new-york-alrighty-who#-R6SvwnYKb3382DNUO9diA
http://www.yelp.com/topic/portland-rip—my-review
http://www.yelp.com/user_details?userid=1sK5OpYWF7Y0ZTGVpwTnOQ
http://www.yelp.com/topic/sunnyvale-yelp-censors-reviews-and-their-explanation-is-not-credible#QgT9ykALksPqmRvoKmfJtg
http://www.yelp.com/topic/henderson-why-is-my-review-gone#oEJzLJjKoxpmexITuMeIWw
http://www.yelp.com/topic/chicago-flagged-review-question#PgmRuj4fLsk3nUF_mW5E4g
http://www.yelp.com/topic/long-beach-i-am-expereincing-a-little-hate-of-yelp-hq#NEGMPgQ8xcn_V3rcr1e4NA
http://www.yelp.com/topic/anaheim-review-removed-why#lkYee7UqKdFrOEtvO0dyXg
http://www.yelp.com/topic/los-angeles-business-owners-taking-down-reviews
http://www.yelp.com/topic/chicago-reviews-not-showing-up#2Q7a9PaqENvMYdfp91XkLA
http://www.yelp.com/topic/chicago-my-review-dissappeared#zB6y-2bTe593WriCKipoYA

http://www.yelp.com/topic/san-francisco-yelp-just-deleted-62-of-my-reviews-without-warning

http://www.yelp.com/topic/chicago-the-amazing-disappearing-review#SjfRzmmkk3XUYHgBXpdUDw
threads about businesses totally confused about disappearing reviews
http://www.yelp.com/topic/foster-city-yelp-is-rigged#G2_Vv-7dz5enx_96CWA5og
http://www.yelp.com/topic/oakland-why-is-yelp-removing-one-star-ratings-for-uhuru#YUvIIYdvtHHvNKWoM-_lAQ
http://www.yelp.com/topic/new-york-holy-crap-this-guy-is-ridiculous#QDwjDxxDS7-OvfDt46uFnw
http://www.yelp.com/topic/albany-missing-review#yVFNKZKuZ179S3Q9CX6jMQ
http://www.yelp.com/topic/long-beach-thanks-yelp—i-see-you-just-deleted-another-one-of-my-5-star-reviews—sorry-i-couldnt-come-up-with-the-350-month#WqJRxSCFtcshC84jGajRdA
(also…. Posts removed by yelp admin inside the thread.

Very odd)

http://www.yelp.com/topic/washington-reviews-removed#KbC1oWjaNN1HEUJaq4xLHw

About Michael

16 Responses to “Why you will never trust Yelp ever again”

  1. Yvonne

    Wow! You really put a lot of time in this. Now that you have me wondering again, you know what I forgot to mention is a trip! “I” can see MY reviews on ALL the business pages again…since I emailed admins months ago, but I think no one else can? Let me know please? Like my friend Paul Hessinger, kept telling me HE could no longer see my review for him, and I kept telling him, “It’s there!” (???)

  2. JO

    it’s a difficult issue. yelp might be too big to manage. maybe they are too busy with marketing. I think the solution is to let reviews be removed from tipoffs by elites.
    Integrity is the most important thing to me.

  3. Michael Hraba

    It is my assessment that “elites” don’t care about content in any way. At least, a lot of them. They used to have moderators, that could be interesting. They could crowd source this and fix everything. Integrity of the site is important if I am going to recommend my businesses to advert with them, etc. It’s just that I now look at a listing and don’t trust it very much. Overall I am sure it is fine, but it is such a far cry from what they suggested it was.

  4. Pete K.

    Great Research. Thanks for this Info. Yelp should definitely issue a press release after this and clear this confusion and their intent.

  5. Christine S.

    I deleted my 175 reviews and profile last month. I refuse to let yelp use my reviews to blackmail small businesses into being sponsors. Yes, reviews disappear off the biz pages all the time. If you click on the review from your profile, it looks like it’s there but if you search the business and then go into it that way, the review is gone. This happens far more often with a negative review of a sponsored business or a positive review of a business they telemarketed to death. This website sucks because of these policies. They have completely undermined their own usefulness. They ought to change their tag line to: Disappearing Reviews, Shallow People, Tough Telemarketers. Fuck yelp.

  6. Nate BW

    Yes, indeed, I have slowly watched my reviews – all legit by my patients – slowly disappear. Frustrating to say the least.

  7. David

    My own experience was that they removed my review, but that it shows up when I logon. I think at least one other person above had a similar experience. My review as entirely factual and first-hand. Can’t understand this!!

  8. Carl L.

    When I first started with Yelp, it immediately became apparent that they were just a shill for specific establishments; reasons unknown.

    BUT, they not only CENSOR the bad reviews, they also CENSOR good reviews, if the establishment happens to be a competitor of a more favorable CLIENT.

    I tested my theory under numerous guises and various e-mail addresses, only to arrive at the same conclusion.

    ABANDON YELP if you are looking for a true critique. There is something there that I am yet unable to define but, trust me, it is not above board.

    You are being steered toward establishments that Yelp would like you to patronize, regardless of quality.

  9. irina

    You can never believe anything you see in yelp.com. Yelp had delete all positive revies,and only kept bad. Negative reviews contained false information and personal attaks on business owners after declining to advertise.The reviews are manipulated to business owners to buy advertising.

  10. Ryan

    Super details! I have been hunting for something such as this for a little bit now. Thanks for the tips!

  11. paul k

    FEDERAL TRADE COMMISSION PHONE NUMBER 1-877-382-4357
    i am a small business owner who has run afoul of a competitor.
    the competing business has bombarded me (using YELP) with out and out fabrications, libelous accusations, and outrageous drivel via what i can only assume to be one writer with several pseudonyms or one (very unethical) ‘on-line presence’ service with a stable of (fiction) writers masquerading as unhappy clients.
    i have written to yelp on many occasions to explain. you have a better chance of finding God. i haven’t found a phone # you can call (unless, of course, you want to buy advertising), and all my letters have elicited only (the same, word for word), boilerplate answers generated by some robot.
    i finally got so angry i called the FTC (federal trade commission), at 877-382-4357.
    they filed a complaint, and said if they see a pattern (meaning a lot of angry businesspeople filing complaints) they will go after them (yelp).
    the gentleman i spoke with seemed particularly interested in the “extortion for advertising” angle.
    so what are you waiting for??? if yelp has wronged you as it has me, CALL NOW AND FILE A COMPLAINT!!!
    FEDERAL TRADE COMMISSION—- 1-877-382-4357

  12. Heads to Tails Grooming Spa

    All of my good reviews dissapeared after I decided not to advertise with them. I called the sales person and he flat out told me that they want people on the site that use it on a regular basis. He also said the he did not feel bad for me because I had not returned his phone calls. If the filter worked then the posts that were both good and bad would get filtered not just the good as in my case. All of the good posts gone. I also have had customers ask why there post was gone.

  13. Michael Hraba

    It’s important to understand that some of the opacity of their algorithm isn’t deliberate obsfuscation…. I mean, Yelp is *Not* trying to be deliberately confusing or unethical, or choose specific ways for your review to be filtered. In fact, it’s random, and their hands are tied in that they, actually, have no idea how their filter is automatically filtering reviews. Originally, there was a general rule of thumb the algorithm would use, but eventually, old engineers leave, new engineers only work on parts of the algorithm… and eventually there isn’t a sole person responsible for the overall project. It’s a hard and complex situation…. and it’s difficult to explain.

    http://www.edternet.com/unclefishbits/2011/11/23/googles-search-algorithm-is-relatively-autonomous/

    Read that… it talks about the relative autonomy and complexity of the algorithm as filtering tool.

    In fact, if anyone else is still reading this, I HIGHLY AND STRONGLY recommend Eli Pariser’s “Filter Bubble”. It’s an important exploration of the complexity of the modern problems of defining our relationship to data online.

    I am sorry for what has happened, but it is more likely a result of randomness and buffoonery than a mitigated smear attack against your business.

Leave a Reply

  • (will not be published)

Trackbacks and Pingbacks:

  1. Uncle Fishbits » Blog Archive » Yelp vomit. I am not organizing this, nor am I reading through it. It is a mash of thoughts on user generated content sites.

    [...] The forest is an amalgamation of healthy trees, unhealthy trees, neutral ones, etc…. and that forest ends up being really big. I used to waste all my time with individual reviews and the algorithmic problems, etc [...]