My disdain for Consumer Reports started in the late 70’s, when I was an audio salesman. They frequently gave lousy products a “Best Buy” rating.<\/p>\n
Back then audio was getting better on an almost daily basis.\u00a0 All receivers and amplifiers had Total Harmonic Distortion (THD) down to a fraction of a percent.\u00a0 It was amusing to hear people insist they could hear the difference between .05% THD and .03% THD.\u00a0 It was like claiming, “Most people can’t read the Surgeon General’s warning on a pack of cigarettes from 200 yards away, but I <\/em>can.”<\/p>\n With the exception of some very high-end equipment attached to high-end speakers, the difference between receivers was inaudible.\u00a0 There was one notable exception – the Pioneer SX series.\u00a0 The most popular model was the SX-780.\u00a0 The phono preamp (which was used to power an ancient artifact called “the turntable”) was as hissy as a nest of angry vipers, and the FM reception sucked.\u00a0 Virtually any other receiver in its price range was superior, and it didn’t require a trained ear to hear the difference.\u00a0 Consumer Reports gave it a Best Buy rating.<\/p>\n The most variable component in an audio system has always been the speakers.\u00a0 These days even inexpensive speakers can sound impressive, but back then there was a huge variation in sound.\u00a0 Customers who had grown up listening to crappy speakers were often most impressed with “tinkle boomers,” speakers specifically designed to impress inexperienced listeners with a shrill high-end and a thumpy bass.\u00a0 Better quality, smoother-sounding speakers provided a more realistic sound and a much better listening experience, and it took some time to explain and demonstrate the difference to customers.<\/p>\n CR’s speaker ratings were all over the place.\u00a0 They’d give equally high marks to tinkle boomers and great-sounding speakers.\u00a0 It was as if they’d thrown the model names into a hat and plucked them out at random.<\/p>\n Many customers would come into the store carrying their beloved Consumer Reports and insisting on buying based on their ratings.\u00a0 At first, I’d try to steer them away from crappy recommendations, but I learned my lesson quickly.\u00a0 People would get upset, sometimes outright angry, when you dared to contradict CR.\u00a0 One customer angrily waved a rolled-up copy of CR in my face and yelled, “These people have never lied to me!”\u00a0 From that point on, when someone came in carrying a CR I just sold them whatever crap they recommended and moved on to the next customer.<\/p>\n My next gig was selling computers, and CR continued its fine record of recommending garbage.\u00a0 The Leading Edge Model D got their best buy rating, despite the fact that after two or three hours of use it would overheat and lock up.\u00a0 I seem to recall them also giving a high rating to Coleco’s horrible Adam, but I can’t confirm that.<\/p>\n As the years went by I continued to be amused by their mistakes and stupidity.\u00a0 I remember a test of primers, where they painted samples and then tested them raw, without any paint on them.\u00a0 It should be obvious that’s not the way primers are designed to work.\u00a0 They rated a car unacceptable because if they were driving at high speeds and tried to make an abrupt turn, jamming the steering wheel in an instant, it didn’t perform well.\u00a0 Because, yeah, we all try to make 90-degree turns at 60 MPH.\u00a0 Milwaukee’s Best was at the top of their list as the best-tasting beer.\u00a0 And their over-the-top attempts to tip over a Suzuki Samurai were appalling<\/a>.<\/p>\n About ten years ago I was a computer tech for a large R&D center.\u00a0 The company’s products include home appliances.\u00a0 I was fixing a computer in an engineer’s office during a meeting.\u00a0 They were trying to decide if they should degrade the quality of their refrigerators to get a better rating from CR.<\/p>\n Engineers have been tweaking and honing the performance of home appliances for decades, so there isn’t much room for improvement.\u00a0 The performance of refrigerators or freezers varies according to the temperature of the outside environment.\u00a0 Obviously, higher temperatures require more energy.\u00a0 More importantly, a box designed to work best in a 68-75 degree range isn’t going to perform as well in 90 degrees. That would require a box designed to work in the hotter environment.<\/p>\n CR was testing in a 90-degree room, and the company’s refrigerators weren’t performing well because they were designed to be most efficient at normal room temperatures.\u00a0 The engineers were discussing the merits of redesigning their refrigerators to work best at 90 degrees, degrading their performance in more realistic temperatures, to get a better Consumer Reports rating. There was some speculation that competitors who had earned better ratings were doing just that.\u00a0 The meeting adjourned without them reaching a decision.<\/p>\n So not only was CR giving bad advice because of their crappy testing procedures, they were contributing to devices being downgraded to win their approval.<\/p>\n A few days ago I was visiting relatives, and my mother-in-law was going through her mail.\u00a0 She handed me the latest issue of Consumer Reports, saying, “I know you don’t like these guys, but they have GPS’ in this issue.” (I’ve mentioned getting one.)<\/p>\n They also reviewed freezers.\u00a0 Remembering the engineering meeting, I turned there first, and in the second paragraph they explained their testing procedures.<\/p>\n They tested them in a 90-degree room.<\/p>\n","protected":false},"excerpt":{"rendered":" My disdain for Consumer Reports started in the late 70’s, when I was an audio salesman. They frequently gave lousy products a “Best Buy” rating. Back then audio was getting better on an almost daily basis.\u00a0 All receivers and amplifiers had Total Harmonic Distortion (THD) down to a fraction of a percent.\u00a0 It was amusing […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[8,19],"tags":[],"_links":{"self":[{"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/posts\/870"}],"collection":[{"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/comments?post=870"}],"version-history":[{"count":8,"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/posts\/870\/revisions"}],"predecessor-version":[{"id":2322,"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/posts\/870\/revisions\/2322"}],"wp:attachment":[{"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/media?parent=870"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/categories?post=870"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.davehitt.com\/blog2\/wp-json\/wp\/v2\/tags?post=870"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}