I am taking a new approach to gear reviews. Remixing some ideas out there, adding my own spice, making my own trail. And because there's been a lot of talk lately about reviews, how they drive traffic; how some bloggers possibly maybe might be biased because they get the gear they write about for free; how some use stock photos; how some write a review after they only walked to the pub and so on; now seems a good time to
rethink reviews. Feel free to chip in via the comments, we can make this a community process, and who knows, maybe other bloggers also will adopt the same "ideas" when they review gear.
So thus far
my reviews were done so that I used the item in question for a about ten to fourteen days, then went to take a bunch of photos, close-ups, details, me wearing or using the item in question and then sat down and wrote the review. Looking back, my reviews have come a long way - the first review here was of the
BushBuddy Ultra and the Tibetian Titanium 1100 pot, versus the last review of the
Panasonic Lumix GF2 vs. Sony NEX-5 - A Field Report. Though it is time to rethink the whole thing, use what's good, dismiss what's bad, taking in something new.
Inspiration for this move came from several sources. First there is
Iain Harper's article, already over a month old, called "
A New Manifesto for Gear Reviewers". Iain was so kind to let me quote him, so here's his list:
1. Function - 25
How does the item work in the field, is it fit for purpose, does it have any major drawbacks in general usage. This section can be broken down into sub sections for different products eg boots (fit, waterproofness, ankle support, cushioning)
2. Features - 15
Does the item have all the necessary features, are any lacking/extraneous/not well implemented or thought through?
3. Technical innovations - 10
New materials or features that genuinely add to an item’s utility. Things it does that competitors don’t or does differently/better.
4. Quality - 10
Is an item well made and likely to last e.g. stitching, seams areas of high wear. Has it lasted well in continued use? For example, I’ve had to send back more than ten bits of gear in the last year due to manufacturing faults.
5. Value for money - 10
Is an item priced reasonably, both in comparison to competitiors and in relation to the points described above?
6. Weight - 10
Is an item an appropriate weight for its function rather than lightweight for the sake of being lightweight? Is the weight likely to have a significant impact on reasonable durability?
7. Recyclability - 5
Is an item made of materials that can be recycled? Does it use recycled fabrics as part of its manufacture?
8. Sustainability of manufacture / supply chain - 5
What is the carbon footprint of the item’s manufacture and shipment to market. Where is it made?
9. Range of sizes - 5
Is the item available in a suitable range of sizes eg varying leg lengths for each waist size
10. Availability in UK - 5
How readily available is the item in the UK? There is nothing more frustrating than reading about a fantastic piece of kit which cannot be found for love or money. (Until recently, Haglöfs was a prime example of this.)
I'm not gonna award points and rank stuff. Gear still is highly subjective -
what works for me might not work for you, and vice versa. But this gives a good idea of what to include when writing a review. I reckon
Function, Features, Technical Innovations, Quality, Weight, Sustainability and
Recyclability are good points I will include. Availability in the times of the internet shouldn't be a problem, as you're reading this right now online (unless a kind person printed this out and sent it via post to you) and there's a good chance that some webstore has the product in question and ships it to your country. I don't think sizes are a big issue either (those really tall folks and those with tiny waists and long legs will disagree). Value For Money is important, but I am not certain yet how to evaluate that (reason being that for some it is no problem to throw down 500€ for a GoreTex jacket, while others will find that lunatic).
The next point is
Time. While I often can tell already after a few days if something is great, good or rubbish, I prefer to use an item over a prolonged timeframe to make a valid evaluation. On the other hand one might have a very "hot" item where there's a lot of demand regarding information about it. First Look articles are useful for that audience, because in addition to getting a better look at the item, they can ask questions of the reviewer which she/ he then can answer, before they make a purchase. But is one still so enamored with the item after a few months of usage?
So I take inspiration from
Steven Horner's comment on Andy's post about "
The Commercialisation of Outdoor Blogging: Integrity and Authenticity?"
Having said all that, I agree with Robin and Alan that a blogger can give a better idea of how a product works over a long period of time. Most print reviewers surely don’t have the time to test each item for months, again unless you are Chris Townsend doing a long walk like the Pacific North West Trail. Unfortunately while bloggers are in a better position to test something long term the company sending the gear probably doesn’t want to wait 6+ months for you to write about it, by then the product will likely of been updated, replaced or dropped.
[
Bold is my emphasis] It is so easy to update a blog post, that I believe it makes no sense to write several articles about one item (First Look, Review, Long Term). So from now on my reviews will be "
living reviews". There will be one post, which gets updated and edited over time. This will satisfy everyones needs - the one who wants to have a first in-depth look before purchasing an item, to the one who wants a long-term usage review, and also possible suppliers of free gear will find the early exposure positive.
Additionally, I will have a few posts coming which will compare similar items (pants, shirts, jackets, etc.) directly to each other in one post, including some other measurements of comparison - I'm very excited about these as they will be fun and very informative, I think. This will be a bit along the lines of
Chris Townsend's comment:
I think the key questions are does an item perform as claimed and how does it compare to alternatives. A further point I will include in reviews in the future is a headline called "
What others say" which will link to other (trustworthy
¹) reviews online, so that you can see what others think about the item in question.
Why do I think this is the way to go? We are online. The internet is a living information source. While a print magazine like TGO Magazine (to name a mag which people think writes high quality reviews), or a "book" á la Andrew Skurka can give a very good look at an item, it is a momentarily picture. You can't interact with it. A
living review will showcase the life of an item over months and years, being constantly updated and annexed, and most importantly for you - if you have a question, you can ask me right here and have an answer not much later. It also minimizes the amount of articles, which my minimalist mind likes. Oh yeah, it is
free, as well.
Bottomline: This are just my thoughts. My reviews were always intensive work and high quality, and nothing will change in that sense. Still plenty of good photos and the occasional video. And in addition, the
living review will allow me and you to see how a product performs over its live cycle. I think that's a good idea, and it does make writing reviews for me again more appealing and fun. Finally, there's a bunch of good gear review bloggers out there, and no one is forced to adhere to any standard - that'd be pretty boring! I plotted down these guidelines for myself, let you in, and now you're free to remix, adopt, rethink or ignore. Because you don't need gear to go outdoors.
----
¹ Definition of a trustworthy review: The reviewer has trip reports on his blog/ site. Blogs/ sites which
only review gear and repeat PR Gibberish are not considered trustworthy for that matter.
----
How will you keep up-to-date with a Review? I probably will announce on
Twitter updates, might sneak the information in
The Week In Review, or you could check, very old-fashioned, the
Reviews page if you're looking for something.
I am taking a new approach to gear reviews. Remixing some ideas out there, adding my own spice, making my own trail. And because there's been a lot of talk lately about reviews, how they drive traffic; how some bloggers possibly maybe might be biased because they get the gear they write about for free; how some use stock photos; how some write a review after they only walked to the pub and so on; now seems a good time to
rethink reviews. Feel free to chip in via the comments, we can make this a community process, and who knows, maybe other bloggers also will adopt the same "ideas" when they review gear.
So thus far
my reviews were done so that I used the item in question for a about ten to fourteen days, then went to take a bunch of photos, close-ups, details, me wearing or using the item in question and then sat down and wrote the review. Looking back, my reviews have come a long way - the first review here was of the
BushBuddy Ultra and the Tibetian Titanium 1100 pot, versus the last review of the
Panasonic Lumix GF2 vs. Sony NEX-5 - A Field Report. Though it is time to rethink the whole thing, use what's good, dismiss what's bad, taking in something new.
Inspiration for this move came from several sources. First there is
Iain Harper's article, already over a month old, called "
A New Manifesto for Gear Reviewers". Iain was so kind to let me quote him, so here's his list:
1. Function - 25
How does the item work in the field, is it fit for purpose, does it have any major drawbacks in general usage. This section can be broken down into sub sections for different products eg boots (fit, waterproofness, ankle support, cushioning)
2. Features - 15
Does the item have all the necessary features, are any lacking/extraneous/not well implemented or thought through?
3. Technical innovations - 10
New materials or features that genuinely add to an item’s utility. Things it does that competitors don’t or does differently/better.
4. Quality - 10
Is an item well made and likely to last e.g. stitching, seams areas of high wear. Has it lasted well in continued use? For example, I’ve had to send back more than ten bits of gear in the last year due to manufacturing faults.
5. Value for money - 10
Is an item priced reasonably, both in comparison to competitiors and in relation to the points described above?
6. Weight - 10
Is an item an appropriate weight for its function rather than lightweight for the sake of being lightweight? Is the weight likely to have a significant impact on reasonable durability?
7. Recyclability - 5
Is an item made of materials that can be recycled? Does it use recycled fabrics as part of its manufacture?
8. Sustainability of manufacture / supply chain - 5
What is the carbon footprint of the item’s manufacture and shipment to market. Where is it made?
9. Range of sizes - 5
Is the item available in a suitable range of sizes eg varying leg lengths for each waist size
10. Availability in UK - 5
How readily available is the item in the UK? There is nothing more frustrating than reading about a fantastic piece of kit which cannot be found for love or money. (Until recently, Haglöfs was a prime example of this.)
I'm not gonna award points and rank stuff. Gear still is highly subjective -
what works for me might not work for you, and vice versa. But this gives a good idea of what to include when writing a review. I reckon
Function, Features, Technical Innovations, Quality, Weight, Sustainability and
Recyclability are good points I will include. Availability in the times of the internet shouldn't be a problem, as you're reading this right now online (unless a kind person printed this out and sent it via post to you) and there's a good chance that some webstore has the product in question and ships it to your country. I don't think sizes are a big issue either (those really tall folks and those with tiny waists and long legs will disagree). Value For Money is important, but I am not certain yet how to evaluate that (reason being that for some it is no problem to throw down 500€ for a GoreTex jacket, while others will find that lunatic).
The next point is
Time. While I often can tell already after a few days if something is great, good or rubbish, I prefer to use an item over a prolonged timeframe to make a valid evaluation. On the other hand one might have a very "hot" item where there's a lot of demand regarding information about it. First Look articles are useful for that audience, because in addition to getting a better look at the item, they can ask questions of the reviewer which she/ he then can answer, before they make a purchase. But is one still so enamored with the item after a few months of usage?
So I take inspiration from
Steven Horner's comment on Andy's post about "
The Commercialisation of Outdoor Blogging: Integrity and Authenticity?"
Having said all that, I agree with Robin and Alan that a blogger can give a better idea of how a product works over a long period of time. Most print reviewers surely don’t have the time to test each item for months, again unless you are Chris Townsend doing a long walk like the Pacific North West Trail. Unfortunately while bloggers are in a better position to test something long term the company sending the gear probably doesn’t want to wait 6+ months for you to write about it, by then the product will likely of been updated, replaced or dropped.
[
Bold is my emphasis] It is so easy to update a blog post, that I believe it makes no sense to write several articles about one item (First Look, Review, Long Term). So from now on my reviews will be "
living reviews". There will be one post, which gets updated and edited over time. This will satisfy everyones needs - the one who wants to have a first in-depth look before purchasing an item, to the one who wants a long-term usage review, and also possible suppliers of free gear will find the early exposure positive.
Additionally, I will have a few posts coming which will compare similar items (pants, shirts, jackets, etc.) directly to each other in one post, including some other measurements of comparison - I'm very excited about these as they will be fun and very informative, I think. This will be a bit along the lines of
Chris Townsend's comment:
I think the key questions are does an item perform as claimed and how does it compare to alternatives. A further point I will include in reviews in the future is a headline called "
What others say" which will link to other (trustworthy
¹) reviews online, so that you can see what others think about the item in question.
Why do I think this is the way to go? We are online. The internet is a living information source. While a print magazine like TGO Magazine (to name a mag which people think writes high quality reviews), or a "book" á la Andrew Skurka can give a very good look at an item, it is a momentarily picture. You can't interact with it. A
living review will showcase the life of an item over months and years, being constantly updated and annexed, and most importantly for you - if you have a question, you can ask me right here and have an answer not much later. It also minimizes the amount of articles, which my minimalist mind likes. Oh yeah, it is
free, as well.
Bottomline: This are just my thoughts. My reviews were always intensive work and high quality, and nothing will change in that sense. Still plenty of good photos and the occasional video. And in addition, the
living review will allow me and you to see how a product performs over its live cycle. I think that's a good idea, and it does make writing reviews for me again more appealing and fun. Finally, there's a bunch of good gear review bloggers out there, and no one is forced to adhere to any standard - that'd be pretty boring! I plotted down these guidelines for myself, let you in, and now you're free to remix, adopt, rethink or ignore. Because you don't need gear to go outdoors.
----
¹ Definition of a trustworthy review: The reviewer has trip reports on his blog/ site. Blogs/ sites which
only review gear and repeat PR Gibberish are not considered trustworthy for that matter.
----
How will you keep up-to-date with a Review? I probably will announce on
Twitter updates, might sneak the information in
The Week In Review, or you could check, very old-fashioned, the
Reviews page if you're looking for something.
The Future of Gear Reviews
lets get it on gear freaks !!!
ReplyDeleteI'm going to take all gear reviews with a grain of salt but I like the living review idea. It's kind of like the car reviews that take the car to 100,000 miles (?KM). I appreciate the detail in this set of criteria. I've read lots of reviews that seem like they were written by just taking the offending gear out of the box and looking at it. There is gear I'm not going to purchase no matter what (a la Patagonia ... I just don't need another jacket) but I appreciate gear reviews from people actually out testing it in the field.
ReplyDeleteI like it. I liked Steves point on AH blog. I dont think points are the way forward. Consensus is the way. Living review I like.
ReplyDeleteI wrote about the Trailstar recently. It was not a review yet it seems very well read and some called it a review, yet it was not. In it I pointed to two superb reviews. Colin and Steve's. If they had not wrote them and bloggers did not write gear reviews at the behest of Ryan Jorden, as he says gear reviews dilut blogs ( or do they pose a threat to his business model?) then we would we have not known about the Trailstar and how good it is? I have yet to see a magazine review or long term use report on it.
What has driven massive shifts in outdoor kit and approach to it: trail shoes, single skin tents and frameless packs to name a few is the blogs. PTC wrote about flexible crampons for trail shoes months before TGO magazine even mentioned them. Then forums pick up on things often mentioned on blogs.
Why do we all want a backcountry boiler? Well blogs like yours making us aware. TGO did a review but it still is not what is driving intrest. Yours and Devin's blog are what has us all aware of the BCB.
We know pyramid shelters work as bloggers get out there in the mountains and moors and tell us about it. Blogs are a up to date interactive tool to connect and ask questions on. I dont have many formal reviews and will update them I think this week. I will list them and I like the thinking here Hendrik. I also like first look posts. They draw attention and make you think about kit and what else is out their. Under the living review they just morph into more info as time goes by. Either way I like it.
But the bottom line is: used and abused reveals all. 30 day might sound good, but 30 separate day walks over a year wont push that rucksack like ten days back to back over the mountains on a TGO Challenge, or ten day trip to Russia. Bloggers who get out there on several trips a year are going to learn and gain insight into kit. This can then be fed into reviews and insight that is shared. Its free and you can ask questions. What magazine offers that? None I know of. Good job outdoor bloggers write about kit as well as trips.
Sounds like a good plan. Most gear reviews on the internet are not really reviews, but only another form of product presentations, though it is usually quite easy to estimate the quality of a review. The idea of a living, evolving review feels great, since it makes it possible to refine the review as it the gear in question is used more.
ReplyDeleteOn my own blog I've pretty much avoided gear reviews, since my focus is more on trips and outings, but this does not mean that I don't appreciate good gear reviews. Unfortunately, I think from the traffic point of view, quantity will always rule over quality.
I don't really read gear reviews unless I'm looking for something particular, but this does sound like a good way to shake up an aspect of outdoor blogging that I find quite tedious and predictable in its current form.
ReplyDeleteIt will definitely be good to hear more about recyclability and sustainability. It seems like manufacturers are still besotted by oil-based materials and the need to release a new and improved version every year. I think it would be good for outdoor bloggers to push more for materials that are sympathetic with the land and the landscape we value so much. Whilst outdoor gear, if looked after properly, generally lasts longer than regular street-wear, there is still plenty of room for improvement.Whilst I understand you giving fit a wide berth, I still think it is valuable to hear how close the manufacturers idea of fit meets your own expectations. If nothing else it provides a control and if you think manufacturer X undersizes, whereas manufacturer Y oversizes, then that can be valuable. I won't comment on the fact that I am that person who is tall, has a skinny waist and long legs.....!
There is definitely something going on at the moment with gear reviews and like most reviews of anything, you find good, bad and fake. And because most internet users looking for reviews can't really tell the difference, the bad and fake bring as much traffic as the good.
ReplyDeleteI like the living review concept, definitely something we will want to do here as well as put more emphasis on recyclability and sustainability. If all the real reviews could be made even better then maybe people would start to notice and learn the difference between days of testing and copy paste of some PR text?
I didn't think your reviews could get much better, but I love this new scoring system idea. I look forward to the first one! -stephanie
ReplyDeleteYet another good post. Very interesting point of view.
ReplyDeleteI don't think that giving a note on a gear will be good, it's a good preliminary work to organise ideas. I think its better to give just a point of view and every reader will just take what he wants. That's what I'm trying to do in my blog.
Considering the comparative item, I've tried this exercise and I've liked it (Golite & ID poncho comparison, in the previous TWIR, thanks for it) but it require a lots of gear & as Maz said "In order to test kit we either need to buy it or have access to it"
I do really like the way you wanna go on the "living review". I'm working on refreshing reviews of some gear, and this format pleases me well.
I'm interested by all this talk of gear reviews. I feel like I do very few gear reviews, because I own very little gear. Even when I have a piece of gear long enough to know everything about it, I can't really compare it to much else-- in the past several years I've only had one of each type of gear (one frameless pack, one tarp, one tarp-tent, one sleeping bag, two quilts, one kind of sleeping pad). Maybe I should start reviewing a few more gear items and see if it bumps up my hits as much as people say it would.
ReplyDeleteNice one Maz. I agree especially about a track record being the foundation for taking someones work seriously. What other option is there?
ReplyDeleteLove the idea of a living review as well. Using the net at its best. Another reason print media is dying.
For my part getting free gear has made me more objective. There's no substitute for the perspective having eight rain coats to choose from gives. When I have that pile in front of me, and bought none of them, I'm not attached to looking at the good points, which I might be if I spent a lot of money on something. I can be ruthless, which is whats needed.
Good post Hendrik.
Yes do try the living review idéa, sounds fresh. Make sure we get informed about the new revision (duh) and what's changed - also admitting, not deleting, inital misconceptions. External links and comparison rocks. Reviews spellbind. If I'm considering a new piece of kit I often put alot, too much, time on it. So a few accredited sources would probably help that. And there's time mentioned, long term reviews, as many as possible. 1 month, year, two years! Yes please. Everything we can to calm the industries 'new year - new product'. And last but not least, as you're already in the business, please put in an extra effort on the environmental and sustainability side. I.e. do they have a policy, a real practical effect?
ReplyDeleteSome thoughts.
Thank you once again for a provocing post, and btw your reviews are usually top notch.
A very important discussion and a very good approach, Hendrik. For www.fjaderlatt.se Martin and I discussed this a couple of years ago and landed at the following: We do not write 'tests' or 'reviews' of gear, but give our 'impressions'.
ReplyDeleteThe reason for this is that if you take the word 'test' seriously, like it should be taken and few magazines and other 'testers' do, this is hard work and takes some scientific fore-thought. One example is when BPL tested merino baselayers against synthetic ones and constructed a shirt that was split down the middle, one half merino the other synthetics.
Martin and I did not have the time for doing something we honestly could call testing, so we simply declared this and said that: These are our impressions, we have seen this in the store, or used it for a weekend or a week or...
Gear reviews are so subjective i don't feel there is a need to have a set layout. What type of review suits one doesn't suit another. We all see things differently.
ReplyDeleteAs somebody who has many years experience of using purchased gear in the outdoors rather than being part of the industry itself, i feel i have what's necessary to write a completely unbiased review on the gear i find.
I have been sent a few items from companies to review but i always make it clear to the companies that my review, good or bad must be accepted by them. I have had no problems with this, in fact the companies have been pleased to accept that sometimes items are bad and appreciate the issues being raised.
Generally i think it's ok to do a review straight out of the box. If you are in a retail outlet, looking at a product, and this is a customers first contact with the item, letting them know what your first thoughts are can be very helpful.
I then use it a while and do a second review. I think it is a good idea to go back to the initial review and do an amendment but don't change the first thoughts. It's important to let the story evolve.
Another review after a season is also the way to go due to the fact that we can change our opinions after a longer period of use. Again this is a natural progression, not a fault.
I particularly like to find alternative products to the mainstream outdoor gear. And if possible cheaper options. Not everybody has deep pockets and some are working within limited budgets. This particular section of the market are somewhat overlooked by pro gear reviewers. So this is where i see outdoors bloggers like myself can assist and share information freely without a bias.
There's room for everybody.
Items like the Super Delios water filter for example is one item i am proud to have had a hand in making a success.
Hej Henrik,
ReplyDeleteI totally agree with Nick Bramhall about the ecological consequences of modern outdoor gear. I just wrote about this subject on my new blog http://dancingbirches.weebly.com/dancing-birches-blog.html . Meaning is to start a discussion on this topic...
Greetings from Fred
Hendrik,
ReplyDeleteThe Gore Tex weekend costs a lot. I estimate - from the programme - it's value to be over €600.
Bloggers on the weekend will get to spend some time in the hills on Saturday afternoon, but Hat evening will also be spent in a hotel. During the afternoon bloggers will be able to try the gear. It might even rain. But it might not.
Let's be honest. Gore will pay out this money for a reason. How many people will be even in a position to give an honest review? None.
Companies do this because we bloggers are seen as a soft touch. We will be enthusiastic without being critical - and to be honest there will be no real chance to compare products.
You make good points about reviewing non mainstream products and reviewing gear that you have used in the field - very different to the blogger summit.
Gore seem willing to pay me to fly to Germany, book me into a good hotel for two nights and feed me good wine and food. They will show me their factory and make me into the hills for some fun.
To those who are going, have a great time. But I'm sure people can see why I'm suspicious of this.
While most outdoor bloggers are honest about what they are up to, not everyone is!
I shall leave it at that.
Some good points Martin. I don't know when PTC first wrote about flexible crampons for trail shoes but I first did in 2003 in TGO and have done so several times since. I first wrote about pyramid tents in TGO back in 2002 too.
ReplyDeleteHowever I agree that blogs aree a good interactive tool and a quick way to get information out to people. I would like to see TGO doing more with gear reviews on the website.
Of course TGO does run gear trip reports - I've done ones on the gear I used on the Southern Upland Way and the Pacific Northwest Trail in the last year. The magazine isn't free but anyone can comment on these or ask questions on the TGO forum or on my blog. And some time after the magazine goes off sale reviews do appear on the TGO website or again on my blog (I posted the PNT report recently) for free.
I think you're being a little too cycnical Andy! Press trips are not new of course. Back in the early 1980s when I started gear reviewing I went on several trips to Karrimor and Berghaus and others. Eventually the number of invites became too large and I had to be selective. Now I go to very few (just one this year, the Neoshell launch because I thought this was a very interesting product - and I had already tested it). I think companies simply look at who is writing about gear and whose work they like or think is influential and invite them on trips. I don't think they expect a test report on the basis of the trip. I remember the Paclite launch on a beautiful sunny day in the Cairngorms. We had a great day out but never needed waterproofs. I think press trips can be useful for questioning designers and marketing people and sometimes getting an initial impression of a product. They're not for testing products though and anyone attending does need to keep an open mind and ask questions and think about what they're told. And then base any review on actually using the product in the conditions its designed for and independently of the company.
ReplyDeleteAgain, I agree with what you say. I have been pushing TGO to do more on the web and I have been told this will happen. However they have an editorial staff of two who produce the magazine and look after the website.
ReplyDeleteMy website gets 10,000 hits a month and I rarely write about gear. When I do the hits soar.
I've written for Walk Highlands (route descriptions not gear) and it's an excellent site. I know the people who run it - they live not far from me. I will be very interested to see Phil's reviews.
Oh, and I wrote about Kahtoola crampons in TGO long before Eddie! My second review (in 2008) is available on the TGO website so it's there for anyone to read.
ReplyDelete"Finally, of course bloggers are the best people to test kit. That cannot be disputed."
ReplyDeleteReally? I'll dispute that. :)
What about folk who have started blogs only a few months after their first nights camp? Can someone with a a handul of days or nights experience give an informed opinion?
Assuming for a moment that such an animal exists (and I don't know of one - I am sure a thorough search of the internet will find one, but I've yet to meet him or her and I have better things to do than to look for them) their opinion is informed, by that handful of days experience. In fact, the first few days of any new discipline are often the ones where you learn the most. The question is not whether they can have an opinion, but what weight you give it which is precisely my point. Who do you trust? An exception to a principle does not disprove the principle. If you, heaving read their blog, don't rate their opinion, so be it but they are still better placed to give an impartial judgment than elite athletes sponsored by a given company or magazines where advertising revenue is crucial.
ReplyDelete"I think press trips can be useful for questioning designers and marketing people and sometimes getting an initial impression of a product." I think that's the missed opportunity - being involved with the design process by having an early impression of new products and the opportunity to make comments and suggestions.
ReplyDeleteThey do exist Maz. I've seen a few folk join forums as total newbies, and asking typical newbie questions. A few months later they have a blog, giving advice.
ReplyDeleteHow can an inexperienced person know how much weight to give to that bloggers opinion? Especially if the blog looks very professional, and gives no clue that the blogger is inexperienced.
I would rather read a review from someone who knows what they are talking about.
There are thousands of folk out there using cutting edge gear that don't have a blog btw. ;)
Mike, I take your point as I have no experience of what you say - I avoid forums like the plague. I accept of course that loads of top notch folk are using cutting edge gear but without a blog, I cannot get their opinions on it very easily.
ReplyDeleteYou'll be ok if you only read blogs. Incest is a game all the family can play. ;)
ReplyDeleteMike anytime someone wants to share a gear review with there vast experience who does not have a blog I will happily host the review on my blog. All I ask is they can prove they went out on several trips with overnight wild camps to have tested that kit.
ReplyDeleteI understand your point, but many on forums give it the big one but what do they do? one night wild camps it seems when you push the point. You get out on multi day trips and that means you are looking at kit in a different light to a day walker or just go for a wild camp person.
If GO Outdoors or Webtogs posted on a forum gear to test there would be a rush of me, me, me I go outdoors honest. But would we see the trip reports and evidence to prove it. I think many would have that but the four mile to wild camp mob would I expect struggle.
Blogs are part of the online community. Forums and Twitter. Some use all and some just Twitter or blog. No one forced or asked them to. Nor forced any to read blogs. Like a TV there is choice. Those using cutting edge kit can post on forums and share just as as we write a review. Its all about willing to share. You know where I am if you want to write a review or share a trip report.
I agree with everything you have written, Martin.
ReplyDeleteFolk on forums are the same as those on blogs. Some would rush to grab free gear, others might not.
My point (obviously not well made) is that there is no way of judging the relevance of the review,. unless you know the reviewers expererience.
Looking at blogs from the 'outside', i wonder if the blogging community is becoming a little insular. The 'online' outdoor community is a small fish in a very big pond. A small percentage of 'outdoor folk' post on forums. an even smaller percentage have blogs.
Hej Henrik,
ReplyDeleteleft a comment on your comment on http://dancingbirches.weebly.com/dancing-birches-blog.html
Greetings Fred.
How do you find current reviews predictable, Nick? What is tedious about them?
ReplyDeleteThe "bloggers-get-gear-and-review-it-positively" song is currently on many airwaves, though as has been pointed out by some of these bloggers, me included: If you get to choose something for testing, you might as well choose something you think will be good. While warning people of a bad product is definitely great, I personally don't want to use my time on a item which already from the start I think is mediocre. Better pick something good, and highlight the not so good parts of the item. Anyway; don't know how this fitted in with your comment, but now it's there =)
Some manufacturers start to use recycled materials, but it is still not enough. I imagine we might see some natural materials coming soon *silk*cough*bamboo*cough* but there's still a long road to go. Hmm, yeah. I will do my best to assess the sustainability & recyclability aspects of the products reviewed in the future. Let me know if they're to your satisfaction!
I will try to mention size where necessary...
Thanks Jörgen. Impression certainly seems to be a good approach. I wouldn't take the word "test" to serious, to be honest. Writing a normal review itself already is a lot of work, and going over the top with largely useless information doesn't add, but subtract from a review, in my opinion.
ReplyDeleteIt might also just depend on the credibility of the writer...
Thanks Daniel. You're on Twitter, so you should be able to stay on top of updates! Stuff will be edited via tags and similar, so nothing gets deleted. Check out the first living review of the Sol Ti and let me know your thoughts on it, and if the env. & sustainability stuff is good or could be better.
ReplyDeleteYou have done the AT, so you definitely would know some stuff about gear that would be of interest to other (wannabe) thru-hikers. And I wonder if you need to be able to compare it to something else - if your pants are great, they're great, and if they're crap, well, then they're crap! Anyway, give it a go and see for yourself - but be warned, it is a lot of work, a proper review.
ReplyDeleteMerci Fils! Will be nice to see the "living review" adopted by you and others, to improve on it, find new angles, and make it of the most interest to those who are in need of the item which is reviewed.
ReplyDeleteAnd comparative reviews are great, but not necessary (if it is for example not possible to compare items!).
Thanks Stephanie! First one is now online (The Jetboil Sol Ti) and it would be interesting to hear if you think it is as good as previous reviews, or still can be further refined.
ReplyDeleteThanks Chris, and I hope everyone is considering reviews in a similar way as you - with a grain of salt, and possibly searching out other reviews from people who take it outdoors.
ReplyDeleteMaybe I should make a "1000 km" tested sign of approval for really well tested & tried gear =)
Ignoring the traffic POV is important here. And I stand by my word that this site will always be about quality, and not quantity!
ReplyDeleteThe good reviews are seldom, and I try to filter the good ones out and feature them in TWIR. I think you did a nice job on the Tour de Pöyrisjärvi gear post, and surely the bikepacking folks would like to know what works and what doesn't!
I occasionally see some bad and fake reviews, but for me it is obvious that they're just that. I also am not interested in explaining my "Outdoor Career" to every new reader who might come here via Google, though I hope that the photos and text itself show that I use the gear outdoors, and not behind my desk.
ReplyDeleteThe first living review is now online, and thus far the reactions are mixed - too objective, not personal enough, is what I heard. And also the sustainability and env. part still needs improvement.
I like your reviews, Mark, and think the summary you have is great - it wraps up the article and highlights the good and bad stuff and useful info.
ReplyDeleteYour final paragraph is great! It is refreshing to hear that there's people out there who think and agree that we can do just as fine a job as the "professionals". I'm not convinced if everyone is able to differentiate between biased & even-handed ones, but that is ultimately that persons short-coming, not mine or yours. Being honest and upfront is essential, even if it means no more freebies.
"Poison goes where poison is welcome", Andy. Those who are already biased & bought won't need an invitation form a company to display that, though it might enhance it further.
ReplyDeleteThe main problem I see is that you shear everyone over the same comb. There will be a few well-trusted bloggers at this event, and while there no doubt will be a black sheep or two, to those honest guys it is slander to compare them to the biased bloggers. There are two guys going I know, who always have been and will be an integral part of the UL community - to trumpet out they'd not be honest in their review is really a blow below the belt.
Instead of shearing everyone over one comb, why not just point out those people who you say are black sheep? Radical transparency!
A set layout helps me, and possibly other reviewers, to see what is important to mention. And I agree, gear reviews are subjective; as I also agree with your other points. I'm not certain if budget gear in UL circles is so much overlooked, as there is a thriving MYOG population among us, and MYOG is inherently cheaper than the commercial gear available. Overall, you are obviously right - otherwise the outdoor industry as a whole would not be able to grow year on year as it does.
ReplyDeleteGreat to hear your take on this topic, Chris, and the extra information you highlight, especially anyone attending does need to keep an open mind and ask questions and think about what they're told is essential (and I think those bloggers with integrity already are practicing these principles).
ReplyDeleteWell said, Maz!
ReplyDelete"Phil Turner is doing gear tests on the Walk Highlands site (well he said he is)"
ReplyDeleteYup, coming end of October. But they've been in development for a little while now - after all, I wouldn't want to write something without having used the kit for a little while first would I?
I'm quite pleased with the format and the active, opinionated forum gives plenty of scope for debate/abuse. I'll be able to sneak some lightweight stuff in there in the spring to stir things up a bit - Paul and Helen the Walkhighlands Editors are dedicated trailshoe wearers after all.
Thanks for your kind words.
ReplyDeleteI think it will get very tedious if you include "recycling" and "sustainability" in every review. More interesting for me is the "fiddle factor", the ease of use in real world situations. Would you want to set up or use an item on a hillside with rain lashing down, or a strong wind blowing, for example.
ReplyDeleteI dig your definition of a trustworthy review, there seem to be a million blogs that are hundreds of posts with near untouched press release text about products, and nothing else. The idea of having a living review from someone you know actually spends a lot of time with the product is great, not just for people looking for reviews on gear but also I guess for the companies to get real world feedback on the gear.
ReplyDeleteI really don't get the big emphasis people put on free gear getting sent out for reviews though. People giving glowing feedback on shit gear will be found out just as much as people faking anything else (Terje Hellesö's recent outing as a photo faker for example). People that are genuinely interested in reading outdoor blogs read them consistently, follow them on RSS or whatever, and over time get a picture of the kind of person the author. I follow around 30 outdoors blogs and already know when a review from you, or Joe at thunderinthenight or PTC or whomever gets posted, I can pretty much take that as gospel because you guys are passionate and knowledgable about hiking and outdoors whether you paid for the gear or not. . Some of the other blogs I follow... maybe I would take what they say with a grain of salt.
I will just briefly answer on your last sentence I think we should be less sensitive about where we get kit from and listen to the people we trust.
ReplyDeleteThey funny thing about this is, as I was pondering about it the last days, that practically all other "Professional" online and print media is getting the gear for free. BPL, Gear Junkie, TGO, Outside, Retki, whatever - they all get the gear for free. They also earn handsomely with advertising - a full page ad for 4000€ or more will for example likely also ensure that your product will get its three or four stars or whatever and a favourable review in the editorial - those that deny that I call liars (TGO + Chris Townsend exempt). Why is it that no one complains about those? The majority of the folks reviewing gear online and in print spend a weekend or two with the item, snap photos, and Voilá - done is your incredibly professionally and trustworthy review.
I think it is time we stop to apply double standards, and accept that a gear review by a blogger can be just as trustworthy and professional as what was formerly considered a professional review, and don't put so much value on where the gear comes from.