You may have heard or read about Bethesda's recent statement regarding its review policy. Essentially, the publisher will no longer be sending out review code to the media – that's websites and publications like Push Square – until the day before launch. This means that we won't have time to write reviews for games like The Elder Scrolls V: Skyrim - Special Edition before they hit store shelves.
Here at Push Square, we hope that our reviews provide valuable information to you, our audience. That's our main reason for writing them in the first place. We like to think that our reviews help you decide whether or not to purchase a new release with your hard-earned cash. But even if that's not the case, then we hope that our reviews at least provide an entertaining read, and help promote intelligent discussion.
However, if we don't receive review code before a game launches, then we're forced to publish our review late – and there's no real way around this. As is the case with the vast majority of gaming websites, we have a working relationship with video game publishers like Sony, EA, Activision, and Bethesda. We rely on publishers to send us review code early so that we can write reviews – and if a publisher decides that it isn't going to send us review code, there's not much that we can do about it.
Sadly, this reluctance to distribute review code is gradually becoming the norm, rather than the exception. As such, Bethesda's aforementioned statement comes as no surprise. From a business point of view, it makes total sense, and at the end of the day, publishers like Bethesda don't owe us anything. There's no written contract that demands that they provide us with review code, and likewise, there's no guarantee that we will provide coverage for their games. Our relationship with publishers is built upon journalistic tradition more than anything – there are no secret handshakes or blood pacts here, despite what some corners of the Internet would have you believe.
Which brings us neatly to the main point of this article. We'd like to take the time to detail our review policy so that you can better understand how Push Square operates.
Debug code
Debug code refers to the unfinished version of a game. Sometimes, publishers will send out debug code to the media so that sites like ours can play upcoming games early. In order to actually play debug code, however, a debug system is required. Essentially, a debug system is a console with the ability to run unfinished code.
By its very nature, debug code is not necessarily indicative of the finished product. With that in mind, we never review games based on debug code, because that's not the product that you, our audience, may be purchasing. If we write an article that's based on an unfinished version of a game, it'll always be filed as a preview or an impressions piece, and a score will never be assigned.
Review events
Review events are private events that are held by publishers in which reviewers are invited to a specific location at a specific time to play an upcoming game. Typically, travel costs and accommodation costs are covered by the publisher.
We do not attend review events unless we're absolutely confident that doing so would benefit our audience. In our experience, review events do not provide a comfortable reviewing environment, therefore we prefer to review games either at home or in our own office. On the very rare occasion that we do attend a review event, we will always make this clear, and disclose any costs that the publisher may have covered.
Multiplayer games
If we're sent review code early for a game that places a heavy emphasis on multiplayer features but online functionality is restricted during the review process, we will refrain from awarding the game a score until we've adequately tested the title's multiplayer components. This may mean that we have to wait until the after the game's launch to publish a complete review.
Non-disclosure agreements
Commonly abbreviated to 'NDA', a non-disclosure agreement is sometimes provided by a publisher or public relations firm when distributing review code. NDAs are put in place to ensure that publications do not reveal information about the game in question before a set date – otherwise known as an embargo. Breaking this agreement can lead to disciplinary action. Offending publications can be blacklisted, for example, meaning that the publisher will no longer have anything to do with them.
If an NDA features demands that we conclude are unreasonable, we will not agree to it. This ensures that we are not bound by rules that we don't agree with, but it also means that we probably won't receive review code for the game in question.
Non-PlayStation platforms
Being a PlayStation-only site, we will never review a game based on non-PlayStation review code. If we are sent non-PlayStation review code by a publisher, we will always politely decline it, even if it means that we'll miss out on timely coverage. We may, however, base previews or impressions pieces on non-PlayStation code, though we will always endeavour to get hands-on time with Sony hardware.
If you have any questions regarding Push Square's review policy, feel free to give us a shout in the comments section below.
Comments 49
While everyone else is declaring the end of game journalism and threatening to buy Bethesda games pre-owned because it's 'anti-consumer' you guys just release a clarification of your process and you deal with it.
It's refreshing, mature and, as always, your site is one of the best out there for Playstation specific content.
@vrtualinsanity That means a lot, thank you.
Thanks for the clarification but hostly it doesn't bother me if I don't have a review day 1. If you have a review day one good if not it doesn't matter, over the years i have bought games that where absolutely DOA and now I hardly buy day 1 because of it. I would rather have a review a week late then a week early if it means you properly test and cover everything available. Unlike some sites that throw a review together in a days time and say something along the lines of "Too much.."
Hi, I usually don't leave commentss, and I especially ddon't frequent this site, but I just wanted to say a few things. I am absolutely blown away by the integrity this site seems to carry. Refusing NDA's, no Review grindhouses, etc. Without integrity, journalism becomes marketing. I truly and honestly wissh that you guys at PS can become successful enough to branch out into other platforms. If not Xbox, maybe even PC from time to time. Regardless, I'll be frequenting this site a lot more, and as an avid gamer, I and the community surrounding gaming appreciate what you guys are doing.
@zww_206 Well, our friends at Nintendo Life do us proud, too. And also, while I can't speak intimately about how others work, I know a lot of other publications honour a similar code to what we've outlined here.
Like others here I very much admire your integrity, honesty & determination to provide good games journalism. But I have to say, & this is just my own stance, I find reviews to be utterly pointless in this day & age & never read them. I don't even watch trailers any more. All I need to know is that a game is out & I'll discover everything else when I play it.
@Tenacious-P That's fair enough. The industry is changing, and we have to move with it. In fact, one change that we subtly introduced behind-the-scenes a few months back is a 1,000 word limit on reviews because we realised there isn't the appetite for long reviews anymore.
Not really a question relating to the article but I have to say it was written well. How will you be reviewing games from when the Pro comes out? Say a game runs just ok on the PS4 but runs like a dream on the Pro how will the score reflect that? Also will you be stating if the photos are of the ps4/pro versions of the game?
Twitter reviews would be good, time is so short these days and your readers are busy on the go people.
@dryrain Not decided yet, but we'll probably have an icon or bit of text explaining which console the game was reviewed on. Realistically, reviewing is already such a time consuming process that it's not feasible to have every reviewer test on two different formats.
Well done, sir. Even if I'm Italian, I follow Pushsquare because it's way more serious than all the other sites I've tried. I'm used to read books' reviews weeks after they reach the shelves so I'd love to read "updated" reviews of games already released.
EDIT: Sorry, @get2sammyb I forgot to mention you! It's you the sir I was thanking!
The reason for this is that a lot of their games have been really buggy at launch; and they don't want us to know in advance. It doesn't matter though, as their reputation precedes them.
Good to know this site and it's people have a moral compass, and follow guidelines that most would push aside just for early clicks. Much respect for that.
I was checking the phone waiting for @get2sammyb to answer me but a second heartquake in few hours just made me run out of my house... this was 6.3 Richter... I'm still shacking so I doubt I'll spend the night playing...
Dont pre-order, folks! Thats an order!!
/coat
@get2sammyb Following up on drydain, do you guys have a 4k tv in PS Towers? It really won't help to say if you are playing on a Slim or Pro if we don't know if it's a 1080p or 4k tv. Well ok 90% of any review would still be valid, but not the 10% pertaining to graphics.
@get2sammyb
Fair play dudes.
This sums you up, Robert (from everything I've seen you write). Balanced, articulate, well thought out, informative, impartial journalism refreshingly free of grudges, cynicism, bitterness or impulsiveness. You're genuinely a rarity in this business! Great ambassador. If you'd seen half of twitter today in all it's self entitledness (yes that's a word shut up alright) it's was a completely different story!
1. I would rather wait for a review on this site than read an earlier one elsewhere. I've always found the reviews to be at least concise, objective, and trustworthy, and at best, they've convinced me to try games that I wouldn't normally (like- believe it or not- destiny, which I described as borderlands minus fun prior to release. How wrong I was). It's one of the reasons, along with the stellar community, that I still browse the site daily.
2. You have an actual office? I thought push square towers was a made up place. Or Sammy's shed. Is it the shed? Do you have to pay for coffee? Does Sammy give you lot an hour for lunch or is it one of those half hour deals where you have to run into Gregg's and grab the nearest sandwich?
3. @andreoni79 stay safe, buddy.
It's reasons like this article why I put the most stock in reviews I read here as well as on NintendoLife. Keep up the good work.
Well written article and greatly appreciated. I trust reviews on this site far more than many other sites because of the points made in this piece but also because there is never any sensationalism. I don't bother with game scores but more on content and I get a real feel for a game from these reviews. I have not always agreed but I can't say that there is never any merit in what is being said. Push square reminds me a lot of good printed game journalism in the early to mid 90's.
What Bethesda's lack of review code means is that there will be huge day one patches and also shows just how important pre-order and day 1 purchases are to game sales. It doesn't always mean a stinker - in the way review embargoes on movies often do- but more that they don't want any negative criticism.
Personally, I will always wait for a review from a reputable site before a purchase unless it is something I have wanted regardless of reviews (e.g Uncharted 4).
You can't teach common sense but the wise guys can make it policy. Stupidity is thus conquered.
Much respect to you guys. You do you. If publishers don't want to send out review copies early I'll wait for the PushSquare stamp of approval.
@andreoni79 Stay safe, man. Actually heard about that earthquake during the football 'cos they mentioned some matches in Italy had been halted.
I don't comment too much here, but I just wanted to say that I love this website, and NintendoLife, for precisely this kind of reason. You are by far the best gaming website I have ever come across, I use to go to multiple to try and get any kind of news, but since I found this place, it's the only gaming website I go on with NintendoLife. The whole community, staff and commenters, are all really nice, you provide lots of news from all sorts of games, indie and AAA, and this kind of integrity is just the icing on the cake. Keep up the brilliant work
This is a completely anti-consumer move by Bethesda (I know other companies are doing the same, so I aim this at them as well). The reasoning of making out like they are doing us a favour by putting code in the hands of the public at the same time as the media is just wrong on so many levels.
I am actually hoping that this backfires somewhat on these companies with review outlets going into great detail over the negatives of a game. So rather than maybe getting a sentence on microtransactions we get a paragraph on their impact and potential future impact once patches come out. Also a thorough and detailed section on the bugs that are in the game from day one. If the review is going to be late anyway there is no reason to worry about upsetting software houses, just purchase a copy for review if they get funny.
Due to the fact games used to have to be finished before going gold we used to get reviews in magazines before release and now we can't even get them online where there is no printing or monthly release date of the media outlets who review games. It is a sad joke and I personally will continue to wait for a decent amount of information before committing to a purchase.
I know you guys are going to work through this, but it is a threat to you too and I sympathise with you over what is going on. Dealing with this, the fact companies actually target sites for review code because they think are more likely to give positive reviews and the 101 youtube reviewers must be both worrying and heartbreaking. I urge people to realise this is the impact of the pre-order culture in gaming and send a message to software houses that you are not happy with this move by stopping this practice
Bethesda makes good games but they are so anti-consumer. They also seem to have as much pride as squeenix had mid 2000's. We'll see how it works out for them.
The Push Square team as a whole though, as always very respectful to your readers. By far the best site for PS reviews, information, and opinion pieces. That's not to mention the community being miles more bearable than the internet norm.
Even more reason for people to clear their backlog - really no reason to buy day one nowadays
There's a great talk through on Good Game Pocket on YouTube about this.
I honestly don't put my stock in reviews too much, but the reviews here are always a good read. I've even read Push Square reviews for games I don't have interest in, simply because they're well written.
Whatever happens, @get2sammyb and @ShogunRok, keep doing what you do.
I don't say this to be disrespectful but I've never counted on this website to have timely reviews. There's been a few times where a game I was interested in didn't get reviewed here until a few days or so after its release. That's fine with me, again I don't come here to get an advance opinion, I visit here for news, features and thoughtful reviews.
Thanks for explaining everything. and I can't speak for everyone but I genuinely have no problem holding off buying brand new games until the reviews have been realeased, their is only a select few games I would actually buy right away, people will always be on this site because some of the stuff you post is hilarious and it's up to date news as well
Well, everyone already said what had to be said. I'd like to thank you all, and keep up the good work!
I'm only really commenting to say how nice it is to see a bunch of positive comments on an article on the Internet. Great community here, people.
My two cents: If nothing else, this move by Bethesda should remind people that they should never, ever pre-order games, unless it's a sequel to something you know like. You can wait a few days for reviews to hit, and then once they do, you can make a more informed decision.
Live stream first impressions?
Thank for this. Your policy is possibly one of the reasons Push Square is my first and primary go-to site for news and reviews on my preferred gaming platform. I'm not too worried about you getting reviews after others or on release date. I stopped pre-ordering a couple of years ago so pre-release reviews are pretty redundant other than as an opinion update on how things are progressing and developing. Look at Evolve; that was a game I was very interested in and followed the hyped build up, praise, and all those rave reviews. But I had my suspicions because there was no story, no characters to engage with. Overall it began to look like a great idea but the reality of the experience didn't have the mileage; something I suspected all along.
I think your review code and policy are spot on.
Great to read that, this is the only PS site I read due to the fact it is well written and not sensationalist, I dont always put stock in any kind of review, afterall one persons trash is another persons treasure but I do like to read them on here as it gives you a "proper" review of things.
Keep up the good work and long may you remain as my default browser homepage
I think this website is great and I really like your opinion in general (to the hell with Battleborn)! That said, Bethesda isn't the same to me anymore, while I think that Skyrim is dated and flawed as hell, it was an enjoyable RPG, even if it's weaker than Morrowind and on par with Oblivion. But after Elder of Scrolls online and Fallout 4 is hard to respect anything from Bethesda (specially after CD Projekt Red shows how to make a RPG) so without a great review I won't even bother do look at their games.
Carry on Gentlemen.
Commander Shepard push square reviews do help me decide my purchases and will do into the future give that man a beer.
Great transparency throughout. Also, hats off for being one of the only sites whereby people aren't constantly sniping at each other in the comments section. It makes me a happy chap to see gamers that aren't bigots.
It's why I always use this website. Sammy and everybody else always interact with their reader's. It's a nice touch. Also reviews are generally of a very high standard and informative. I would highly recommend this website over the likes of Gamespot and IGN, just for personality of this site alone.
@BowTiesAreCool I'd say I'm still working on my impulsiveness! But thanks for the very kind words, means a lot.
Thanks to everyone who's commented on this article, we're glad that it's had a positive response. We thought it was important to outline where we stand on all this stuff after the recent Bethesda kerfuffle.
Although this was in response to the Bethesda issue, it's great to see you guys have such a principled review policy, especially when it comes to strange things like review events.
I think it's smart for you guys not to review a debug code. Often there are lots of bugs that companies promise will be sorted, but then it ends up differently (and with Bethesda's in-house developed games that's a common occurrence!)
The only outlets I visit regularly are Push Square, Nintendo Life and Easy Allies. And they often do reviews after the fact. But I actually like it that way. It feels more measured and sensible.
And in odd cases like Dragonball Xenoverse 2 where some aspects were held back, I could still get a feel for the game and whether I would want it from what was already written.
Keep up the good work guys!
Good on you guys. Interesting comments on a couple of other sites too: Jimquisition has a couple of pieces on this and him being black flagged by EA and Squeenix, and digitallydownloaded have stated that they'll no longer review Bethesda product - that one especially is worth a read, because their points are well made - it's certainly not about the possible financial hit for them.
Reviews are nice and Push Square has some of the best, including the community here. I'd rather have a thorough review than a timely review.
I usually only go to reviews if I'm sitting on the fence about a game. If I already know I'm going to buy a game like Horizon Zero Dawn, I will avoid reviews since I don't want to hit any spoilers. Keep up the great work!
"...this reluctance to distribute review code is gradually becoming the norm..." Which is why my personal new norm is to rarely (Torment: Tides of Numenera & Divinity: Original Sin 2 being the exceptions) pre-order any games. I can wait until reviews are out. There isn't a statue, soundtrack, piece of dlc, or anything else I can think of that can persuade me to change my stance.
As I don't game online I can wait for reviews if need be. Having said that I have ordered Skyrim for day one and Persona 5 will be a day one for me.
In the old days of Amstrad gaming the writers did a main review for games and then a green-screen view paragraph/section as you had a choice between the two screens depending on the budget. Maybe a section on how the Pro improves things/differs could suffice. Of course that would mean the reviewer having to play the game twice. In the Amstrad days game were much shorter.
I have been a long time background reader, created an account just to say how vital in the industry we have teams like yourself sticking to doing the right thing. I will make my face known more here and get part of the community following on from this. Thank you all for your constant hard work.
Tap here to load 49 comments
Leave A Comment
Hold on there, you need to login to post a comment...