Testing Criteria

We'll change a few things about these mission so unfortunately we'll have to ask you to re-test them after the next beta. (Don't worry it is a minor change, at least where testing is concerend.)

However this gives me the chance to specify the criteria a mission has to fulfill to get a GREEN light:

• The command briefing (If present) has to be final. No text errors, no problems with the voiceovers or animations.[/*:m]
• The briefing must not have any problems (stuttering video is NOT a mission problem but an engine problem. Do report it, but in a separate thread. Fixing the engine problem doesn't require us to touch the missions or the cutscenes themselves). The briefings must be logical and it must serve its purpose to explain the mission objective.[/*:m]
• The objective screen must not allow ship or weapon selection up to Mission 24. From and Mission 25 on (inclusive) those screens must be available. They should only allow you to change missiles (yes we know you can remove all primaries, but that's ok. You shouldn't however have any other primaries available or even worse, be able to mount them.[/*:m]
• The mission objectives need to make sense to you. Check the F4 screen during the mission for changing objectives and check those too. Also check for grammar or spelling errors here.[/*:m]
• The mission itself must play out correctly. This includes general gameplay, mission specific AI behavior, voiceovers (natural dialogue flow and timing), text lines, head animations.[/*:m]
• All mission PATHS need to work. We'll post detailed information about all possible paths in each thread. Please test every single onw of those before greenlighting the mission.[/*:m]
• After enemies are gone, do ships behave as expected? Do wingmen continue on course or form on your wing? Do capital ships do something that makes sense? Do they return into battlegroup formation, do convoys jump out, do transports continue docking? Stick around at such nav points and watch what happens![/*:m]
• Are all escort list entries making sense? Are all ships present, are ships present that shouldn't be? Does their sorting make sense?[/*:m]
• Do the HUD markers for each NAV point show up?[/*:m]
• Do the autopilot sequences work without problems?[/*:m]
• Are the autopilot sequences visually pleasing?[/*:m]
• The debriefings must be correct in terms of text, voiceovers, medal awards/promotions and also recommendations for lost missions. Please test the debriefing for all paths![/*:m]
• The cutscene must play (if available)[/*:m]
• The mission must advance in the campaign as designed. This means the game must force you to replay a mission if it was lost sometimes. We will specify which missions should not allow you to proceed if lost.[/*:m]
• The missions must add the correct entries to the tech room. Including ships and intel. We'll post which mission should add what (this also only works in campaign mode. Restarting the campaign will reset the techroom)[/*:m]
• The cutscenes must become available in the techroom once played.[/*:m]
• Does the launch script work correctly?[/*:m][/list:u]

Any GREEN light needs to be accompanied by a post commenting on this:

• Command briefing[/*:m]
• Briefing[/*:m]
• Objectives[/*:m]
• Mission flow[/*:m]
• Mission paths[/*:m]
• Wingmen behavior[/*:m]
• Comms (text and voice)[/*:m]
• Escort list entries[/*:m]
• Autopilot HUD[/*:m]
• Autopilot sequence cameras[/*:m]
• Traitor ending[/*:m]
• Debriefing[/*:m]
• Cutscene[/*:m]
• Campaign flow[/*:m]
• Tech room entries[/*:m]
• Launch script[/*:m][/list:u]

  using this template. We want short comments on ALL of these, showing us you tested it all INLCUDING any stuff that we post as important in the mission specific thread's first post.

  If you GREEN a mission without commenting on all of that we will delete your green light and mark everything missing from your post in red. Please add those things and/or retest, then change the post and add your green light again.

  We'll collect GREEN lights from everyone in the first post and a mission will be marked as GOLD once everyone has given it a green.

Stinger wrote:What is the time schedule for each sector?

Until the next beta. We need to greenlight one batch each beta.

You're welcome 😊

OK, I think it's a start. The list consists of multiple sheets, one for each sector. The "red" buttons can be clicked and switched to green once you've checked the mentioned feature in-game.

The first sheet "summary" consists of tables for all sectors(as far as I know them) and a refresh button. Please note: That button has to be pressed before the actual state of your test results are shown (performance decision, visual basic can be a bitch, and I'm not very good at it).

If you find any errors, please tell me. Comments are also welcome 😊

Thanks for that checklist. Will probably help a few people.

@All: Please keep the greenlight threads clean. ONLY reports go there. if you have any questions or comments, post them in the Space Combat Thread for that mission. Every minute we have to spend on moving threads around is one less minute we can use on finalizing the game. We do not have a moderator staff that is doing this for us, we are doing this alone! So please save us the work.

Also if you see anything that we missed in the checklist, please tell us and we'll add it. Now's the time!

I also cleaned up some outdated posts in here to keep the thread easy to read.

Since we are on great time pressure, I created one (last) feature for the checklist. Next to every mission there is now a "Create report" button. After commenting and green/red-lighting all aspects of the checklist for one mission, press that button to create a green lantern mission report, ready to copy + paste into the appropriate forum thread.

That's all I could do to make the testing a little more comfortable. Now it's your turn, guys. As Keldor said, we need to finish the first batch of green lantern checks within the next week, so

Good hunting!

📎 [Attachment: checklist_green_lantern_v4.zip]

Thank you very much. 😊 (I just wished it worked with OpenOffice)

by the way, it would be pretty smart and come in handy to add links to the mantis tickets that refer to mentioned problems in our "green lighting" reports, wouldn't it?

that would be smart everywhere else in the forum as well 😉 HINT HINT HINT

O RLY?

Nah, seriously, I'll try to keep it in mind. 😛

Do NOT, repeat, NOT include the traitor debriefing text problems in every single mission as a RED. That issue is not, repeat, NOT, mission specific. So we have the report, we'll fix it, but don't redlight every single mission because of it. Please remove this issue from ALL missions and set the mission status accordingly. I had commented on this before.

Would you rather have a complete report right away or is it ok if we post a partial report and complete it at a later date by using the "Edit"-Button? (I have a partial report on Brimstone 1)

You can post a partial as long as you complete the post later.

Thx. Will do.

Edit: I have an idea: If two testers live at/near the same location, they could do the Greenlight Test together on one PC. I mean, four eyes at the same time catch more than two, don't they? What do you think about this one?

@All: From now on please add a line in your green light posts, stating what Beta you have tested it with, so we know how up to date the data is. And please re-test with the newest beta as soon as possibly and update the post.

Shall we also test if the right Squadron Insignia is being shown in the Barracks? Also, shall we restart testing Brimstone and Vega (if finished already) or shall we continue with Proxima, Loki and Nifelheim?

edit: I've got an answer from Tolwyn over PM: 1st: The Insignias should be correct but we may check them out anyways. 2nd: The testing should be restarted to check if everything has been fixed.

Several of you guys are not updating your mission reports, missed stating which version you tested with and several also don't have an "overall mission status" written down.

Please EVERYONE, correct this and update your reports.

Shall we also add the Beta Version to the pre-Cairo Reports?

If your report was still red then it needs to be tested again and if you test it again you need to give us the version with which you tested it... So yes. ALL mission reports need to be updated again and again and again until they are 100% green. I told you before, we are finalizing here, if it is green we won't touch it. What you test here will hit the public

Also, shall we test every aspect again or only the red ones?

In theory just the red ones.

What you might want to add to the testing procedure is one additional thing:

Please test if the launch script works correctly. E.g. if there is a ship positioned behind the player on the flight deck, it should start moving only if the player is outside the hangar. I've run into an issue with M33 the other day, where one of my wingmen pegged me from behind.

Tolwyn wrote: What you might want to add to the testing procedure is one additional thing:

Please test if the launch script works correctly.

Added to the list.

Do you think that it is better if the reports get reposted instead of editing the already posted ones?

FekLeyrTarg wrote:Do you think that it is better if the reports get reposted instead of editing the already posted ones?

No

Nephele 1-4 and Loki 4 (Episode 4 missions) greenlight threads are ready.

Testing criteria updated: launch script check added.

Please test if the launch script works correctly. What this means is: if there is a fighter positioned behind the player, wait in the hangar for several seconds - if he fires up his engines and rams you, this means that the launch script does not work. Most recently reported by damson in Loki 1 where Assassin would peg you from behind.

Episode 5 Green Light threads are online.

Also one condition regarding the cutscene has been added to Nifelheim 2

When you do your final playthrough, guys, please pay a very close attention to the new kilrathi takes. Two reasons: number one - they may be a bit hard to understand; number two - I had to modify message timing, so we should make sure that event chains are not broken.

Here is a list of missions in question:

Hermes:

6 9 28 37 40 41 43 46 48 49 50

Prologue:

4

Are we talking about the mission-specific messages only or are the "standard"-messages also affected in any way?

These are indeed mission specific messages with the new filter applied to zhem.

Another final testing thingy: When you close tickets like 734, would it be possible for you guys to drop a short note on how it was fixed? It would help to re-test the red ones in the final play-throughs since not every issue/resolution is clearly noticeable at once.

Regarding the Beta testing, I found some sheet I almost forgot... 😊

http://media.wcsaga.net/Stinger/betatesting.png

Initially I had one sheet of paper per 2 missions (ticking each of the greenlight checks during the playthrough). I have probably lost it in the process of moving this month. What a shame ... 😉