FULL SPECTRUM WARRIOR: HOW THE INSTITUTE FOR CREATIVE TECHNOLOGIES BUILT A COGNITIVE TRAINING TOOL FOR THE XBOX
James H. Korris The Institute for Creative Technologies, University of Southern California Marina del Rey, CA 90292 1. ABSTRACT Microsofts popular game console, the Xbox, combined the possibility of compelling training efficiencies with formidable obstacles to development, both in terms of the business model, the limitation of the Windows 2000 computer inside it and the systems standard humanmachine interface. In its mission to leverage the capabilities of the entertainment industry to develop next-generation simulation tools, the Institute for Creative Technologies turned to this inexpensive, powerful platform for its Squad level cognitive tactical trainer. This paper will describe the pedagogical and technological challenges and unique processes that translated Squad level command doctrine to a commercial game interface and a cost-effective, universally-accessible computational medium 2. INTRODUCTION Founded in August 1999, the Institute for Creative Technologies (ICT) is a University Affiliated Research Center at the University of Southern California. Its mission focuses on the development of enabling technologies for immersive virtual reality that may be used in creating the next generation of virtual training applications for the US Army. In addition to the intellectual resources of the university, the ICT is intended to leverage the technologies and techniques of the US entertainment industry, particularly filmed entertainment and interactive entertainment software. In 1997, a National Research Council study1 suggested that, in certain respects, the entertainment industry had surpassed military simulation, historically, the innovator in computational simulation. By refining story, character, graphical and sound qualities, entertainment product developers had, for their very survival, honed their ability to attract and hold users attention with compelling content. The ICT was an effort to capture that corpus of expertise and apply it to the development of the US Armys simulation needs. It followed that platforms for the ICTs research and prototype applications would fall broadly into two groups: (a) novel, often large-scale interfaces to display, for example, life-sized entities driven by high-end rendering solutions and (b) readily available, generally inexpensive COTS hardware. It was in this context that Microsoftss Xbox, a popular game console, was considered as the release platform for an application involving the Armys smallest Light Infantry maneuver unit: two Fire Teams constituting a nine Soldier Squad. The application came to be known as Full Spectrum Warrior (FSW), the first military training application published for a commercial game console. 3. COGNITIVE TRAINING CHALLENGE Since the fall of the Soviet Union, US Army missions have changed with an emphasis on critical thinking and decision-making even at the lowest echelons. Operations in urban terrain against asymmetric, insurgent or transnational enemies often put a great burden of responsibilities on the youngest Soldiers. The ICT sought virtual training opportunities that would exercise a critical faculty of judgment in challenging, real-time circumstances. A Southwest Asian urban and ex-urban terrain environment was developed with an asymmetric enemy in the overarching context of a peacekeeping mission. Missions are simple and, due to the limitations of the computational platform, model the behaviors of a single Squad with a roughly equal number of enemy and civilians. The maximum number of autonomous entities present at any given time in the simulation is approximately forty. FSW puts the player in the role of the Squad Leader. However, the primary audience for FSW is the Soldiers in a Squad, not the Squad Leader himself. By taking the bosss job, Soldiers might deepen their appreciation for the correct execution of dismounted battle drills in the urban context. Moreover, the Squad Leaders role has a greater range of decision-making responsibility and authority than Fire Team members and consequently constitutes a greater cognitive challenge than the role of the individual Fire Team member. Working with Subject Matter Experts from the United States Army Infantry Center at Fort Benning, care was
taken to adhere faithfully to schoolhouse TTP and doctrine in the behaviors of the Soldiers under the players command. In cases where there was no single unambiguous approach to accomplishing an objective (e.g. room clearing), efforts were made to provide editable choices to the user. To emphasize the cognitive decision-making aspects of the experience, the player only issues orders to on-screen characters. The player has no weapon: a very unusual choice in a military-themed, entity level simulation. In the interest of developing decision-making skills, mechanical skills, e.g. firing a weapon, dealing with equipment malfunctions, were deemed a distraction. Also, the player cannot be God and freely move about the environment. He moves with his troops; his situational awareness is limited by their movements and perceptions. 4. THE XBOX PLATFORM Microsofts Xbox game console, introduced in November 2001, runs a modified version of Windows 2000 (with DirectX 8.0a) that includes security features that allow Microsoft to rigorously control access to the platform. The Operating System memory footprint in RAM is less than 3MB. It is, like other game consoles, a plug and play component that is intended to have the stability and ease-of-use of an appliance. It weighs 3.86 kg and measures 31 cm X 27 cm X 10 cm. It arrives equipped to display on a standard definition NTSC television (maximum resolution 640 X 480), but with optional cables it can display at High Definition television resolution (1920 X 1080). Audio interconnects range from RF encoded television mono to AC-3 5.1 optical SPDIF. Its current MSRP is $149.99. Xboxs 800 internal components include an Intel custom 733MHz Pentium III with a 133 MHz Front Side Bus and 64 MB of Micron DDR SDRAM. The graphics components manufacturer, nVidia, developed a custom 250 MHz (XGPU) graphics processor for the system. nVidia claims 125 M/second polygons and a maximum anti-aliased pixel fill rate of 4.0 G/second. Xbox comes equipped with an 8GB or 10GB hard drive. There are no user-serviceable parts in the system. While the specifications are not impressive for modern desk-top systems, the price represents a very attractive value. With complete control over the Operating system, drivers and components, the Xbox is optimized for gaming applications. The choice of Xbox for the FSW platform was driven by several considerations. First, with a standard-equipped

hard drive, the system offered persistence with the ability to capture a session and review in AAR (After Action Review). Second, amongst all game consoles, only Xbox is produced by an American company. Third, its graphical and computational performance matched or exceeded the competition. Finally, developing applications for the Xbox system is, from the standpoint of numerous developers, somewhat easier than writing for Sonys Emotion Engine system in PS2. From the user standpoint, leveraging Xbox meant exploiting a skill set that numerous young Soldiers bring with them to service in the US Army. The majority of new recruits are, at a minimum, casual gamers; a significant percentage are serious gamers. Since there is overall intentional consistency between console applications in application management, menu systems and overall system operation, there is a potential efficiency in training for training by developing applications for what is already a familiar simulation environment. 5. BARRIERS TO ENTRY: THE XBOX BUSINESS MODEL The efficiencies arising from Xbox publication do not come without hurdles. Unlike developing applications for personal computers, a developer does not simply write and compile code, make copies and distribute them freely. Access to the Xbox platform, as noted previously, is rigorously controlled by Microsoft. In this respect, Microsoft does not differ from other game console manufacturers. These are proprietary, incompatible systems which are developed at considerable expense, with estimates of up to $125 lost on every Xbox sold2. Profits are made from buyers who purchase discs over time, with each disc paying a platform license to Microsoft of approximately $10. Given this business model, it is not surprising that Microsoft has concerns about consoles used in circumstances that limit the purchase of new content. If a developer created a business productivity suite for Xbox with email, word processing and spread sheet applications utilizing the Datel Xbox QWERTY keyboard, he would pose a serious threat to Microsofts Operating System and productivity software businesses. If he used the Xboxs 100BT Ethernet port to connect to an office subnet, he could overcome the platforms storage limitations with server-based storage. A supervised workplace would limit game play opportunities, so no games would likely be purchased or used. This kind of scenario makes console manufacturers cautious about the kinds of applications they certify.

THE FSW SOLUTION

The ICT approach in FSW went to one of the basic tenets of the Institutes mission: leveraging Southern Californias regional capability in entertainment content creation. Given the abundance of creative talent available on a project-by-project basis in the area, there was no need to duplicate the capability at the ICT. Rather, arrangements were made to contract with a developer (Pandemic Studios) and a special effects house (Sony Imageworks) to execute plans developed at the ICT. In this way, with minimal permanent staffing, the ICT was able to conceive, formulate, direct and manage the process and provide the greatest value-add to the overall process. As a matter of course, Microsoft reserves the right to deny access to its platform to any developer. Put differently, no console manufacturer will pre-approve an application. This serves to preserve a standard of product content including application stability, user interface and constraints on language, nudity and violence. Additionally, it protects the platform producer from the single-disc scenario described above. Early on, the ICT bound its contractors to a milestone requiring commercial publication of a version of FSW, thus avoiding a publication shut-out. The Armys FSW, it was determined, could be hidden on the disc with an unlock code made available to Soldiers. 7. THE INTERFACE Since the ICTs tasking on FSW included the use of the standard Xbox configuration, there were serious design challenges arising from the platforms human-machine interface. A standard Xbox controller has two thumb-controlled joysticks, a directional key, two proportional trigger keys (mounted below) and eight pushbuttons: two left and six right. There is no keyboard and consequently no convenient way to enter text. There is no mouse, so pointing and clicking, while possible, is more awkward than with desktop and laptop systems (see Figure 1):
Figure 1: Xbox Controller S All simulation is, to some extent, an abstraction of the real world. If FSW had been a First Person Shooter simulation, the user interface would have been a simple matter. Pointing, shooting and steering all map readily to console controllers. But in FSW, the player only issues commands to characters visible on-screen and, as noted previously, does not carry a weapon. The solution to the challenge of creating meaningful interaction with the simulations entities came in part from what was dubbed the Action Cursor. Moving the left joystick in FSW instantiates a cursor which anticipates movement orders from a Squad Leader to a Fire Team. These choices include an Object Formation, Corner Formation, Door Formation, Breach Door/Building, etc., and are derived from the physical context of the cursor orientation (see Figure 2).

Figure 2: Action Cursor shown on street Orders are given to Fire Teams; switching between Teams is accomplished by pressing the red B button. Once the Action Cursor location is placed in an acceptable location with an implied formation/action, the green A button executes the order. Bounding overwatch using buddy teams is ordered by pressing and
holding the A button during a movement order. The full interface command set is shown in Figure 3.
Figure 5: Nudge interface command set Figure 3: FSW default controls The directional key accesses the nudge system. It was determined that typical Squad Leader interactions include the physical nudging of individual Soldiers positions and orientations. The nudge system begins with the identification of a Fire Team member. Directional key mapping of the four Fire Team members is visible in the lower-left corner of the screen at all times. Grenade launch trajectories are also accessed through the nudge system. Once a Fire Team member has been selected for a nudge, the camera switches to a close-up view (see Figure 4). One interesting challenge arose from the resolution limitations of standard definition television display: optimally, 640 X 480. In the subtended field of view depicted on the main application screen, OPFOR would normally be visible in the mid far range depicted in the simulation. The solution was an iconic widget that floats over the distant OPFOR (see Figure 6) highlighting a character who might not otherwise be seen in this lowerresolution display.
Figure 6: Red icon revealing OPFOR 8. USER PARAMETERS/AAR Figure 4: Nudge view of Team Leader Nudge commands are limited: it was deemed unrealistic to give players the ability to move Soldiers around like chess pieces. A nudge can move a Soldier a few inches, change his individual cover sector or rotate him. The nudge interface command set is shown in Figure 5. FSW is a customizable training tool and has a significant number of user-adjustable parameters for the simulation: density and aggressiveness of OPFOR and civilians, wind speed and direction, training levels of Squad members (untrained soldiers make the application more difficult) and Rules Of Engagement (ROE). All of these are accessible prior to each simulation run. Additionally, Squad equipment is allocable both before and at any time during a simulation session.

For After Action Review (AAR), the entire session is captured on the Xbox hard drive and may be replayed in real or variable time with VCR-like controller functionality (see Figure 7).
Figure 9: XAI threat lines revealed in AAR playback 9. Figure 7: AAR Playback Controls In AAR mode, the camera is freely movable around the simulation terrain map. Finally, FSW includes an implementation of Explainable Artificial Intelligence (XAI) developed at the ICT by Dr. Michael Van Lent. This capability reveals entity vision cones (see Figure 8) and threat lines (see Figure 9) during AAR playback. CONCLUSIONS
FSW, the first military training application published for the Microsoft Xbox, demonstrated the feasibility and utility of leveraging inexpensive COTS game consoles to solve a US Army cognitive training challenge. While the challenges of working within the limitations imposed by console manufacturers are formidable, careful planning can ensure a positive outcome. A practical and flexible user interface was developed proving that rich entity interactions were possible with standard console human-machine interfaces. A fullfeatured AAR makes FSW a potentially useful classroom tool. Finally, FSW is a further proof-of-concept for the ICTs mission to leverage the US entertainment industrys wealth of talent, techniques and technology in the development of a new generation of COTS-based cognitive simulation training tools.
Modeling and Simulation: Linking Entertainment and Defense, Washington, DC: National Academy Press, 1997. 2 Will Xbox Drain Microsoft?, David Becker, Joe Wilcox, C|Net News.com, March 6, 2001 Figure 8: Entity vision cones revealed during AAR playback

Documentation Big-selling war games may carry bigger cost By Mike Snider, USA TODAY, 6/9/2004 11:16 PM "RPG! They've got an RPG!" hollers the team leader of a four-man U.S. Army infantry squad hiding behind a beat-up car on this battle-ridden street. Ultrarealistic: Full Spectrum Warrior, which takes place in the Middle East, is based on an actual Army training simulation. THQ Pfssssft! KER-Boom! The rocket-propelled grenade overshoots the troops. "That's not the way it went in training," one soldier says, and they continue policing the streets of this Middle Eastern country. The scenario sounds like a report transmitted from a television crew in Iraq. But it's actually from Full Spectrum Warrior, a new video game for Microsoft's Xbox. The game, out less than a week, is the latest in a stream of increasingly realistic war games. And it's likely to add fuel to the controversy about games and violence. Today's ultrarealistic games such as Warrior play like an interactive version of Black Hawk Down. However, some observers are critical of the combat-gaming trend, saying the games can mislead players into viewing war as fun, particularly among the target audience of young men. (Related story: War games launch all-out sales assault) Mary Spio, 31, who served in the U.S. Air Force during the first Gulf War, thinks video games can create a bloodlust. "What we saw in the Abu Ghraib prison scandal was the tip of the iceberg - it was a glimpse of a generation of war gamers coming of age," says Spio, now the pop culture editor for One2One Magazine. "Video games that allow players to kill real human beings are desensitizing generations of American society," she says. Research into the long-term effects of video games remains foggy, although findings have long shown that watching violent TV and movies and playing violent games increases aggressive thoughts, feelings and, to a lesser extent, behaviors. "It is probably more likely to be a vicious circle, where increased interest in war leads to playing these games, which leads to more aggressive feelings and increased negative stereotypes of other cultures, which just fuels more interest in war," says Douglas Gentile, an assistant professor of psychology at Iowa State University and director of research for the National Institute on Media and the Family. Those who play the games beg to differ. "It's like playing a pickup game of basketball," says Sean Starke, 40, of Middletown, N.J., a member of the 60 or so members of Dads Playing SOCOM (www.dpsclan.org), a group of adults who play Sony's SOCOM II: Navy Seals games online. He often allows his 10-year-old daughter to play the game on PlayStation 2 with him. "It's obvious that it's a game. I don't really have fears of her Columbining." In another sign of the games' growing reach, the U.S. Army has its own online games,
America's Army, and a sequel, America's Army: Special Forces - recruitment programs played on PCs (free at www.americasarmy.com). The games have drawn more than 1.9 million players. Ubisoft, which publishes the Tom Clancy games and has Brothers in Arms, a World War II game, in the works, has a deal to publish America's Army for consoles such as the PS2 and Xbox. Full Spectrum Warrior, which grew out of Pandemic Studio's creation of an Army training simulation, is "technically, tactically very real," says retired Army captain James Ytuarte, who served as a consultant on the game. His 13-year-old son has played the game, too. "He understands it's just a game. It's entertainment." Starke agrees, but adds, "my wife jokes that when the school psychologist calls, she's handing me the phone."