A Semiotic approach to the HUD

This whole thing started with me attempting to do a Wenn diagram explaining Peirce's sign theory. For funnsies I tried to see if it all somehow could be applied to game HUDs. Turns out it can and works very well as a framework for analyzing HUD designs. The diagram brakes up into seven categories (A-G) and I will attempt to give one example from each.


A. Purely iconic signs: Signs that directly depict what they are representing. A photograph is a classic example of an iconic sign.

Example: The picture of Atlas in the bottom right corner, Note however that there also exists a indexial relation in this case. Also, the ammo icon in the bottom left directly depicts the kind of ammo equipped.

B. Purely indexical signs - These signs have a direct physical or causal connection to what they signify. Bread crumbs signify bread (Physical) and thunder signify lightning (causal). Almost all sound effects in games are indexical symbols.

Example: The sound signifying that shield-recharge has started in the Halo series.

C. Purely symbolic signs - All text and abstract signs are symbolic. These signs require that you know some "ground rules" in ordered to be interpreted (Like knowing how to read text or roman numerals).

Example: Text instructions in Killzone 2

D. Iconic/indexical signs - both directly depicts what they are symbolizing AND have a casual/ physical connection to something happening in the game.

Example: Blood stains in Killzone 2 - they directly depicts the blood that the player looses due to being wounded, the amount of blood is related to the amount of damage taken and the direction from where it gushes is related to the direction of the hit.

E. Symbolic/iconic signs - A sign that is depicting something, but symbolizing something else or something more general than the symbol suggests. Usually these kinds of signs are widely spread throughout our society. These signs are more abstracted than signs in from category A but still has some connection to their signifies unlike signs from category C.

Examples: A symbol depicting a floppy disk usually means "save" in general, not just "save to a floppy disk".

F. Symbolic/indexical - Thes signs are thing that change in some predetermined manner as an effect of changes in the game world - But still need to be explained to the player, unlike signs from D.Example: All the bars and indicators in Street Fighter 4 - what these bars represent and how they are connected to the actions of the player and the events in the game world is not apparent from the start.

G. Everything at once! - Maps are a classic example of a sign(system) that occupy all the three groups at once. The map is iconic in that it depicts the actual world (from a top down perspective), it is indexical in that the distances on the map correspond to real world distances according to the maps scale and symbolic in that it often use symbols that need to be interpreted using the maps legend.

Example: The map in the bottom left corner in GTA4 - The map is an accurate depiction of Liberty City (Iconic), it makes use of a lot of small icons to denote special locations (Symbolic) and it reacts to player actions by constantly rotating and scaling the map (indexical).

This is useful for analyzing HUD designs form a component level - I belive that for an immersive singe player experience HUD elements should be represented as either A B or D signs. For an engaging and fun multi-player experience however signs from C, E F and G can be used to grate effect.