In this assignment, you will create a simple experience of some form that uses multiple markers (at least 3), one fixed and at least two held or movable.  You should imagine an interesting marker-based experience, and then define a simple fragment of an experience that is evocative or indicative of the full experience.  You only need to implement the fragment that satisfies the technical requirements below.  The goal of this assignment is to give you practical and technical experience working with markers.

You should envision an experience, possibly a very very simple one, where there is a fixed trackable target.  Ideally, this would be a NFT target (such as the next version of Argon will support), but for this assignment, you will use a marker.  You could imagine this marker being on the wall, the floor, a desk, a map, a book, etc.  The experience “lives” on that marker, in 3D, situated on and above it.   The maker must be sized such that it can be printed on an 8.5 x 11 inch piece of paper.

The additional 2 or more markers should be sized such that they can be held easily, such as being smaller than playing cards.  They should be used in at least two different ways.

1) as a token or trigger of some form.  Technically, what this means is that when a marker of this form is seen, it’s appearance is recognized by your code and some state changes as a result.  For example, in a game, it could be a power-up or result in the addition of a new ability to a game character.  In a advertising application, it could act as a coupon or purchasing code.  No content needs to be registered continuously with this kind of marker (one would expect it’s behavior to be drawn on the paper marker itself), but the experience on the fixed target should visibly react to the appearance of the token marker.

2) as a continuous interactor.  Technically, this kind of marker should have 3D content on it, and both this content and the content on the fixed marker should be visible at the same time, and visibly react to the movement or location of the interactor marker as the user moves this marker relative to the fixed marker.  You will need to structure the physical setup of your experience such that it is feasible for both physical markers to be visible at the same time.

You will submit the following:

• A URL to your experience.
• Three copies of the physical markers (sized as required, with any decoration you want to including on them) for your experience (one for each of the instructors and TA), as well as a PDF file so they can be printed again if necessary.
• A brief description of your experience (both what you imagine the “real” experience being, and what you did), as well as step by step instruction for the grader to fully experience what you did.

Grading will be as follows:

• Display non-trivial 3D content (2D HTML in 3D using CSS3 Transforms, not all laying flat on the markers) relevant to your experience, on the fixed marker.  (4/10)
• Handle marker tracking gracefully, in particular when the marker is lost for a small amount of time due to transient occlusion or computer vision errors.  (2/10)
• Have content on fixed marker affected by trigger markers. (1/10)
• Have non-trivial 3D content on interactor makers. (1/10)
• Have content on fixed and interactor makers react to relative movement or location of the interactor relative to the fixed marker. (2/10)
• bonus:  use the orientation of your device to determine the orientation of the fixed marker to the real world, and use this knowledge in your experience in a compelling way (1/10).