Augmented Reality (AR) is a technology that provides the seamless interaction between real and virtual environment. Since its emergence, AR has been gaining wide acceptance in various fields of application including the gaming industry. Its unique interface allows for integration of difference user interface and interaction techniques to create immersing and fun gaming experience. Motion detection which is related with visual user interface (UI) and gesture recognition is one such example. With the introduction of devices such as Microsoft Kinect and Nintendo Wii Remote, motion based technique has been fast gaining popularity as a more natural mean of user interface, which can be referred as natural user interface (NUI). This paper presents a conceptual design framework for motion detection based AR games. A physical prop is introduced as a reference point to enhance the game experience. A case scenario of a simple game will be presented to illustrate the concept. Potential design and implementation challenges will be highlighted and discussed. © 2011 Springer-Verlag.