A wearable-based augmented reality system has been demonstrated. An intermediate virtual space has been generated where the user can play a game of billiards, maintaining tactile interaction with the physical objects and maintaining real visual sensing while the system simultaneously overlays a graphical output to suggest shots and assist targeting. Through the use of computer vision and wearable computing, we enhance the game without encumbering the user or limiting playability. An autonomous probabilistic vision algorithm drives the Stochasticks system providing it with the necessary intelligence to make a useful contribution to the human player.