Researches at the University of Washington, in partnership with Facebook and Google have released a new video and research paper that presents a future of what watching football in AR might look like. The system, which is best described as tabletop football, is an end-to-end system that creates a moving 3D reconstruction of a real match which can be enjoyed with a 3D viewer or on an AR compatible device such as HoloLens.
The system was achieved by training a convolutional neural network (CNN) with hours of virtual player data captured from EA’s FIFA videogames, which was able to provide the team behind the system with the data needed to ingest a single monocular YouTube video and output it in the result seen below.
The ten page research paper goes in depth on how the team at the University of Washington, Facebook, and Google were able to bring all the data and technology together for the end result. In theory, the system would allow viewers to watch a match, be it live or recorded, in a hybrid 2D/3D AR experience that could be enjoyed from any viewing angle. The prospect of a tabletop experience similar in vein to the recently announced Motorsport Manager Mobile 3 which is also leveraging AR technology to allow users to turn a surface into a playground.
You can see an example of the system below and read the research paper from the University of Washington here.