Supplemental Material Submission
CVPR Paper ID: 791

Please find inside several videos (AVI-format, compressed with the xVid-Mpeg4 codec; playable with 
Windows Media Player in Microsoft Windows; in Linux use xine or mplayer) demonstrating our approach on 
videos taken from baseball matches. These videos are representative of the results we reported in our 
submission, and expand upon the still frames shown in our submission.

Each video shows:
1) Tracks of humans performing actions in the storyline; these are the colored rectangles surrounding
humans in video.

2) The inferred storyline* for each video, shown as a graph on the left side.

As actions occur on the screen, the corresponding action nodes in the storyline are outlined in the 
color of the track which corresponds to the action. For example, if, in the video, the pitcher is 
surrounded by a green rectangle while he is pitching, then the "Pitching" node in the graph will 
be outlined in the same color green.

Nodes for actions that are yet to have been observed have a black outline. The nodes corresponding to 
actions that have been observed are shown in gray color.

3) Automatically generated text caption at the top of the screen. The parts of the text caption relevant to 
the actions occurring at a particular frame are highlighted in red.



--
* Please Note that this is inferred storyline (i.e result of selections at the OR-nodes in the storyline model). 
All the nodes in the storyline correspond to actions in the video.