{"id":44,"date":"1999-05-19T19:45:00","date_gmt":"1999-05-19T19:45:00","guid":{"rendered":"http:\/\/skyeome.net\/wordpress\/?p=44"},"modified":"2006-08-08T06:57:56","modified_gmt":"2006-08-08T06:57:56","slug":"video-tracking-project","status":"publish","type":"post","link":"https:\/\/skyeome.net\/wordpress\/?p=44","title":{"rendered":"Video Tracking Project"},"content":{"rendered":"<p><img decoding=\"async\" class=\"alignright\" style=\"width: 212px; height: 159px\" alt=\"Trails in Newman Court\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/vidTrack.jpg\" \/>In May 1999, I took architecture\/sculpture course titled &#8220;Idiosyncratic Apparatus&#8221; (Sue Reese and Donald Sherifkin).  I was interested in visualizing the paths traced out by individuals as they moved through spaces.  I wanted to make the architectural concept of the &#8220;program of circulation&#8221;  concrete and measurable.  I was also curious what might be revealed about the social psychology of individual interaction if there was a methodology for precisely recording the positions and velocities of individuals in relation to each-other and the environment they were moving through.<br \/>\n<!--more--><br \/>\nWould it be possible to construct theories of social interaction from these trajectories the same way physicists used trails  etched in bubble chambers to determine properties of elemental particles? The result was a prototype art\/sociology\/technology piece which attempted to visualize the trajectories in space and time traced out by theatergoers in &#8220;Newman Court&#8221;, a lobby outside of a theater space at Bennington college.  The project built upon previous work I did with Ruben Puentedura on object motion tracking in video.  Since then there has been very interesting work done by <a href=\"http:\/\/www.helbing.org\/\">Dirk Helbing<\/a> et al. on the physics of moving people.<\/p>\n<div style=\"text-align: center\"><img decoding=\"async\" alt=\"Stills from overhead video\" class=\"alighright\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/track1.jpg\" \/><\/div>\n<p>I set up a camera on a balcony and digitized video footage of people waiting in Newman Court to enter a drama performance.  Using a macro I wrote for Object Image (a medical image processing program, now called <a href=\"http:\/\/rsb.info.nih.gov\/ij\/\">ImageJ<\/a> ) I extracted the pixel location of the feet of each person in each frame.  This information was recorded along with the frame number to give coordinates in time and space.<\/p>\n<div style=\"text-align: center\"><img decoding=\"async\" alt=\"Fixed locations in image for coordinate transform\" style=\"width: 262px; height: 325px\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/track2.jpg\" \/><\/div>\n<p>Because the camera was not directly above and orthogonal to the floor, I needed to transform the recorded pixel data to remove the distortions of perspective. To do this I located calibration points in the image which I could compare to measured positions in the space.  Physics professor Norm Derby provided me with a set of translation equations to transform the video coordinates back into real space using the calibration points &#8211; essentially projecting the screen points onto the plane of the floor.<\/p>\n<div style=\"text-align: center\"><img decoding=\"async\" alt=\"Paths extracted\" style=\"width: 204px; height: 194px\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/track3.jpg\" \/><\/div>\n<p>I wanted to get a picture of the &#8220;phase space&#8221; of the data.  I used a 3D plotting program to visualize the time and space components of people&#8217;s movement as traces in a three dimensional cube. In these diagrams the X and Y coordinates correspond to the X and Y dimensions of Newman Court, but the Z dimension of each point indicates the amount of time which has elapsed since the beginning of the film.<\/p>\n<div style=\"text-align: center\"><img decoding=\"async\" alt=\"Overhead view (projection in space)\" style=\"width: 352px; height: 313px\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/track4.jpg\" \/><\/div>\n<p>If the cube is rotated so that the view is from &#8216;above&#8217;, the time information is collapsed.  The traces of each person&#8217;s motion appear in plan view and the patterns of traffic in the space become visible.  Most of the trails converge on the stairs down into the theater.<\/p>\n<div style=\"text-align: center\"><img decoding=\"async\" style=\"width: 424px; height: 301px\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/track5.jpg\" \/><\/div>\n<p>With a side view, motion along the X-axis is plotted against time.  From this perspective the slope of each line indicates the person&#8217;s velocity and the direction they were moving.<\/p>\n<div style=\"text-align: center\"><img decoding=\"async\" alt=\"compound projection (time and space)\" style=\"width: 358px; height: 337px\" src=\"http:\/\/www.skyeome.net\/vidTrackWeb\/track6.jpg\" \/><\/div>\n<p>If the cube is viewed at an angle where some of all three dimensions are visible, relationships appear which are more difficult to see in strict plane views.  In this diagram it is possible to pick out the lines corresponding to individuals who were moving in a group because they show fairly strict parallelism in space and time.  <\/p>\n<div style=\"text-align: center\">\n<embed src=\"http:\/\/skyeome.net\/vidTrackWeb\/newmanVideo2.mov\" height=\"185\" width=\"240\"\/><br \/>(qt video clip)<\/div>\n<p>The video clip from which the data was extracted is fairly simplistic and uninteresting and mostly serves to test the concept.  At some point I&#8217;d like to develop this into a usable methodology.For the class, I just presented a few of these examples, the data in the 3D computer software (so people could spin it to view from all angles), and physically mapped all the points onto the floor of the lobby to provide a very concrete record of the paths.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In May 1999, I took architecture\/sculpture course titled &#8220;Idiosyncratic Apparatus&#8221; (Sue Reese and Donald Sherifkin). I was interested in visualizing the paths traced out by individuals as they moved through spaces. I wanted to make the architectural concept of the &#8220;program of circulation&#8221; concrete and measurable. I was also curious what might be revealed about &hellip; <a href=\"https:\/\/skyeome.net\/wordpress\/?p=44\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Video Tracking Project<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/44"}],"collection":[{"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=44"}],"version-history":[{"count":0,"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/44\/revisions"}],"wp:attachment":[{"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=44"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=44"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/skyeome.net\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=44"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}