{"id":426,"date":"2016-05-06T12:16:40","date_gmt":"2016-05-06T10:16:40","guid":{"rendered":"http:\/\/www.mpateraki.org\/?p=426"},"modified":"2016-05-06T13:52:26","modified_gmt":"2016-05-06T11:52:26","slug":"full-body-pose-tracking-the-top-view-reprojection-approach","status":"publish","type":"post","link":"https:\/\/mpateraki.org\/?p=426","title":{"rendered":"Full-body Pose Tracking \u2013 the Top View Reprojection Approach"},"content":{"rendered":"<p>Sigalas M., <strong>Pateraki M.<\/strong>, Trahanias P., 2015. Full-body Pose Tracking \u2013 the Top View Reprojection Approach. IEEE Transaction on Pattern Analysis and Machine Intelligence [<a href=\"http:\/\/dx.doi.org\/10.1109\/TPAMI.2015.2502582\" target=\"_blank\">doi<\/a>].<\/p>\n<p>Abstract:<\/p>\n<p>Recent introduction of low-cost depth cameras triggered a number of interesting works, pushing forward the state-of-the-art in human body pose extraction and tracking. However, despite the remarkable progress, many of the contemporary methods cope inadequately with complex scenarios, involving multiple interacting users, under the presence of severe inter- and intra-occlusions. In this work, we present a model-based approach for markerless articulated full body pose extraction and tracking in RGB-D sequences. A cylinder-based model is employed to represent the human body. For each body part a set of hypotheses is generated and tracked over time by a Particle Filter. To evaluate each hypothesis, we employ a novel metric that considers the reprojected Top View of the corresponding body part. The latter, in conjunction with depth information, effectively copes with difficult and ambiguous cases, such as severe occlusions. For evaluation purposes, we conducted several series of experiments using data from a public human action database, as well as own-collected data involving varying number of interacting users. The performance of the proposed method has been further compared against that of the Microsoft\u2019s Kinect SDK and NiTETM using ground truth information. The results obtained attest for the effectiveness of our approach.<\/p>\n<table align=\"center\">\n<tbody align=\"center\">\n<tr align=\"center\">\n<td align=\"center\" width=\"50%\"><a href=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2b.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2b-1024x256.png\" alt=\"qual2b\" width=\"540\" height=\"135\" class=\"alignleft size-large wp-image-432\" srcset=\"https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2b-1024x256.png 1024w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2b-300x75.png 300w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2b.png 1920w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><\/a><\/td>\n<td align=\"center\" width=\"50%\"><a href=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2e.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2e-1024x256.png\" alt=\"qual2e\" width=\"540\" height=\"135\" class=\"alignleft size-large wp-image-433\" srcset=\"https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2e-1024x256.png 1024w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2e-300x75.png 300w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual2e.png 1920w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><\/a><\/td>\n<\/tr>\n<tr align=\"center\">\n<td align=\"center\" width=\"50%\"><a href=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3a.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3a-1024x256.png\" alt=\"qual3a\" width=\"540\" height=\"135\" class=\"alignleft size-large wp-image-434\" srcset=\"https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3a-1024x256.png 1024w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3a-300x75.png 300w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3a.png 1920w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><\/a><\/td>\n<td align=\"center\" width=\"50%\"><a href=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3e.png\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3e-1024x256.png\" alt=\"qual3e\" width=\"540\" height=\"135\" class=\"alignleft size-large wp-image-435\" srcset=\"https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3e-1024x256.png 1024w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3e-300x75.png 300w, https:\/\/mpateraki.org\/wp-content\/uploads\/2016\/05\/qual3e.png 1920w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<ul>\n<li>Qualitative results with multiple users in the scene (<strong>video<\/strong>):<br \/>\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/jY5F2vj-QYc\" frameborder=\"0\" allowfullscreen><\/iframe>\n<\/li>\n<li>Comparative evaluation of our methodology vs. Microsoft Kinect SDK skeletonization module using ground truth data (<strong>video<\/strong>):<br \/>\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/33AsuE-WP64\" frameborder=\"0\" allowfullscreen><\/iframe>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Sigalas M., Pateraki M., Trahanias P., 2015. Full-body Pose Tracking \u2013 the Top View Reprojection Approach. IEEE Transaction on Pattern Analysis and Machine Intelligence [doi]. Abstract: Recent introduction of low-cost depth cameras triggered a number of interesting works, pushing forward the state-of-the-art in human body pose extraction and tracking. However, despite the remarkable progress, many [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-426","post","type-post","status-publish","format-standard","hentry","category-publications"],"_links":{"self":[{"href":"https:\/\/mpateraki.org\/index.php?rest_route=\/wp\/v2\/posts\/426","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mpateraki.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mpateraki.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mpateraki.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mpateraki.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=426"}],"version-history":[{"count":5,"href":"https:\/\/mpateraki.org\/index.php?rest_route=\/wp\/v2\/posts\/426\/revisions"}],"predecessor-version":[{"id":438,"href":"https:\/\/mpateraki.org\/index.php?rest_route=\/wp\/v2\/posts\/426\/revisions\/438"}],"wp:attachment":[{"href":"https:\/\/mpateraki.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=426"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mpateraki.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=426"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mpateraki.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=426"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}