Research

Datasets & Benchmarking

IndustryShapes Dataset (ICRA 2026)

IndustryShapes is a benchmark for instance-level and novel-object 6D pose estimation in realistic industrial environments. It includes challenging textureless, reflective and geometrically complex objects captured under clutter, occlusion and varying viewpoints. Its extended set provides RGB-D onboarding sequences designed to support the evaluation of model-free methods.

Project page · Paper · Dataset · Code

CarDA: Car-Door Assembly Activities Dataset(ECCV 2024)

CarDA is a multimodal dataset for vision-based human behaviour understanding in realistic automotive assembly environments. It provides synchronised multi-camera RGB-D recordings and motion-capture data, together with annotations for assembly activities and EAWS-based ergonomic assessment. The dataset supports research on worker localisation, 3D human-pose estimation, action recognition, posture analysis and task-progress monitoring.

Paper · Dataset

harAGE: Multimodal Smartwatch-Based Human Activity Dataset (FG 2021)

harAGE is a multimodal dataset for recognising human activities from smartwatch sensor data. It supports research on wearable sensing and human-activity recognition, particularly in workplace and ageing contexts.

Paper · Dataset

f-Body: Occluded Articulated Human Body Dataset (TPAMI 2015)
An annotated dataset for human body pose extraction and tracking under occlusions.

t1
t2
t3
t4

Project page · Paper


3D Object Perception and 6D Pose Estimation

This research addresses the estimation and tracking of the three-dimensional position and orientation of objects from visual observations. Current work focuses particularly on generalisable and model-free methods that can operate on previously unseen industrial objects, including objects with limited texture, reflective surfaces, complex geometry, clutter and occlusion. Earlier work investigated multi-hypothesis tracking and model-based pose estimation.

Selected publications:

  • 6D Object Localization in Car-Assembly Industrial Environment. Papadaki, A. & Pateraki, M., 2023. Journal of Imaging, 9(3), 72.  Paper
  • IndustryShapes: A Dataset and Benchmark for Generalisable 6D Object Pose Estimation in Industrial Environments. Sapoutzoglou, P., Vaggelis, O., Zacharia, A., Sartinas, E. & Pateraki, M., 2026. In Proc. of IEEE Int.. Conf. on Robotics and Automation (ICRA)   Paper
  • Crane Spreader Pose Estimation from a Single View. Pateraki M., Sapoutzoglou P. & Lourakis M.,  2023. In Proc. of the 18th Intl. Joint Conf. on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023). Paper
  • Markerless Visual Tracking of a Container Crane Spreader. Lourakis, M. & Pateraki, M., 2021. In Proc. IEEE/CVF Intl. Conf. on Computer Vision Workshops (ICCVW). Paper
  • Robust Multi-Hypothesis 3D Object Pose Tracking. Chliveros G., Pateraki M., Trahanias P., 2013. In Proc. of the 9th Intl. Conference on Computer Vision Systems (ICVS). Paper ·  Video

3D Shape Representation

Investigate compact and continuous representations of complex three-dimensional shapes. Rather than relying on computationally intensive neural architectures or dense explicit models, the work explores functional representations that describe surface geometry through local distance fields anchored at strategically selected reference points.

Selected publications:

  • SHARC: Reference Point Driven Spherical Harmonic Representation for Complex Shapes. Sapoutzoglou, P., Terzakis, G. & Pateraki, M., 2026. In Proc. of the Intl. Conf. on Pattern Recognition (ICPR 2026)Project page · Paper · Code
  • Shape Representation Using Gaussian Process Mixture Models. Sapoutzoglou, P., Terzakis, G., Floros, G. & Pateraki, M., 2026. The Intl. Archives of the Photogrammetry, Remote Sensing and Spatial Information SciencesISPRS paper · arXiv

Human Behaviour Understanding and Human–Robot Interaction

This research uses visual and multimodal observations to understand human pose, posture, activity, attention and communicative intent. The work supports ergonomic assessment, task-progress monitoring and natural interaction between people and robotic systems in industrial and social environments.

Selected publications:

  • A vision-based framework for human behavior understanding in industrial assembly lines. Papoutsakis, K., Bakalos, N., Zacharia, A., Fragkoulis, K., Kapetadimitri, G.,  & Pateraki, M., 2026. Computer Vision and Image Understanding. Paper · arXiv · CarDA dataset
  • Detection of Physical Strain and Fatigue in Industrial Environments Using Visual and Non-Visual Low-Cost Sensors. Papoutsakis, K., Papadopoulos, G., Maniadakis, M., Papadopoulos, T., Lourakis, M., Pateraki, M., & Varlamis, I., 2022. Technologies, 10(2), 42. Paper
  • Full-body Pose Tracking – the Top View Reprojection Approach. Sigalas M., Pateraki M., Trahanias P., 2016. IEEE Transaction on Pattern Analysis and Machine Intelligence. Paper Video-01 Video-02
  • Visual estimation of attentive cues in HRI: The case of torso and head pose. Sigalas M., Pateraki M. and Trahanias P., 2015. In Proc. of the 10th Intl. Conference on Computer Vision Systems (ICVS), 6-9 July, Kopenhagen, Denmark. Paper 
  • Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation. Pateraki M., Baltzakis H., Trahanias P., 2014. Computer Vision and Image Understanding. Paper
  • Visual tracking of hands, faces and facial features of multiple persons. Baltzakis H., Pateraki M., Trahanias P., 2012. Machine Vision and Applications. Paper Video-01 Video-02

Photogrammetric 3D Reconstruction and Documentation

This research addresses the generation of three-dimensional information from images and range observations. It spans multi-image matching, digital surface modelling, surface-discontinuity preservation, point-cloud processing and the integration of heterogeneous imaging sources. These methods have been applied to built, natural and cultural-heritage environments, from airborne mapping and glacier monitoring to architectural and archaeological documentation.

Selected publications:

  • Detecting Three-Dimensional Straight Edges in Point Clouds Based on Normal Vectors. Makka, A., Pateraki, M., Betsas, T. & Georgopoulos, A., 2025. Heritage, 8, 91. Paper
  • Conventional or Automated Photogrammetry for Cultural Heritage Documentation? Tapinaki, S., Pateraki, M., Skamantzari, M. & Georgopoulos, A., 2023. The Intl. Archives of the Photogrammetry, Remote Sensing and Spatial Information SciencesPaper
  • Photogrammetric Documentation and Digital Representation of the Macedonian Palace in Vergina–Aegae.Patias, P., Paliadeli, C., Georgoula, O., Pateraki, M., Stamnas, A. & Kyriakou, N., 2007. In XXI International CIPA SymposiumPaper
  • From Point Samples to Surfaces—On Meshing and Alternatives. Boehm, J. & Pateraki, M., 2006. In ISPRS Commission V Symposium: Image Engineering and Vision MetrologyPaper
  • Adaptive Multi-Image Matching for DSM Generation from Airborne Linear Array CCD Data. Pateraki, M., 2005. Doctoral dissertation, ETH Zürich, Diss. ETH No. 15915. Publication
  • Digital Surface Modelling by Airborne Laser Scanning and Digital Photogrammetry for Glacier Monitoring.Baltsavias, E. P., Favey, E., Bauder, A., Boesch, H. & Pateraki, M., 2001. The Photogrammetric RecordPaper

Extended Reality and Immersive Environments

This research explores how immersive technologies, interactive digital environments and distributed computing infrastructures can support collaborative, educational and training applications. It includes extended-reality authoring and deployment, medical training, cultural-heritage experiences and edge–cloud support for computationally demanding immersive environments.

Selected publications:

  • Edge-driven docker registry: facilitating XR application deployment. Makris, A., Psomakelis, E., Korontanis, I., Theodoropoulos, T., Kontopoulos, I., Pateraki, M., Diou, C. & Tserpes, K., 2024. Computing, 106, 3479–3501. Paper
  • MAGES 4.0: Accelerating the World’s Transition to VR Training and Democratizing the Authoring of the Medical Metaverse. Zikas, P. et al., 2023. IEEE Computer Graphics and ApplicationsPaper
  • XR-RF Imaging Enabled by Software-Defined Metasurfaces and Machine Learning: Foundational Vision, Technologies and Challenges. Liaskos, C. et al., 2022. IEEE AccessPaper
  • Cloud for Holography and Augmented Reality. Makris, A. et al., 2021. In IEEE International Conference on Cloud NetworkingPaper
  • Mixed Reality Gamified Presence and Storytelling for Virtual Museums. Papagiannakis, G. et al., 2018. In Encyclopedia of Computer Graphics and GamesPaper