TU Darmstadt / ULB / TUprints

Perceiving and Predicting Semantic Keypoints

Zauss, Duncan (2021)
Perceiving and Predicting Semantic Keypoints.
École polytechnique fédérale de Lausanne and Technische Universität Darmstadt
doi: 10.26083/tuprints-00019453
Master Thesis, Primary publication, Publisher's Version

[img]
Preview
Text
Master_thesis_Duncan_Zauss.pdf
Copyright Information: CC BY 4.0 International - Creative Commons, Attribution.

Download (43MB) | Preview
Item Type: Master Thesis
Type of entry: Primary publication
Title: Perceiving and Predicting Semantic Keypoints
Language: English
Referees: Schäfer, Prof. Dr. Michael ; Alahi, Prof. Dr. Alexandre
Date: 2021
Place of Publication: Darmstadt
Collation: xi, 50, xxviii Seiten
DOI: 10.26083/tuprints-00019453
Abstract:

In this work the inherently ambiguous task of predicting 3D human poses from monocular RGB images is tackled. Two different approaches to achieve this goal are presented. Firstly, it is proposed to train a fully connected neural network to lift the 2D joint positions, that can be obtained with any off-the-shelf 2D human pose estimation algorithm, to 3D poses. Since 3D human pose datasets are limited and the joint locations of datasets for 2D human pose estimation and 3D human pose estimation often do not match, we create a synthetic ground truth. Through this mean, our model can learn to lift arbitrary sets of keypoints to 3D. Our experiments show that we achieve competitive results on the Human3.6M without using any of the Human3.6M training data. Secondly, we propose a new fully convolutional architecture that encodes 3D poses with composite fields. Our method learns 3D vectors that point from a central position of the human body to all of the humans joints in the 3D space. Our model achieves competitive results on the challenging 3D poses in the wild dataset. Furthermore, our model runs at 21 FPS which makes it real-time capable.

Status: Publisher's Version
URN: urn:nbn:de:tuda-tuprints-194534
Classification DDC: 000 Generalities, computers, information > 004 Computer science
Divisions: Study Areas > Study area Computational Engineering
Date Deposited: 10 Sep 2021 12:13
Last Modified: 09 Sep 2022 09:24
URI: https://tuprints.ulb.tu-darmstadt.de/id/eprint/19453
PPN: 485777207
Export:
Actions (login required)
View Item View Item