MoVi: A large multi-purpose human motion and video dataset.

Large high-quality datasets of human body shape and kinematics lay the foundation for modelling and simulation approaches in computer vision, computer graphics, and biomechanics. Creating datasets that combine naturalistic recordings with high-accuracy data about ground truth body shape and pose is...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Saeed Ghorbani, Kimia Mahdaviani, Anne Thaler, Konrad Kording, Douglas James Cook, Gunnar Blohm, Nikolaus F Troje
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/d8c4f389e7d44217bb4c27653f55fac7
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:d8c4f389e7d44217bb4c27653f55fac7
record_format dspace
spelling oai:doaj.org-article:d8c4f389e7d44217bb4c27653f55fac72021-12-02T20:10:28ZMoVi: A large multi-purpose human motion and video dataset.1932-620310.1371/journal.pone.0253157https://doaj.org/article/d8c4f389e7d44217bb4c27653f55fac72021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0253157https://doaj.org/toc/1932-6203Large high-quality datasets of human body shape and kinematics lay the foundation for modelling and simulation approaches in computer vision, computer graphics, and biomechanics. Creating datasets that combine naturalistic recordings with high-accuracy data about ground truth body shape and pose is challenging because different motion recording systems are either optimized for one or the other. We address this issue in our dataset by using different hardware systems to record partially overlapping information and synchronized data that lend themselves to transfer learning. This multimodal dataset contains 9 hours of optical motion capture data, 17 hours of video data from 4 different points of view recorded by stationary and hand-held cameras, and 6.6 hours of inertial measurement units data recorded from 60 female and 30 male actors performing a collection of 21 everyday actions and sports movements. The processed motion capture data is also available as realistic 3D human meshes. We anticipate use of this dataset for research on human pose estimation, action recognition, motion modelling, gait analysis, and body shape reconstruction.Saeed GhorbaniKimia MahdavianiAnne ThalerKonrad KordingDouglas James CookGunnar BlohmNikolaus F TrojePublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 6, p e0253157 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Saeed Ghorbani
Kimia Mahdaviani
Anne Thaler
Konrad Kording
Douglas James Cook
Gunnar Blohm
Nikolaus F Troje
MoVi: A large multi-purpose human motion and video dataset.
description Large high-quality datasets of human body shape and kinematics lay the foundation for modelling and simulation approaches in computer vision, computer graphics, and biomechanics. Creating datasets that combine naturalistic recordings with high-accuracy data about ground truth body shape and pose is challenging because different motion recording systems are either optimized for one or the other. We address this issue in our dataset by using different hardware systems to record partially overlapping information and synchronized data that lend themselves to transfer learning. This multimodal dataset contains 9 hours of optical motion capture data, 17 hours of video data from 4 different points of view recorded by stationary and hand-held cameras, and 6.6 hours of inertial measurement units data recorded from 60 female and 30 male actors performing a collection of 21 everyday actions and sports movements. The processed motion capture data is also available as realistic 3D human meshes. We anticipate use of this dataset for research on human pose estimation, action recognition, motion modelling, gait analysis, and body shape reconstruction.
format article
author Saeed Ghorbani
Kimia Mahdaviani
Anne Thaler
Konrad Kording
Douglas James Cook
Gunnar Blohm
Nikolaus F Troje
author_facet Saeed Ghorbani
Kimia Mahdaviani
Anne Thaler
Konrad Kording
Douglas James Cook
Gunnar Blohm
Nikolaus F Troje
author_sort Saeed Ghorbani
title MoVi: A large multi-purpose human motion and video dataset.
title_short MoVi: A large multi-purpose human motion and video dataset.
title_full MoVi: A large multi-purpose human motion and video dataset.
title_fullStr MoVi: A large multi-purpose human motion and video dataset.
title_full_unstemmed MoVi: A large multi-purpose human motion and video dataset.
title_sort movi: a large multi-purpose human motion and video dataset.
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/d8c4f389e7d44217bb4c27653f55fac7
work_keys_str_mv AT saeedghorbani movialargemultipurposehumanmotionandvideodataset
AT kimiamahdaviani movialargemultipurposehumanmotionandvideodataset
AT annethaler movialargemultipurposehumanmotionandvideodataset
AT konradkording movialargemultipurposehumanmotionandvideodataset
AT douglasjamescook movialargemultipurposehumanmotionandvideodataset
AT gunnarblohm movialargemultipurposehumanmotionandvideodataset
AT nikolausftroje movialargemultipurposehumanmotionandvideodataset
_version_ 1718375028491288576