Machine Intelligence for Motion Exegesis (MIME): Applying Pose Estimation and Related Technologies to Analyze Archival Performance Recordings
Audiovisual Documents Analytics
Résumé
Machine Intelligence for Motion Exegesis (MIME): Applying Pose Estimation and Related Technologies to Analyze Archival Performance Recordings
Michael Rau and Peter Broadwell, Stanford University (USA)
MIME is a collaborative effort between faculty in the Department of Theater and Performance Studies at Stanford University and developers at the Stanford Libraries’ Center for Interdisciplinary Digital Research. The project incorporates a suite of software tools for applying deep learning-based pose and gesture estimation to recorded theatrical performances, coupled with a database-backed web interface to facilitate close evaluation and refinement of data inputs and analytical outputs via interactive visualizations and built-in code notebooks. Previously unexplored, computationally oriented research inquiries in performance studies drive the collaboration; these include characterization of the range of choreographed poses within a performance, tracking the evolution of actors’ embodiment of a role, and comparative thematic and stylistic analysis of performances.
Michael Rau is a live performance director specializing in new plays, opera, and digital media projects. He has worked internationally in Germany, Brazil, the UK, Ireland, Canada, and the Czech Republic. He has created work in New York City at Lincoln Center, The Public Theater, PS122, HERE Arts Center, Ars Nova, The Bushwick Starr, The Brick, 59E59, 3LD, and Dixon Place. Regionally, his work as been seen at the Ingenuity Festival in Cleveland, OH, and the American Repertory Theatre in Cambridge, MA. He has developed new plays at the Eugene O’Neill National Playwrights Conference, the Lark and the Kennedy Center. Michael Rau is a recipient of fellowships from the Likhachev Foundation, the Kennedy Center, and the National New Play Network. He has been a resident artist at the Orchard Project, E|MERGE, and the Tribeca Performing Arts Center. He has been an associate director for Anne Bogart, Les Waters, Robert Woodruff, and Ivo Van Hove. He is a New York Theater Workshop Usual Suspect and a professor of directing and devising at Stanford University.
Peter Broadwell is a Digital Scholarship Research Developer at the Stanford University Libraries’ Center for Interdisciplinary Digital Research, where his work applies machine learning, web-based visualization, and other methods of digital analysis to complex cultural data. He has a Ph.D. in Musicology from the University of California, Los Angeles and an M.S. degree in Computer Science from the University of California, Berkeley. Recent studies in which he has participated have involved automatic translation and indexing of folklore collections in multiple languages, deep learning-based analysis of dance choreography on social media, and multimedia annotation of Japanese Noh theater performances.
Partager cette ressource
Intégrer cette vidéo
Générique
Reimagining Annotation for Multimodal Cultural Heritage
Co-chair: Clarisse Bardiot et Jacob Hart
– Production vidéo – CRÉA Université Rennes 2
Technique: Henri Huchon, Sylvain Quiviger, Leonardo Hoyos
Production: Amélie Rouleau, Clément Dufloux
Habillage, diffusion: Yann Garandel
This project has received funding from the European Research Council (ERC) under the European Union’s Horizon Europe research and innovation programme (grant agreement no. 101097091 – STAGE). Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or ERC. Neither the European Union nor the granting authority can be held responsible for them.
Rennes Métropole
Région Bretagne
Union Européenne
European Research Council (ERC)
SATT Ouest Valorisation
Maison des Science de l’Homme de Bretagne (MSHB)
Centre de Recherche Interuniversitaire sur les Humanités Numériques (CRIHN)
Laboratoire Arts: Pratiques et Poétiques (A&PP)
crédit visuel : Jean-François Peyret, Re:Walden, Avignon 2013 © Compagnie tf2 – Jean-François Peyret / Maëlla Mickaëlle
Conditions d'utilisation
Cette ressource constitue une oeuvre protégée par les lois en vigueur sur la propriété intellectuelle, dont les producteurs sont titulaires.Les dénominations ou appellations, les logos, sont, sauf indications particulières, des marques déposées.
Aucune exploitation commerciale, reproduction, représentation, utilisation, adaptation, modification, incorporation, traduction, commercialisation, partielle ou intégrale des éléments de cette ressource ne pourra en être faite sans l’accord préalable et écrit des ayants droit, à l’exception de l’utilisation pour un usage privé sous réserve des dispositions différentes voire plus restrictives du Code de la propriété intellectuelle.
La violation de l’un de ces droits de propriété industrielle et/ou intellectuelle est un délit de contrefaçon passible d’emprisonnement et d’une amende.
Les enseignants ont le droit d’utiliser librement et gratuitement cette ressource pour leurs cours.
Pour plus de renseignements contactez : lairedu@univ-rennes2.fr