Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/36211
Title: Automatic Camera Control and Directing with an Ultra-High-Definition Collaborative Recording System
Authors: VANHERLE, Bram 
VERVOORT, Tim 
MICHIELS, Nick 
BEKAERT, Philippe 
Issue Date: 2021
Publisher: Association for Computing Machinery
Source: Mantiuk, Rafał; Richardt, Christian; Volino, Marco; Mustafa, Armin (Ed.). CVMP '21: European Conference on Visual Media Production, Association for Computing Machinery, (Art N° 2)
Abstract: Capturing an event from multiple camera angles can give a viewer the most complete and interesting picture of that event. To be suitable for broadcasting, a human director needs to decide what to show at each point in time. This can become cumbersome with an increasing number of camera angles. The introduction of om-nidirectional or wide-angle cameras has allowed for events to be captured more completely, making it even more difficult for the director to pick a good shot. In this paper, a system is presented that, given multiple ultra-high resolution video streams of an event, can generate a visually pleasing sequence of shots that manages to follow the relevant action of an event. Due to the algorithm being general purpose, it can be applied to most scenarios that feature humans. The proposed method allows for online processing when real-time broadcasting is required, as well as offline processing when the quality of the camera operation is the priority. Object detection is used to detect humans and other objects of interest in the input streams. Detected persons of interest, along with a set of rules based on cinematic conventions, are used to determine which video stream to show and what part of that stream is virtually framed. The user can provide a number of settings that determine how these rules are interpreted. The system is able to handle input from different wide-angle video streams by removing lens distortions. Using a user study it is shown, for a number of different scenarios, that the proposed automated director is able to capture an event with aesthetically pleasing video compositions and human-like shot switching behavior.
Keywords: CCS CONCEPTS • Computing methodologies → Neural networks;Graphics pro- cessors;Object detection;• Applied computing → Media arts KEYWORDS Video processing, automated directing, object tracking
Document URI: http://hdl.handle.net/1942/36211
ISBN: 9781450390941
DOI: 10.1145/3485441.3485648
Category: C1
Type: Proceedings Paper
Appears in Collections:Research publications

Files in This Item:
File Description SizeFormat 
cvmp.pdfPublished version11.42 MBAdobe PDFView/Open
reviews.pdf
  Restricted Access
Proof of peer review59.09 kBAdobe PDFView/Open    Request a copy
meta review.pdf
  Restricted Access
Proof of peer review50.4 kBAdobe PDFView/Open    Request a copy
Show full item record

Page view(s)

128
checked on May 21, 2022

Download(s)

14
checked on May 21, 2022

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.