SocialSync: Sub-frame synchronization in a smartphone camera network

Richard Latimer, Jason Holloway, Ashok Veeraraghavan, Ashutosh Sabharwal

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations

Abstract

SocialSync is a sub-frame synchronization protocol for capturing images simultaneously using a smartphone camera network. By synchronizing image captures to within a frame period, multiple smartphone cameras, which are often in use in social settings, can be used for a variety of applications including light field capture, depth estimation, and free viewpoint television. Currently, smartphone camera networks are limited to capturing static scenes due to motion artifacts caused by frame misalignment. Because frame misalignment in smartphones camera networks is caused by variability in the camera system, we characterize frame capture on mobile devices by analyzing the statistics of camera setup latency and frame delivery within an Android app. Next, we develop the SocialSync protocol to achieve sub-frame synchronization between devices by estimating frame capture timestamps to within millisecond accuracy. Finally, we demonstrate the effectiveness of SocialSync on mobile devices by reducing motion-induced artifacts when recovering the light field.

Original languageEnglish (US)
Title of host publicationComputer Vision - ECCV 2014 Workshops, Proceedings
EditorsCarsten Rother, Michael M. Bronstein, Lourdes Agapito
PublisherSpringer-Verlag
Pages561-575
Number of pages15
ISBN (Electronic)9783319161808
DOIs
StatePublished - 2015
Event13th European Conference on Computer Vision, ECCV 2014 - Zurich, Switzerland
Duration: Sep 6 2014Sep 12 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8926
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th European Conference on Computer Vision, ECCV 2014
Country/TerritorySwitzerland
CityZurich
Period9/6/149/12/14

Keywords

  • Camera array
  • Camera network
  • Mobile device
  • Multiple viewpoints
  • Smartphone
  • Synchronization

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'SocialSync: Sub-frame synchronization in a smartphone camera network'. Together they form a unique fingerprint.

Cite this