A Software Retina for Egocentric & Robotic Vision Applications on Mobile Platforms

Siebert, J. P. , Schmidt, A., Aragon Camarasa, G. , Hockings, N., Wang, X. and Cockshott, W. P. (2016) A Software Retina for Egocentric & Robotic Vision Applications on Mobile Platforms. European Conference on Computer Vision 2016, ECCV 2016, Workshop on Egocentric Perception, Interaction and Computing, Amsterdam, The Netherlands, 09 Oct 2016.

[img]
Preview
Text
148801.pdf - Accepted Version

138kB

Publisher's URL: http://www.eyewear-computing.org/EPIC_ECCV16/

Abstract

We present work in progress to develop a low-cost highly integrated camera sensor for egocentric and robotic vision. Our underlying approach is to address current limitations to image analysis by Deep Convolutional Neural Networks, such as the requirement to learn simple scale and rotation transformations, which contribute to the large computational demands for training and opaqueness of the learned structure, by applying structural constraints based on known properties of the human visual system. We propose to apply a version of the retino-cortical transform to reduce the dimensionality of the input image space by a factor of ex100, and map this spatially to transform rotations and scale changes into spatial shifts. By reducing the input image size accordingly, and therefore learning requirements, we aim to develop compact and lightweight egocentric and robot vision sensor using a smartphone as the target platform

Item Type:Conference or Workshop Item
Keywords:Egocentric vision, retino-cortical transform, smart cameras, deep learning, CNN, robot vision, biologically motivated computer vision.
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Schmidt, Dr Adam and Aragon Camarasa, Dr Gerardo and Cockshott, Dr William and Hockings, Mr Nick and Siebert, Dr Paul and Wang, xiaomeng
Authors: Siebert, J. P., Schmidt, A., Aragon Camarasa, G., Hockings, N., Wang, X., and Cockshott, W. P.
College/School:College of Science and Engineering > School of Computing Science
Research Group:CVAS in IDA
Copyright Holders:Copyright © 2016 The Authors
First Published:First published in European Conference on Computer Vision 2016, ECCV 2016, Workshop on Egocentric Perception, Interaction and Computing
Publisher Policy:Reproduced in accordance with the publisher copyright policy
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record