Home  |  Centre for Mathematical Sciences  |  LTH  |  LU

Wearable Visual Information Systems


A camera picture has traditionally been considered as a visual recording of a specific isolated moment in place and time and as a permanent link to that moment and its associated memories. However, the advent of digital technologies for capturing, storing and transmitting pictures has dramatically extended our perception of the role of photography. Indeed already the ubiquity and vastness of most people's personal photo collection has begun to stimulate the development of mostly manual tools for managing and searching large image repositories. In fact, the ease with which pictures are captured and stored today opens up many new possibilities for exploiting captured visual information for the purposes of content analysis, guiding, information access and memory enhancement. All these tasks require advanced tools of image analysis and computer vision in order to extract useful information (semi-)automatically from images. It is the purpose of this project to advance these tools and show their usefulness in a set of compelling demonstrators based on personal wearable image capturing devices.

Specific problems that we adress are for example:

  • Automatic tagging of images taken by hand held devices
  • Localization and way finding
  • Locating everyday objects
  • Visual diaries from continuously wearable cameras

Funded by the Swedish Foundation for Strategic Research .
Period: 2009-2013.
Partners: CVAP, KTH

Project publications

Below is a selection of the publications within the project.

A Brute-Force Algorithm for Reconstructing a Scene from Two Projections
Enqvist, Olof; Jiang, Fangyuan; Kahl, Fredrik, 2011, Published at: Conference on Computer Vision and Pattern Recognition

A Complete Characterization and Solution to the Microphone Position Self-Calibration Problem
Kuang, Yubin; Burgess, Simon; Torstensson, Anna; Åström, Kalle, 2013, Published at: The 38th International Conference on Acoustics, Speech, and Signal Processing

A Linear Framework for Region-Based Image Segmentation and Inpainting Involving Curvature Penalization
Schoenemann, Thomas; Kahl, Fredrik; Masnou, Simon; Cremers, Daniel, 2012, Published in: International Journal of Computer Vision

A Public Video Dataset for Road Transportation Applications
Saunier, Nicolas; Ardö, Håkan; Jodoin, Jean-Philippe; Laureshyn, Aliaksei; Nilsson, Mikael; Svensson, Åse; Miranda-Moreno, Luis; Bilodeau, Guillaume-Alexandre; Åström, Kalle, 2014, Published at: 2014 TRB Annual Meeting Workshop on Comparison of Surrogate Measures of Safety Extracted from Video Data

A Unifying Approach to Minimal Problems in Collinear and Planar TDOA Sensor Network Self-Calibration
Ask, Erik; Kuang, Yubin; Åström, Kalle, 2014, Published at: European Signal Processing Conference (EUSIPCO 2014)

Accurate Localization and Pose Estimation for Large 3D Models
Svärm, Linus; Enqvist, Olof; Oskarsson, Magnus; Kahl, Fredrik, 2014, Published at: Conference on Computer Vision and Pattern Recognition (CVPR)

An Automatic System for Microphone Self-Localization Using Ambient Sound
Simayijiang, Zhayida; Andersson, Fredrik; Kuang, Yubin; Åström, Kalle, 2014, Published at: European Signal Processing Conference (Eusipco 2014)

Automatic Compartment Modelling and Segmentation for Dynamical Renal Scintigraphies
Ståhl, Daniel; Åström, Kalle; Overgaard, Niels Christian; Landgren, Matilda; Sjöstrand, Karl; Edenbrandt, Lars, 2011, Published at: 17th Scandinavian Conference on Image Analysis (SCIA 2011)

Bayesian Formulation of Image Patch Matching Using Cross-correlation
Ardö, Håkan; Åström, Kalle, 2012, Published in: Journal of Mathematical Imaging and Vision

Bundle Adjustment using Conjugate Gradients with Multiscale Preconditioning
Byröd, Martin; Åström, Kalle, 2009, Published at: ], in Proc. The 20th British Machine Vision Conference

Combining Text Semantics and Image Geometry to Improve Scene Interpretation
Medved, Dennis; Jiang, Fangyuan; Exner, Peter; Oskarsson, Magnus; Nugues, Pierre; Åström, Kalle, 2014, Published at: International Conference on Pattern Recognition Applications and Methods

Conjugate Gradient Bundle Adjustment
Byröd, Martin; Åström, Kalle, 2010, Published at: European Conference on Computer Vision

Curvature Regularity for Region-based Image Segmentation and Inpainting: A Linear Programming Relaxation
Schoenemann, Thomas; Kahl, Fredrik; Cremers, Daniel, 2009, Published at: International Conference on Computer Vision

Discrete Optimization in Early Vision
Strandmark, Petter, 2012

Efficient Optimization Techniques for Localization and Registration of Images
Svärm, Linus, 2015

Exploiting p-Fold Symmetries for Faster Polynomial Equation Solving
Ask, Erik; Kuang, Yubin; Åström, Kalle, 2012, Published at: ICPR 2012

Fast and Reliable Two-View Translation Estimation
Fredriksson, Johan; Enqvist, Olof; Kahl, Fredrik, 2014, Published at: Conference on Computer Vision and Pattern Recognition (CVPR)

Fast and Stable Polynomial Equation Solving and Its Application to Computer Vision
Byröd, Martin; Josephson, Klas; Åström, Kalle, 2009, Published in: International Journal of Computer Vision

Generalized Convexity in Multiple View Geometry
Olsson, Carl; Kahl, Fredrik, 2010, Published in: Journal of Mathematical Imaging and Vision

Generalized Roof Duality
Kahl, Fredrik; Strandmark, Petter, 2012, Published in: Discrete Applied Mathematics

Image Segmentation and Labeling Using Free-form Semantic Annotation
Tegen, Agnes; Weegar, Rebecka; Hammarlund, Linus; Oskarsson, Magnus; Jiang, Fangyuan; Medved, Dennis; Nugues, Pierre; Åström, Kalle, 2014, Published at: International Conference on Pattern Recognition

Image Segmentation with Context
Eriksson, Anders; Olsson, Carl; Kahl, Fredrik, 2007, Published at: Scandinavian Conference on Image Analysis

Improved Object Detection and Pose Using Part-Based Models
Jiang, Fangyuan; Enqvist, Olof; Kahl, Fredrik; Åström, Kalle, 2013, Published at: Scandinavian Conference on Image Analysis

In Defense of 3D-Label Stereo
Olsson, Carl; Ulén, Johannes; Boykov, Yuri, 2013, Published at: CVPR 2013

Learning Based Image Segmentation of Pigs in a Pen
Nilsson, Mikael; Ardö, Håkan; Åström, Kalle; Herlin, Anders; Bergsten, Christer; Guzhva, Oleksiy, 2014, Published at: Visual observation and analysis of Vertebrate And Insect Behavior 2014

Minimal Solutions for Dual Microphone Rig Self-Calibration
Zhayida, Simayijiang; Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2014, Published at: European Signal Processing Conference (EUSIPCO 2014)

Minimal Solvers for Relative Pose with a Single Unknown Radial Distortion
Kuang, Yubin; Solem, Jan Erik; Kahl, Fredrik; Åström, Kalle, 2014, Published at: IEEE Conference on Computer Vision and Pattern Recognition

Minimal Solvers for Unsynchronized TDOA Sensor Network Calibration
Burgess, Simon; Kuang, Yubin; Wendeberg, Johannes; Åström, Kalle; Schindelhauer, Christian, 2014, Published at: Algorithms for Sensor Systems

Minimal Structure and Motion Problems for TOA and TDOA Measurements with Collinearity Constraints
Ask, Erik; Burgess, Simon; Åström, Kalle, 2013, Published at: 2nd International Conference on Pattern Recognition Applications and Methods

Node Localization in Unsynchronized Time of Arrival Sensor Networks
Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2012, Published at: ICPR 2012

Normalized Cuts Revisited: A Reformulation for Segmentation with Linear Grouping Constraints
Eriksson, Anders P; Olsson, Carl; Kahl, Fredrik, 2007, Published at: International Conference on Computer Vision

Numerically Stable Optimization of Polynomial Solvers for Minimal Problems
Kuang, Yubin; Åström, Kalle, 2012, Published at: European Conference on Computer Vision

Optimal Geometric Fitting Under the Truncated L2 -Norm
Ask, Erik; Enqvist, Olof; Kahl, Fredrik, 2013, Published at: CVPR 2013

Optimizing Visual Vocabularies Using Soft Assignment Entropies
Kuang, Yubin; Åström, Kalle; Kopp, Lars; Oskarsson, Magnus; Byröd, Martin, 2010, Published at: Asian Conference on Computer Vision

Partial Symmetry in Polynomial Systems and Its Application in Computer Vision
Kuang, Yubin; Zheng, Yinqiang; Åström, Kalle, 2014, Published at: IEEE Conference on Computer Vision and Pattern Recognition

Pose Estimation with Unknown Focal Length using Points, Directions and Lines
Kuang, Yubin; Åström, Kalle, 2013, Published at: IEEE International Conference on Computer Vision (ICCV2013)

Practical Global Optimization for Multiview Geometry
Kahl, Fredrik; Agarwal, Sameer; Chandraker, Manmohan; Kriegman, David; Belongie, Serge, 2008, Published in: International Journal of Computer Vision

Prime Rigid Graphs and Multidimensional Scaling with Missing Data
Oskarsson, Magnus; Åström, Kalle; Torstensson, Anna, 2014, Published at: International Conference on Pattern Recognition

Projective Least-Squares: Global Solutions with Local Optimization
Olsson, Carl; Kahl, Fredrik; Hartley, Richard, 2009, Published at: Conference on Computer Vision and Pattern Recognition

Revisiting the PnP Problem: A Fast, General and Optimal Solution
Zheng, Yinqiang; Kuang, Yubin; Sugimoto, Shigeki; Åström, Kalle; Okutomi, Masatoshi, 2013, Published at: IEEE International Conference on Computer Vision, ICCV2013

Robust Fitting for Multiple View Geometry
Enqvist, Olof; Ask, Erik; Kahl, Fredrik; Åström, Kalle, 2012, Published at: European Conference on Computer Vision

Robust Optimal Pose Estimation
Enqvist, Olof; Kahl, Fredrik, 2008, Published at: The 10th European Conference on Computer Vision

Shape Modeling by Optimising Description Length Using Gradients and Parameterisation Invariance
Karlsson, Johan; Ericsson, Anders; Åström, Kalle, 2012

Shift-map Image Registration
Svärm, Linus; Strandmark, Petter, 2010, Published at: International Conference on Pattern Recognition (ICPR)

Simultaneous Multiple Rotation Averaging using Lagrangian Duality
Fredriksson, Johan ; Olsson, Carl, 2012, Published at: Asian Conference of Computer Vision

Single Antenna Anchor-Free UWB Positioning based on Multipath Propagation
Kuang, Yubin; Åström, Kalle; Tufvesson, Fredrik, 2013, Published at: IEEE International Conference on Communications

Stratified Sensor Network Self-Calibration From TDOA Measurements
Kuang, Yubin; Åström, Kalle, 2013, Published at: 21st European Signal Processing Conference 2013

Structure from Motion Estimation with Positional Cues
Svärm, Linus; Oskarsson, Magnus, 2013, Published at: Scandinavian Conference on Image Analysis

Supervised Feature Quantization with Entropy Optimization
Kuang, Yubin; Byröd, Martin; Åström, Kalle, 2011, Published at: IEEE Workshop on Information Theory in Computer Vision and Pattern Recognition

TOA Sensor Network Calibration for Receiver and Transmitter Spaces with Difference in Dimension
Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2013, Published at: 21st European Signal Processing Conference 2013

TOA sensor network self-calibration for receiver and transmitter spaces with difference in dimension
Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2015, Published in: Signal Processing

Tighter Relaxations for Higher-Order Models based on Generalized Roof Duality
Fredriksson, Johan; Olsson, Carl; Strandmark, Petter; Kahl, Fredrik, 2012, Published at: HiPot: ECCV 2012 Workshop on Higher-Order Models and Global Constraints in Computer Vision

Time Delay Estimation for TDOA Self-Calibration using Truncated Nuclear Norm
Jiang, Fangyuan; Kuang, Yubin; Åström, Kalle, 2013, Published at: The 38th International Conference on Acoustics, Speech, and Signal Processing

Tracking the Motion of Box Jellyfish
Kjellberg, Tobias; Oskarsson, Magnus; Palmér, Tobias; Åström, Kalle, 2014, Published at: Visual observation and analysis of Vertebrate And Insect Behavior 2014

Understanding TOA and TDOA Network Calibration using Far Field Approximation as Initial Estimate
Kuang, Yubin; Ask, Erik; Burgess, Simon; Åström, Kalle, 2012, Published at: International Conference on Pattern Recognition Applications and Methods

Verifying Global Minima for L2 Minimization Problems in Multiple View Geometry
Hartley, Richard; Kahl, Fredrik; Olsson, Carl; Seo, Yongduek, 2013, Published in: International Journal of Computer Vision

Visual Entity Linking: A Preliminary Study
Weegar, Rebecka; Hammarlund, Linus; Tegen, Agnes; Oskarsson, Magnus; Åström, Kalle; Nugues, Pierre, 2014, Published at: AAAI 2014 Workshop on Cognitive Computing for Augmented Human Intelligence

 

Questions: webmaster
Last updated: 2008-11-26

Centre for Mathematical Sciences, Box 118, SE-22100, Lund. Phone: 046-222 00 00