Jacobus J Barnard

Abstract:

Color is of interest to those working in computer vision largely because it is assumed to be helpful for recognition. This assumption has driven much work in color based image indexing, and computational color constancy. However, in many ways, indexing is a poor model for recognition. In this paper we use a recently developed statistical model of recognition which learns to link image region features with words, based on a large unstructured data set. The system is general in that it learns what is recognizable given the data. It also supports a principled testing paradigm which we exploit here to evaluate the use of color. In particular, we look at color space choice, degradation due to illumination change, and dealing with this degradation. We evaluate two general approaches to dealing with this color constancy problem. Specifically we address whether it is better to build color variation due to illumination into a recognition system, or, instead, apply color constancy preprocessing to images before they are processed by the recognition system.

Abstract:

We present a new data set of 1014 images with manual segmentations and semantic labels for each segment, together with a methodology for using this kind of data for recognition evaluation. The images and segmentations are from the UCB segmentation benchmark database (Martin et al., in International conference on computer vision, vol. II, pp. 416-421, 2001). The database is extended by manually labeling each segment with its most specific semantic concept in WordNet (Miller et al., in Int. J. Lexicogr. 3(4):235-244, 1990). The evaluation methodology establishes protocols for mapping algorithm specific localization (e.g., segmentations) to our data, handling synonyms, scoring matches at different levels of specificity, dealing with vocabularies with sense ambiguity (the usual case), and handling ground truth regions with multiple labels. Given these protocols, we develop two evaluation approaches. The first measures the range of semantics that an algorithm can recognize, and the second measures the frequency that an algorithm recognizes semantics correctly. The data, the image labeling tool, and programs implementing our evaluation strategy are all available on-line (kobus.ca//research/data/IJCV_2007). We apply this infrastructure to evaluate four algorithms which learn to label image regions from weakly labeled data. The algorithms tested include two variants of multiple instance learning (MIL), and two generative multi-modal mixture models. These experiments are on a significantly larger scale than previously reported, especially in the case of MIL methods. More specifically, we used training data sets up to 37,000 images and training vocabularies of up to 650 words. We found that one of the mixture models performed best on image annotation and the frequency correct measure, and that variants of MIL gave the best semantic range performance. We were able to substantively improve the performance of MIL methods on the other tasks (image annotation and frequency correct region labeling) by providing an appropriate prior. © 2007 Springer Science+Business Media, LLC.

Well-regulated emotions, both within people and between relationship partners, play a key role in facilitating health and well-being. The present study examined 39 heterosexual couples' joint weight status (both partners are healthy-weight, both overweight, 1 healthy-weight, and 1 overweight) as a predictor of 2 interpersonal emotional patterns during a discussion of their shared lifestyle choices. The first pattern, coregulation, is one in which partners' coupled emotions show a dampening pattern over time and ultimately return to homeostatic levels. The second, codysregulation, is one in which partners' coupled emotions are amplified away from homeostatic balance. We demonstrate how a coupled linear oscillator (CLO) model (Butner, Amazeen, & Mulvey, 2005) can be used to distinguish coregulation from codysregulation. As predicted, healthy-weight couples and mixed-weight couples in which the man was heavier than the woman displayed coregulation, but overweight couples and mixed-weight couples in which the woman was heavier showed codysregulation. These results suggest that heterosexual couples in which the woman is overweight may face formidable coregulatory challenges that could undermine both partners' well-being. The results also demonstrate the importance of distinguishing between various interpersonal emotional dynamics for understanding connections between interpersonal emotions and health.

Abstract:

We present an algorithm which uses information from both surface reflectance and illumination variation to solve for color constancy. Most color constancy algorithms assume that the illumination across a scene is constant, but this is very often not valid for real images. The method presented in this work identifies and removes the illumination variation, and in addition uses the variation to constrain the solution. The constraint is applied conjunctively to constraints found from surface reflectances. Thus the algorithm can provide good color constancy when there is sufficient variation in surface reflectances, or sufficient illumination variation, or a combination of both. We present the results of running the algorithm on several real scenes, and the results are very encouraging. © 1997 Academic Press.

Abstract:

Illumination is rarely constant in intensity or color throughout a scene. Multiple light sources with different spectra - sun and sky, direct and interreflected light - are the norm. Nonetheless, almost all color constancy algorithms assume that the spectrum of the incident illumination remains constant across the scene. We assume the converse, that illumination does vary, in developing a new algorithm for color constancy. Rather than creating difficulties, varying illumination is in fact a very powerful constraint. Indeed tests of our algorithm using real images of an office scene show excellent results.