TSVP Talk: "Seeing the World: Building Scenes From Pixels in the Mid-Level Visual Pathway​" by Ko Sakai

Title: Seeing the World: Building Scenes From Pixels in the Mid-Level Visual Pathway​

Speaker: Ko Sakai, University of Tsukuba, Japan, Computational Vision Science Lab

Abstract:
Retinal images are just like digital images composed of many small pixels. Through its hierarchical visual cortices, our brain gradually groups these pixels, constructs contours and surfaces, and ultimately recognizes objects and scenes. Intermediate cortical areas, such as visual areas 2 and 4 (V2, V4), play crucial roles in this transformation.
V2 neurons code the local side (direction) of the object with respect to borders defined by luminance, color, texture, and depth; that is, they find which side of the border belongs to the object. Pooling this information then contributes to the detection of contours, which form the periphery of an object. V4 neurons code a figure relative to the background and construct a surface, the spatial extent of objects enclosed by contours. Attributes such as shape, color, and texture are thought to attach to this surface and contribute to object recognition. If surface construction fails, even the perceived shape deviates from the true object, and recognition will also fail.
Our recent study showed that individual V4 neurons were not capable of coding figures, but tens of neurons appeared to code figures at the population level. A pool of approximately forty to fifty neurons was capable of segregating figures in natural images, in good agreement with perceptual performance.
Surface construction is thought to be driven by the prior probability structure of natural images, which is reflected in perceptual rules such as Gestalt factors. The resulting surface is considered a proto-object that provides bottom-up visual information for matching with top-down knowledge about objects. Further investigations of proto-objects may clarify how we understand and abstract visual scenes and conceptualize the world.

Profile:
Ph.D. in Bioengineering, University of Pennsylvania, PA, U.S.A., 1995
Researcher, Brain Science Institute, RIKEN, Wako, Japan, 1995
(Associate) Professor (Emeritus), University of Tsukuba, Japan, (1999) 2009 (2025)
https://sites.google.com/alumni.tsukuba.ac.jp/ko-sakai/home?authuser=0

Language: English

Target audience: General audience/everyone at OIST and beyond.
Freely accessible to all OIST members and guests without registration.

This talk will also be broadcast online via Zoom:
Meeting ID: 913 8815 5495
Passcode: 561328

※ Please note that this event may be recorded and the videos uploaded. In addition, photos may be taken during the event. These are intended for publication online (the OIST website, social media, etc.)※