Electrical Engineering and Computer Science

Live public street cams are tracking social distancing

Voxel51, a U-M startup led by Prof. Jason Corso, uses custom AI to continuously track vehicle, cyclist, and pedestrian traffic in real time at some of the most visited places in the world.

With advanced computer vision models and live public street cam video, a University of Michigan startup is tracking social distancing behaviors in real time at some of the most visited places in the world.

Voxel51’s new tool shows—quite literally—an uptick in public gathering in Dublin on St. Patrick’s Day, for example, and at New Jersey’s Seaside Heights boardwalk during a recent weekend of unusually good weather.

The tool uses the company’s existing platform and underlying custom AI to continuously track vehicle, cyclist, and pedestrian traffic at seven locations: Times Square; Abbey Road in London; Fremont Street in downtown Las Vegas; Seaside Heights in New Jersey; a beach in Ft. Lauderdale and intersections in Dublin and Prague. Several other locations are in beta, and more will be added soon. 

It assigns each place a “physical distancing index,” or PDI score, once every 15 minutes. 

“This pandemic is having an unprecedented impact on our daily lives and what we’re trying to do is create a tool to improve public awareness,” said Jason Corso, professor of electrical and computer engineering at U-M and CEO of Voxel51, an Ann Arbor video analytics and data management company. “The PDI score helps people understand and compare how the coronavirus is changing social behaviors over time and enables municipalities to visualize how they’re doing from a public health perspective. 

“Even though the virus is spreading, overall, we can see that the public response to the stay-at-home mandates has been rather dramatic and impressive.”

While other projects are also tracking lockdown compliance, what’s different about Voxel51’s approach is that it’s real-time, video-based and protects privacy. Data sources like mobile phones don’t protect privacy and only offer approximate locations.

On this new platform, viewers can click on a specific point in time on an individual city graph to see historic footage as well as additional details about policies such as school closures and stay-at-home orders.

The graphs provide insights into the difficulty in limiting human activity in the face of good weather and special celebrations: Fort Lauderdale is one of the top destinations for students on spring break. As shown on the detailed graph for Florida, despite the governor issuing a public emergency on Feb. 29, crowds were at all-time highs in early March, yet started to fall dramatically after the mayor issued emergency methods on March 17 closing bars and nightclubs. And New York City – hit hardest by the pandemic, has a very tough time keeping its 8 million tightly-packed residents completely shuttered in.

Voxel51 plans to add new locations regularly, as well as blog posts analyzing the data. The company is also accepting requests to add locations or specific installations of the system for local government and taxpayer usage. Views of different parks could help residents locate the least trafficked area to safely walk their dog, for example.

The researchers are also in the process of adding curves to the graphs to plot weather, case rates and death rates.

“We expect to find rich information in the joint analysis of the physical distancing index and these other feeds,” Corso said. “There is even a chance that the PDI can feed into a predictive model for cities not yet greatly affected and the potential for a renewed outbreak next year.”

Artist rendering of COVID-19 Enlarge

The research featured in this story is related to some of the issues facing individuals around the world due to COVID-19. See our COVID-19 page for additional resources and news from Electrical & Computer Engineering.

Autonomy, AI & Robotics; COVID-19; Computer Vision; Jason Corso; Research News; Signal & Image Processing and Machine Learning
November 2, 2020 : Medium

Introducing FiftyOne: A Tool for Rapid Data & Model Experimentation

August 13, 2020 : Click on Detroit

Ann Arbor-based Voxel51 launches industry’s first open-source experimentation tool

April 17, 2020 : Computing Community Consortium

Computing Researchers Respond to COVID-19: Voxel51; A Means of Tracking Social Distancing

April 10, 2020 : Governing

Company Uses Public Street Cams to Measure Social Distancing

April 8, 2020 : ScreenRant

How To Watch The Grim Reality Of Physical Distancing In Major Cities

April 8, 2020 : TechCrunch

Tech for good during COVID-19: Texts for frontline workers, a crisis prevention hotline and more

April 8, 2020 : Click on Detroit

Local AI startup creates platform to track social distancing in global cities -- including Ann Arbor