Skip to main content

Zensors app uses your old smartphone and crowdsourcing for smart surveillance

Zensors: Sensing Unleashed
Want to know how many times your cat jumps on the counter when you’re not around? Or, maybe you want to quantify the distraction you experience at work by counting the number of people who walk by your cubicle. Now there’s an app for that. Zensors, created by a research group at Carnegie Mellon University in participation with the Yahoo InMind Project, uses your smartphone’s camera to capture data, and then uses artificial intelligence and crowdsourced input to analyze it.
Recommended Videos

The app, currently in beta, uses your phone’s camera to monitor the action. You can set up an area on the phone’s touchscreen for the application to pay particular attention to. A Zensors demo used a parking lot as an example, where the user defined a certain parking space, or group of spaces, to watch for a period of time. Data is then analyzed by set parameters, such as how many cars park in a certain spot over a period of time.

You can use your current phone, though the group behind Zensors suggests that this is a practical use for an old smartphone that you no longer use. You can set it up to be a dedicated data collector; if you use your current device, you may interrupt your data collection activities when you receive a text, or have to walk away from the scene.

zensors
Image used with permission by copyright holder

The data is crowdsourced, because certain questions are not easily answered by the simple action of an object on the screen. One of the creators, Chris Harrison, assistant professor of human-computer interaction at Carnegie Mellon, writes on his profile page that certain sensors, such as a simple open/close door sensor, does not answer the question of whether someone’s children are home from school (although you might want pick who you want to crowdsource on that query). Another example is which patrons at a restaurant need their drinks refreshed. There are business and practical applications for the Zensors app.

For the crowdsourced monitoring, the job could be done by an outsourced staff that watches for activity. At the same time, the app’s algorithms are learning from the humans; over time, some of those human-based activities could become automated.

Crowdsourcing is sometimes necessary. Harrison notes that advances in sensing, computer vision, and machine learning are quite advanced, but not quite there yet to address the queries people might use the app for.

Zensors was built for use with unused smartphones, but will also work with a Wi-Fi camera such as a Dropcam. The site says users can set alerts by email or text, and adapt the app using the available API.

Enid Burns
Former Digital Trends Contributor
Enid Burns is a freelance writer who has covered consumer electronics, online advertising, mobile, technology electronic…
Weather alerts may be the smartest use of smart lights. They can save your life
LIFX Mini Color bulb installed in ceiling

Springtime brings with it fresh life, blooming flowers, and in some parts of the country, incredible storms. The old expression that March comes in like a lion and goes out like a lamb holds particularly true in the Southeast and Midwest, where spring storms are accompanied by damaging, dangerous tornadoes.

Meteorological science has advanced in amazing ways. People now have a much better idea when dangerous weather is on the way, but only if they pay attention -- and even then, it can sometimes be hard to hear the alert if there's a lot going on in the home.

Read more
5 ways to make your smart home display more useful while working from home
Nest Hub Max, using the touchscreen.

A smart display is more than just a way to check the weather, read up on the news, or control your smart home. It can provide you with quick information about specific subjects and streamline your day. Given how people are continuing to work from home, smart displays present themselves as the perfect deskside companion. Here are a few tips and tricks that can help your smart display be more than a simple tool -- it can be the centerpiece of your work-from-home experience.
Keep tabs on your schedule on the go

Many people think working from home is a more laid-back schedule, but it often involves juggling more tasks than you're used to. As a result, it can be tough to stay on top of your schedule, especially on particularly busy days. Your smart display can show your schedule at a glance and even alert you to upcoming meetings.

Read more
Think your house is smart now? Here’s a peek at what it’ll be like with AR
lightanchors carnegie mellon 2

In Plato’s Allegory of the Cave, the influential Greek philosopher asks us to imagine a group of prisoners living their entire lives inside a cave. All that they can see of the real world comes from shadows which appear on the cave walls. Eventually, a prisoner escapes and realizes that his or her previous view of existence was based on a low resolution, flat understanding of how the world actually operated.

A slightly pretentious way of starting an article on augmented reality? Perhaps. But the broad idea is the same: Right now, in the pre-AR world, we have a visual perspective that contains only the details of things around us that we can see on the surface. AR, a technology which has been talked about increasingly in recent years, promises to let us go deeper.

Read more