Tag Archives: Maps
Have you registered for our 2015 Quantified Self Europe Conference? If not, this weekend is your last chance to take advantage of our special early bird rate (€149!). We’d love to see you there so register today!
Our friends at Oura are currently crowdfunding their amazing heart rate, sleep, and activity tracking ring. Check out their Kickstarter to learn more.
Now, on with the show!
You may just have updated the map with your RunKeeper route by Alex Barth. Short post here describing a fascinating use of publicly available data from Runkeeper users around the world.
A Six Month Update on How We’ve Been Using Data, and How it Benefits All Americans by DJ Patil. A nice update on some of the current initiatives being championed at the federal level to make data more available and beneficial for all Americans. I can’t wait to see what happens next.
Discovering Google Maps New Location History Features by Mark Krynsky. Mark walks us through the new features embedded within Google Maps and Location tracking. Want to find out where you spend most of your time or how often you visit your favorite coffee shop? Google may already know!
Drowning in Data, Cities Need Help by William Fulton.
No city government, university or consulting firm can possibly figure out how best to use all the data we now have. The future lies in having everybody who understands how to manipulate data — from sophisticated engineering professors to smart kids in poor neighborhoods — mess around with it in order to come up with useful solutions.
Just Talking with Maggie Delano by Christopher Snider. Take a listen to a great conversation with our friend and QS Boston and QSXX organizer, Maggie Delano. Well worth your time.
HRV Measurements: Paced Breathing by Marco Altini. Marco is back at it again with a in-depth post about his experiments on how breathing rate affects HRV and heart rate measurements. Starting with a great review of the current literature, he then dives in to his own data and what he’s found through various experimental protocols.
Resuming Quantified Self Practices by Emily Chambliss. A short post here on using Excel to track and understand food consumption. Make sure to check out the slides from a talk she gave in 2012 at a New York QS Meetup.
My Sleep Quality of the last 2 Years by Reddit user Splitlimes. A beautiful visualization of just over two years of sleep data tracked with the Sleep Cycle app.
Time-histogram of 10 Million Key Strokes by Reddit user osmotischen.
These are plots of 10 million key strokes and about 2.4 million mouse clicks logged over a bit more than a year’s time on my computer. (Make sure to click through for more visualizations.)
From the Forum
Descriptives and visualizations for large numbers of variables
I created this site to make decisions better with an algorithm. I’d love feedback!
HRV apps for Polar H7 that include SDNN
Enjoy the first What We’re Reading post of 2015!
Wearable Devices as Facilitators, Not Drivers of Health Behavior Change by Mitesh Patel, David Asch, and Kevin Volpp. This opinion piece seeks to describe the reasons why currently available health wearables are not “bridging the gap” between tracking and changing behavior.
Big Data Not A Cure-All in Medicine by Amy Standen. This story, which first appeared on All Things Considered, sheds some light on concrete examples of how data can be used to treat medical conditions, and the current roadblocks in place.
The Smart, Angry Home by Emily Anthes. Smarter homes, smarter grids, and more data about our energy use is undoubtably on the horizon. In this piece, Emily Anthes describes how providing data back to individuals about energy use, especially in multi-tenant dwellings, can be a source of tension.
Thoughts on the Quantified Self by Kevin Ripka. I really enjoyed this short post about the author’s reactions to Quantified Self. I was especially interested in his description of the “Four Types of Projects” that he believes one can undertake when self-tracking.
What 2439 Reports Taught Me by Sam Bev. Sam has been using the ReporterApp over the last year. Since he began he’s amassed over 2400 reports, and those have provided some interesting insights into his own life. Read this great post and make sure to visit his website where his reports are made visible.
Seen, Read 2014 by Steven Soderbergh. Steven Soderbergh is an acclaimed writer and director, who has been tracking his media consumption for a few years. This post chronicles the books, plays, TV, movies, and records he consumed during 2014.
Map Your Trips Using Pics From Your Phone by Marco Altini. In this how-to post Marco lays out a fun method for tracking travel and location using only the photos you take with your smart phone.
A long one this time. Enjoy the words, numbers, and images herein.
New biometric tests invade the NBA by Pablo S. Torre and Tom Haberstroh. Data and statistics are nothing new in professional sports. They’ve even made Academy Award nominated movies based the idea that data can help a team win. Until now data on players and teams has come from analysis of practices and gameplay. This great piece opens another discussion about collecting even more personal data about how players in the NBA live their lives off the court. Recall that athletes, coaches, and owners have been talking about out of game data tracking since 2012.
Misleading With Statistics by Eric Portelance. We’ve featured these type of articles before, but the example used here by Eric is not to be missed. So many times the data visualization trumps the actual data when a designer makes editorial choices. After reading this piece you’ll think critically the next time you see a simple line chart.
Handy Tools & Apps by Ray Maker. A great resource for athletes and exercisers who use a variety of tools to capture, export, and work with the activity and workout data we’re collecting.
Happiness Logging: One Year In by Jeff Kaufman. A great post here about what Jeff has learned about himself, what is means to log something like “happiness”, and the power of tagging data. After looking at his data, and a commenter’s from the r/quantifiedself subreddit, I’m wondering about the validity of 10-point scales for this type of self-tracking.
Redshit/f.lux Sleep Experiment by Gwern. Our esteemed friend and amazing experimenter is back with another analysis of his sleep data. This time he explains his findings from using a program that shifts the color temperature on his computer away from blue and towards red.
I ran a randomized experiment with a free program (Redshift) which reddens screens at night to avoid tampering with melatonin secretion and sleep from 2012-2013, measuring sleep changes with my Zeo. With 533 days of data, the main result is that Redshift causes me to go to sleep half an hour earlier but otherwise does not improve sleep quality.
Make sure to join the discussion on the forum!
Schedule Abstracted by Mike McDearmon.
Even a hectic schedule can have a sense of serenity with all text, labels, and interface elements removed.
Location History Visualizer by Theo Platt. The data above is actually my full Location History from Google Takeout. Theo made this simple and fast mapping visualization tool. Try is out yourself!
Lifelogging Lab. No visualizations here, but if you’re a designer, visualizer, or just have some neat data then you should submit it to this sure to amazing curated exhibition.
From the Forum
The ethics of QS
Call For Papers: HCI International 2015 Los Angeles
Pebble for Fitness Tracking
QS Business Models
QS, Light, Sleep, Reaction Timing, and the Quantified Us
Are you using your data to write a reference book or tell a story?
A bit of a change this week. Today we’re posting some of our favorite academic and scholarly articles dealing with many different aspects of Quantified Self tools and methods. If that’s not for you, make sure to scroll down for some great self -tracking projects and visualizations. (Make sure to click [pdf] for the full article.)
Understanding Physical Activity through 3D Printed Material Artifacts [pdf] by Rohit Khot, Larissa Hjorth, and Florian Mueller. A fascinating paper on what happens when you transform digital physical activity data into representative physical objects.
Personal Tracking as Lived Informatics [pdf] by John Rooksby, Mattias Rost, Alistair Morrison and Matthew Chalmers. The authors of this research paper interviewed users of self-tracking tools to better understand how they incorporate personal data into their lives. From the abstract, “We suggest there will be difficulties in personal informatics if we ignore the way that personal tracking is enmeshed with everyday life and people’s outlook on their future.”
Persuasive Technology in the Real World: A Study of Long-term Use of Activity Sensing Devices for Fitness [pdf] by Thomas Fritz , Elaine M. Huang, Gail C. Murphy and Thomas Zimmermann. The authors of this study interviewed thirty individuals who had been using different activity tracking tools for different amounts of time (3-54 months). Those interviews unearthed some of the reasons why people starting using and continue to find activity trackers useful in their lives.
Using MapMyFitness to Place Physical Activity into Neighborhood Context by Jana Hirsch, Peter James, Jamaica Robinson et al. What can you find out about a population by partnering with a QS toolmaker? Jana Hirsch and colleagues tried to answer that question by partnering with MapMyFitness to better understand where and how individuals in Winston-Salem, North Carolina were exercising.
Visualized and Interacted Life: Personal Analytics and Engagement With Data Doubles [pdf] by Minna Ruckentstein. Don’t let the the title fool you, this article is not about new analytical methods for personal data. Rather, it is an thorough examination of the phenomenology of self-tracking and how people construct understanding of themselves through personal data collection.
Stress Trigger Personal Survey by Paul LaFontaine. We were lucky to hear about Paul’s stress tracking at the 2014 QS Europe Conference. While we work on getting that talk edited and posted online we thought this would be a great sneak preview.
Data, Pictures, and Progress by Chris Angel. Chris found out about QS while he was thinking about figuring out how to best lose weight. This post is his “first quarter” report from 2014.
Google has most of my email because if has all of yours by Benjamin Mako Hill. Benjamin has been running his own email server for 15 years. After a conversation with a friend he began wondering about how much email Google has a copy of. What followed was an amazingly in-depth analysis.
Strava Labs Global Heatmap. You can explore over 220 billion data points from almost 100 million different running and cycling activities tracked with the Strava app. (If you’re interested in the engineering side of this visualization they’ve written a great blog post here.)
From the Forum
Want to receive the weekly What We Are Reading posts in your inbox? We’ve set up a simple newsletter just for you. Click here to subscribe.
In the Quantified Self community we focus on projects and ideas that help people access and get meaning out their personal data, including the information you can collect with your smartphone. If you have an iPhone, Android, or Windows phone you’re already have carrying of the world’s most sophisticated self-tracking tools. The GPS, accelerometer, the microphone, all of these tiny sensors make up a great set of tools you can use to understand how you move around the world.
I’m going to focus this short “how to” on geolocation data and mapping your movement, specifically using data gathered by the Moves application. Moves is a passive activity and location tracking tool available for the iPhone and Android. We’ve written a bit about it in the past and had a chance to interview their CEO, Sampo Karjalainen. I’ve been using it since May, 2013 and I wanted to share some neat tools and methods for getting a bit more out of the data Moves collects.
I find that visualizing my data on a map to be incredibly powerful. It might by my inner cartographer, but seeing my patterns of movement (or lack there of) in reference to known places and landmarks is a great mechanism for inducing recall and reflection on where I’ve been and what I’ve done. Hopefully you’ll use one of the tools or methods below to map you data and learn something new!
Moves Connected Apps
Like many self-tracking applications and devices, Moves has a API that many different developers have built services on top of. Here are just a few of the services that allow you to see your data on a map. Be advised that each of these services has access to your data. Make sure to read their Terms of Service before agreeing to the data transfer.
WebTrack. This is by far the most utilitarian data mapping tool. However, you shouldn’t get discouraged by the lack of fancy design because it gives you an very unique data view. When you use Moves on your phone you typically only see the “storyline” and the detected places you’ve spent time at. However, Moves is constantly pinging and recording your location when it detects movement. WebTrack allows you to see all those movement points by hovering over the associated timestamp.
Fluxtream. You might know Fluxtream as Friend of QS and a great open-source data aggregation tool. They’ve set up a “Moves Connector” that allows you to import and visualize your Moves data. Because Fluxtream is set up as an aggregation and visualization tool you can also map other interesting data sets. Want to know where you were tweeting last week? Fluxtream will map it for you. (You can see me tweeting on a CalTrain ride between San Francisco and Palo Alto below.)
Zenobase. Another interesting data aggregation service here. Zenobase treats your Moves data bit differently. Rather than importing all the movement geolocation data it focuses on your place data and visualizes those locations. I like the high-level view it start with, but make sure to keep zooming in to see more specific place data.
Resvan Maps. This mapping application adds a unique twist to the typical mapping visualizations. It will plot your places, paths, and categorize paths depending on the activity (transport, walking, running, and cycling). Additionally, you can create “analysis cirlces” and have the application compute the time you spent in a certain location you bound (it aggregates to hours:minutes per day).
MMapper. This method for mapping your data, developed by Nicholas Felton, is by far the most technical, but it produces some really neat visualizations. You’ll have to download Processing and follow the instructions Nicholas provides on the Github repository page here. The great thing here is that the mapping and data access is all happening locally.
Move-O-Scope. Another great mapping application here from the folks at Halftone.co. They’ve probably completed the most thorough mapping and exploration tools for your Moves data. After linking your Moves account you can explore maps by activity type, day of the week, and custom data ranges. Additionally, they’ve implemented a neat feature for exploring place data. You can see how many times you’ve visited a specific place, where you’ve come from and where you go next, what days you typically visit, and your typical time of day at that place. (See this post for background on why they created this nifty tool.)
Map It Yourself!
If you don’t want to trust your data to a third party, but you still want to explore your movement maps there is really great option for you. Our friend and co-organizer of the QS LA Meetup, Eric Blue, recently published a method for easily exporting your data: the Moves CSV Exporter. You’ll have to login and use the Moves pin system in order to download your data, but Traqs isn’t storing your data, just providing a way for you to access it. The tool allows you to download and explore your activity, summary, tracks and place data. We’ll focus on the place data for creating maps. You can also use your full tracks history for mapping all the geolocation points Moves collects.
Because this data is based on latitude/longitude coordinates there are many different methods available that you can use to map your data. I’m going to focus on two here: Google Fusion Tables and CartoDB (if you know of others share them in the comments or our forum).
Google Fusion Tables
Fusion Tables are a new Google Drive tool that you can use to store, analyze, and visualize many different types of data. Once you download your Moves places.csv file you can upload it to a new Google Fusion Table. Once you upload your data, which takes about 2 minutes, you’ll see a menu bar and three tabs: Rows, Cards, Map of longitude. Just click on the “Map” tab and you’ll see your data already placed on a map. If you want to see a heatmap rather than a point map just navigate to Tools -> Change Map and you’ll see an option for a heatmap on the lefthand side. This is just the tip of iceberg for mapping fusion table data. You can learn more about different mapping methods and tricks here.
CartoDB is a visualization and analysis engine for geospatial data. I’ve been using it to play around with a few of the different geolocation datasets that I have (I actively keep three). Although it is paid service, they do offer a free plan for smaller datasets, which is perfect for your Moves data. Again, you’ll have to upload your places.csv file to a new table once you set up your account. Once the data is uploaded there are quite a few different map visualization wizards you can use to view your data in different ways. Pesonaly I like playing with the “Torque” visualization that gives you a real feeling of space-time to your data.
TileMill is an interactive map design tool from the folks over at Mapbox. If you’re looking to create custom maps with your data that you can format, style, and share then this is a wonderful tool to use. At first glance it’s a little daunting because it looks like a mashup of a CSS editor and map tool. That actually gives it the unique power to drive customization. Don’t be afraid, it’s not too hard to get started with. Mapbox has provided a great “crashcourse” to get you started with importing data, saving it as a new layer on your map, and then manipulating how it looks on your screen. If you want to go just a bit farther you can also add legends and informative popups to describe your data points. Mapbox also offers a free hosting plan if you want to share your interactive maps on a webpage. For example check out my MovesMap here, where I added a quick styling to manipulate the point size in relation to the time spent at a location.
Hopefully you’ve learned something new from this. If you map your Moves data (or any other geolocation data) we want to see it! Leave a link in the comments, post it in the location mapping thread on the QS Forum or get in touch on twitter!
Today’s gallery image comes to us from Eric Jain. Eric is the creator of Zenobase a neat data aggregation and tracking system. He’s also been a great contributor to our community at meetups in Seattle, our conferences, and on the forum.
This map shows my outdoor trips in the Pacific Northwest since 2008. Red is driving, yellow is hiking or paddling. The map doesn’t just help me remember past trips, but also helps me decide what areas to explore next. The tracklogs were recorded with a Garmin GPS device, processed with a simple script and uploaded to Google Fusion Tables with additional meta data stored for each trip in my Zenobase account.
Where are you? A pretty easy question to answer. But, what about, “Where was I?” Not so easy to answer, especially when we start talking about periods of time more than a few days or weeks. Sure, we all have GPS running on our phones now. We can check in with Foursquare/Facebook/Path etc. to keep a log of locations, but that data is fragmented and only represents certain specific locations. What about paths? What would we learn if we knew more about how we traveled about our world?
Aaron Parecki is one of the founders of Geoloqi, a location-based services platform. He has also been tracking his location every 6 seconds for the last four years and he has created some amazing visualizations to better understand his movement:
You may think this is just a boring old map with some travel data layered on top, but what makes this map special is that there is no underlying geospatial data. The lines you see above are Aaron’s actual travel paths from his GPS data. Using this information you can easily see the well traveled roadways by finding the thicker lines. You can even quickly pick out freeways and interstates due to their high speed.
Aaron has a lot more visualizations of his GPS traces, but I’ll leave you with this neat video showing a timelapse of his minute-by-minute movement:
Every few weeks be on the lookout for new posts profiling interesting individuals and their data. If you have an interesting story or link to share leave a comment or contact the author here.
From the New York QS Show&Tell group: Robert Rabinovitz, a design teacher at the Parsons New School of Design and a designer himself, mapped the 40-minute period on January 19, 2007 when he experienced his first brain seizure. He takes us through his gripping story, moment by moment, with images of what he saw that day. Robert is also writing a play, writing a research report and planning a film about his experience of survival. Watch the video below to see how the design process saved his life.
At our June Bay Area Quantified Self Show&Tell, Jim Keravala of Flaii gave us a brief tour of the mind map he developed using TheBrain. He spends 1-2 hours a day entering information into his virtual brain, and has recorded about 65,000 thoughts so far. He feels that the main benefit he gets from it is enhanced recall, which has given him an advantage in business situations. In the video below, he reveals that he has become very attached to the system he uses and doesn’t like to be away from it for more than a few hours at a time.
Bo Adler, a regular at Quantified Self Show&Tell meetups in the Bay Area, describes a mapping mashup he built for his naturalist friends who work with Outdoor Education groups. He wanted to capture their location from the pictures they are taking along the Pacific Crest trail, from Mexico to Canada. Find out what he learned from the power of location.