This page is intended to help you analyze the data that you received from your iPhone app.
When you email yourself your sleep history data, you will find 4 files attached with the email:
Singularity state data file:
this is processed data in 5 minute resolution. This is the primary file that you would be plotting to analyze your sleep.
[important]Data analysis worksheet for this file has been released! It accepts data from the version 1.1 and up. Follow instructions on the worksheet on how to copy/paste the data into the file. The document includes sample data collected by me using wrist mounted device. I analyze the data in the worksheet to give you a feeling for what you may discover[/important]
Hi-Res Research data:
This is raw data in 1 minute epochs. You may wish to familiarize yourself with it, although it requires quite a lot of processing to turn into meaningful data.
used for debugging purposes, it can confirm that the app has played a reminder at a certain time, and is the easiest file to read.
History Data File:
This is a comprehensive analysis of your dream journal. This file is most useful if you report dreams at night.
Some of the metrics to help you understand your sleep:
Dream Event /User Event: These are the dreams that you have reported by tapping on the screen at night.
- 1 = Dream
- 2= Lucid Dream
- -1=No recall
- -2= Awake
By plotting any metric against these events, you will notice how the metric changes before a dream has been reported.
- 1 = early scheduling
- 2= Reminder scheduled
- 3= reminder delivered
By plotting reminders and dream events together, you would be able to see how close to your dream awakening the app has played a reminder. Using this information, you may either increase the intensity of the reminder or change the amount of seconds the reminder will flash light before delivering a light reminder.
Future updates of this page would include an excel spreadsheet capable of plotting all of your data (simply copy/paste data in to see graphs). Due to the sensitive nature of some algorithms, I will not be discussing what certain metrics mean due to unauthorized copying that this would produce.
Working with Dream History:
Each time you report a dream using the app, a dream journal entry is created. There are 4 types of entries:
- Red are awake episodes: you’ve been awake prior to reporting this
- Green are dreams: you’ve woken up and remember a dream
- Blue are Lucid Dreams: you’ve actively experienced a lucid dream prior to this awakening
- Gray are no dream recall: you’ve woken up from sleep and do not remember dreams
Dreams are accessible on the dreams tab and the sleep history tab. Each dream marker is tappable and brings you to it’s corresponding dream journal entry.
Each row is tappable and brings you to the corresponding night’s data.
Basic Dream History Analysis
When looking at a dream history, you may want to understand the following:
- When do I dream the most?
- How long are my sleep cycles?
- When are my dream awakenings?
- What can I do to improve my sleep.
Let’s examine each of these questions in order.
When do I dream the most?
Let’s examine the image on the right. The top row is the most recent night. All markers are plotted in real time with the left edge being midnight.
- Black marker indicates the onset of the first stage of light sleep for sleep cycle 1. This is commonly referred to as Sleep Onset.
- On the top night , I’ve fallen asleep at about 1:40. I can estimate the time by analyzing the blue scale under the black marker or by tapping on the row to bring up detailed info for that night.
- My first dream awakening (Green Garker) was reported at 4:40. I estimate the dream duration to be 12 minutes. This means that I had a dream between 4:28 and 4:40.
- By checking the purple scale over the markers, I can see that there are 2 segments between the black marker and the first green marker. This means that the first dream that I’ve reported happened at the end of the second sleep cycle.
- The second dream recall happened at 6:04, I estimate the duration of that dream to be 7 minutes.
- By looking at the purple scale, I can see that the second dream that I remember happened at the end of the third sleep cycle
- My third dream was reported at 7:06, I often wake up around 7AM, as this is the local sunrise time around where I live, the light may be causing this awakening.
- My fourth dream was reported at 8:03. It is not uncommon for me to wake up at this time too.
- The fifth dream was reported at 9:31, at the end of 5th sleep cycle.
- I’ve had 5 sleep cycles in that night – I count the number of purple segments on the top ruler between the black marker and the orange marker.
What does this tell me? I’ve had a pretty good night, with 5 dreams reported for a relatively short night of only 8 hours:
- I estimated 35 minutes of remembered dream time.
- I’ve recorded each dream in my paper dream journal and have re-typed it in the dream journal in the morning. This took 20 minutes
- I have rated each dream on it’s control and clarity, with one dream having low level of dream control.
- The dream at 7:03 had my most common dream sign. I can use affirmations and mnemonics (MILD) to help me realize I’m dreaming when seeing that dreamsign again.
- I learned that the dream at 4:40 has been the longest, and also had some level of control (flying on a snowboard).
To do so, I find the console log for the given date and look through the console log, looking for messages about a reminder being delivered, here’s what I find:
04:13:17: Requesting reminder with delay: 1 minutes 04:13:17: Deliver Reminder Finished 04:14:18: Presenting reminder 04:16:19: Reminder has been played
The app has played a reminder at 4:16, while I’ve reported dream recall at 4:40 and estimated that it started at 4:28. The app has played the reminder 12 minutes earlier, potentially influencing the earlier portion of the dream that I do not remember. Flying on a snowboard may be a side effect of that early reminder. In order to improve my chances on subsequent nights, I can increase the “reminder delay” of the gray reminder (1st one clockwise after black marker) on the image to the right.
I can continue to analyze the effectiveness of my reminders that way.
Now that I have analyzed one night, I can continue the process by looking for patterns within the history.
I can view history in 2 modes:
- Real Time, where each marker is plotted against real clock and the left edge is midnight.
- Bed Time, where the left edge is bedtime and each marker is plotted as number of hours after bedtime.
Both modes may help me learn more about my sleep.
For now, I’ll analyze data in Real time mode.
My dream recall is pretty good on all days visible, and I report dreams upon awakening. Here are some things that I see:
- On Dec 22, 23rd and 26th, I woke up from my first dream and had trouble falling back asleep after writing down the dream in a dream journal. This is indicated by a red marker after the dream marker.
- Looking at the black and orange markers, I can see that my pattern of waking follows my pattern of bedtime. If I go to bed later, my body would want to wake up after completing a certain number of sleep cycles. This means that waking up with an alarm would be difficult if my rise time is fixed, but the bedtime varies as shown.
- On Dec 25th I’ve experienced REM rebound. It took me a long time to fall asleep (42 minutes), but from 6:40 to 8 I’ve woken up 6 times and remembered a dream fragment each time. I expect that light outside caused these dreams to be more fragmented. If this happened before sunrise, I would’ve had a very long dream. The possible cause of REM rebound is consuming alcohol the day before– you can see that I did not remember dreams until almost 4th sleep cycle. This means that the next day my body “caught up” on the REM by dreaming more intensely.
How can I improve my sleep.
If you take a look at my sleep history, you will notice that my bedtimes are fairly strict. I go to bed at either 0:30ish or 1:30ish. My ideal awakening is 9:38. If i push it further, I will sleep to as late as 11:00. Before I learned about the importance of sleep hygeine, my bedtimes would be all over the place, and as a result, my dream recall and lucid dream induction suffered.
[I will have to stop writing this article, because it’s almost bedtime! :)]
Advanced Sleep history analysis.
With the app version 1.2, you can search your dream journal and filter your history according to some terms. When I record dreams in my dream journal, I mark obvious instances when an image from a previous day appears in a dream. The term for this is “Day residue”, it is a free example of how a real life object may get integrated into a dream.
For example, seeing a bike commercial on TV I may find myself riding a bike in a dream. The appearance of day residue may be delayed, and the theme of a dream may represent an even that occured a few days in the past.
To start with advanced analysis, you need to start marking your dreams with keywords, like “Day residue” or your most frequently observed dreamsign. You can then search the history and get a pattern like the one to the right. Tapping on each marker, you can see what you dreamt about, while the color of each marker indicates the dream’s clarity and level of control.