@Jiandong-Guo @AJBouzidi @ForumG-SC
FROM RESPONDENT:
I’ve participated in this study for a few weeks and wanted to share my experience. Please forward this email to the researchers.
First, I am experienced with the experience sampling method and have published on this topic in the peer reviewed literature. My comments below are meant to be constructive.
I note that the time sampling does not appear random. For instance, I set the schedule for 10am to midnight. (My morning alarm clock goes off at 10am). More often than not, the first time sampling message comes at exactly 10am to complete the survey. This seems odd and not random, which will effect the type of result this project is collecting.
Second, on my IPhone, there is only a text notification of the time sampling request to complete the survey. As a result, I’m only getting the text notification message when I happen to be on my phone or sometimes am completing the survey in response to a text notification first posted some time ago in the past—(given I’m on my phone for a specific purpose, this experience sampling is highly biased when I complete the survey).
Although I’m out of the loop on current ESM methodology, I assume it’s goal is still to sample a participant’s experience at a specific, (somewhat) random time. Given the notification set up, this app does not alert the participant in real time. That is, In the app settings, I don’t see a setting about how to include a sound notification or a vibration, which I would argue would be the correct method to sample one’s experience over a simple text message. Thus, I’m left only with just the text notification, which is almost always missed.
Given these concerns, I’ve made the decision to withdraw from the study, as I have no confidence in my results (and neither should you).
I do wish you luck in this research and hope these comments are helpful as you move from the pilot to the main study.
If you wish to discuss any of these issues with me, please don’t hesitate to contact me.
@Jiandong-Guo @AJBouzidi @ForumG-SC
FROM RESPONDENT:
I’ve participated in this study for a few weeks and wanted to share my experience. Please forward this email to the researchers.
First, I am experienced with the experience sampling method and have published on this topic in the peer reviewed literature. My comments below are meant to be constructive.
I note that the time sampling does not appear random. For instance, I set the schedule for 10am to midnight. (My morning alarm clock goes off at 10am). More often than not, the first time sampling message comes at exactly 10am to complete the survey. This seems odd and not random, which will effect the type of result this project is collecting.
Second, on my IPhone, there is only a text notification of the time sampling request to complete the survey. As a result, I’m only getting the text notification message when I happen to be on my phone or sometimes am completing the survey in response to a text notification first posted some time ago in the past—(given I’m on my phone for a specific purpose, this experience sampling is highly biased when I complete the survey).
Although I’m out of the loop on current ESM methodology, I assume it’s goal is still to sample a participant’s experience at a specific, (somewhat) random time. Given the notification set up, this app does not alert the participant in real time. That is, In the app settings, I don’t see a setting about how to include a sound notification or a vibration, which I would argue would be the correct method to sample one’s experience over a simple text message. Thus, I’m left only with just the text notification, which is almost always missed.
Given these concerns, I’ve made the decision to withdraw from the study, as I have no confidence in my results (and neither should you).
I do wish you luck in this research and hope these comments are helpful as you move from the pilot to the main study.
If you wish to discuss any of these issues with me, please don’t hesitate to contact me.