11

Peter_Hurford comments on Students for High-Impact Charity: 2018 Update - Effective Altruism Forum

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (19)

You are viewing a single comment's thread. Show more comments above.

Comment author: Peter_Hurford  (EA Profile) 09 August 2018 01:59:26PM *  1 point [-]

I wonder if it is possible to add a check for this in a future survey. Maybe ask them if they intentionally conserve their water usage to save the environment? There should be no reason for that to change from pre- to post- without a change in social desirability or attrition.

Comment author: cafelow  (EA Profile) 10 August 2018 02:21:56AM 5 points [-]

My guess is the main problem occurs when it is very clear to students what the instructors want them to say. Since we don't talk about water usage, students may not change their answer for the water usage question, but still change their answer to the questions relating to the content (whether or not they have been impacted by the program), so there may not be a shift in the water question, but still a shift in the other questions.

We did test out some different social desirability scales in the surveys, which is a common method. The preliminary analysis suggested that social desirability is a factor, but we haven't finished that analysis on the full data yet.