Thanks for reaching out and for including a nice note about our experiment.
A small typo you may want to fix: In our field study, no meals were sold because they were free at an event. We used this field study to establish ecological validity and then scaled the study by repeating the experiment design in an online experiment
A few more notes:
You have a subsection about how online studies have much smaller effect sizes than field studies. Is this the case in other behavioral sciences? I suggest you make a comparison.
Especially for when you write this for a journal, I suggest including motivation for the works you cover in the introduction. Why is transitioning away from MAP important?
Overall, I don't find directly comparing the effect sizes of the various studies compelling because the studies differ across so many dimensions - region, intervention type, student vs non-student population, online vs field studies - and as you mention, publication bias is a concern.
I think what is needed are studies that compare different types of interventions within the same study population. For example, imagine a study where a random subset of the participants receive an intervention highlighting how a vegan meal has a lower price, and another random subset of participants receive an intervention highlighting how a vegan meal has a lower carbon impact.
Best of luck with the project! This work is important!
Thanks for reaching out and for including a nice note about our experiment.
A small typo you may want to fix: In our field study, no meals were sold because they were free at an event. We used this field study to establish ecological validity and then scaled the study by repeating the experiment design in an online experiment
A few more notes:
You have a subsection about how online studies have much smaller effect sizes than field studies. Is this the case in other behavioral sciences? I suggest you make a comparison.
Especially for when you write this for a journal, I suggest including motivation for the works you cover in the introduction. Why is transitioning away from MAP important?
Overall, I don't find directly comparing the effect sizes of the various studies compelling because the studies differ across so many dimensions - region, intervention type, student vs non-student population, online vs field studies - and as you mention, publication bias is a concern.
I think what is needed are studies that compare different types of interventions within the same study population. For example, imagine a study where a random subset of the participants receive an intervention highlighting how a vegan meal has a lower price, and another random subset of participants receive an intervention highlighting how a vegan meal has a lower carbon impact.
Best of luck with the project! This work is important!
Alex