Comment author: RomeoStevens 13 October 2018 07:05:56AM 4 points [-]

Was whether senior talent should have better access to high quality executive assistants explored?

Actually in general if there were any negative findings that is probably useful too.

Comment author: RomeoStevens 13 October 2018 06:49:44AM 3 points [-]

Recruiting is a thing and an EA org with the funds should be willing to consult with the best in the world if it's a one time cost to do so and you can do judgmental bootstrapping on their models and techniques.

Comment author: RomeoStevens 01 July 2018 04:35:55PM 2 points [-]

Good stuff! You might be interested in both OODA loops and Marr's levels of analysis.

Comment author: Peter_Hurford  (EA Profile) 19 June 2018 02:46:10AM 3 points [-]

it might also be nice if there was a repository of info on why some common cause areas are not generally recommended by EA

Good idea. I had been experimenting by adding summaries at the top of some articles (for example this one on aging) and was trying to figure out how opinionated the Wiki should be. Right now I was trying to err on the side of being less opinionated. If you have any thoughts on this issue, I'd definitely be curious to hear them.

I'm unsure how one would incentivize such info being added though.

We're hoping to eventually and slowly create a volunteer pool to do this kind of work. This seems like the kind of tasks volunteers have done well on in my past experience. Furthermore, given funding, we'd even be able to pay for the assistance.

Comment author: RomeoStevens 19 June 2018 04:02:08PM *  2 points [-]

Maybe also a prize for best new wiki entry periodically?

How opinionated it is probably comes down to tone more than content. Less 'and this is why everyone who supports education is stupid' and more 'this is the story on education studies so far. We hope this can be of assistance to someone trying to develop new educational interventions so they don't go down the same blind alleys as previously' that could help. It could also harm in the sense that controversy engenders engagement and a more confrontational approach would get people to actually argue.

Also I'd like to note that I'm bullish on this idea overall as I think it might allow for genuine philosophical progress. Part of the lack of progress comes from the fragmentary nature of all the various arguments, making people very hesitant to offer critiques since a likely outcome is 'that has already been addressed in 3 places.' We tend towards a community of correctors, which shuts down generative creative thought.

Comment author: RomeoStevens 19 June 2018 01:55:40AM 5 points [-]

In addition to cataloging sources of data and analysis for current and potential EA causes, it might also be nice if there was a repository of info on why some common cause areas are not generally recommended by EA. I'm unsure how one would incentivize such info being added though.

Comment author: RomeoStevens 05 June 2018 11:08:20PM 9 points [-]

The biggest risk seems to be in the hotel manager position. My guess is there is underestimation of the learning curve and ongoing maintenance costs/time to run a 17 person hotel.

Comment author: RomeoStevens 28 May 2018 05:50:34PM 1 point [-]

Another way to frame it is thinking about Marr's three levels of analysis. The computational (what are we even trying to do?), the algorithmic (what algorithms/heuristics should we run given we want to accomplish that?), and implementation (what, concretely should our next actions be to implement those algorithms in reality?). Cleanly separating which step you are working on prevents confusion.

Comment author: Eva 22 May 2018 12:28:04AM 3 points [-]

And when groups do work on these issues there is a tendency towards infighting.

Some things that could help:

  • Workshops that bring people together. It's harder to misinterpret someone's work when they are describing it in front of you, and it's easier to make fast progress towards a common goal (and to increase the salience of the goal).
  • Explicitly recognizing that the community is small and needs nurturing. It's natural for people to at first be scared that someone else is in their coveted area (career concerns), but overall I think it might be a good thing even on a personal level. It's such a neglected topic that if people work together and help bring attention to it real progress could be made. In contrast, sometimes you see a subfield where people are so busy tearing down each other's work that nothing can get published or funded - a much worse equilibrium.

Bringing people together is hugely important to working constructively.

Comment author: RomeoStevens 22 May 2018 09:35:41PM 0 points [-]

when groups do work on these issues there is a tendency towards infighting.

Do you think this is a side effect of the-one-true-ontology issues?

Do you happen to know which conferences research results in this area tend to get presented at or which journals they tend to get published in? Could be useful to bootstrap from those networks. I've been tracing some citation chains from highly cited stat papers, but it's very low signal to noise for meta-research vs esoteric statistical methods.

Comment author: RomeoStevens 21 May 2018 06:44:20PM 2 points [-]

Really happy to see this get some attention. I think this is where the biggest potential value add of EA lies. Very very few groups are prepared to do work on methodological issues. Those that do seem to generally get bogged down in object level implementation details quickly (See: the output of METRICS for example.) Method work is hard, connecting people and resources to advance it is neglected.

Comment author: Michael_S 21 May 2018 04:43:24PM 3 points [-]

I agree that limitations on RCTs are a reason to devalue them relative to other methodologies. They still add value over our priors, but I think the best use cases for RCTs are when they're cheap and can be done at scale (Eg. in the context of online surveys) or when you are randomizing an expensive intervention that would be provided anyway such that the relative cost of the RCT is cheap.

When costs of RCTs are large, I think there's reason to favor other methodologies, such as regression discontinuity designs, which have faired quite well compared to RCTs (

Comment author: RomeoStevens 21 May 2018 06:42:06PM 1 point [-]

Would the development of a VoI checklist be helpful here? Heuristics and decision criteria similar to the flowchart that the Campbell collab. has for experimental design heuristics.

View more: Next