<transcript><audio_254>these were different projects so here we had 100 replications with a lot of labs from around the world here we had 21 famous studies that were published in science or in nature so this is a summary a uh</transcript><transcript><audio_255>that i took from twitter barai nosek is the director of the center of open science that does the open science framework that we just used in order to conduct our pre-registration so he built this tool because for a very long time he was looking for a website</transcript><transcript><audio_256>where he can store and share his materials where he can do pre-registrations and there wasn't any so he built one and right now because of him and because of the non-profit that he is headed you know the center of open science</transcript><transcript><audio_257>we now have this amazing tool um called the open the open science framework so what we have is that from 2015 from this 97 replications that originally had significant effect when we tried to repeat this only</transcript><transcript><audio_258>36 of them 36 were significant in the same direction and of those the effect size was about half then people said okay you just try to replicate psychological science and jpsp these</transcript><transcript><audio_259>social psychology journals we didn't expect very much but if you try to publish science in nature then everything is going to replicate but once again out of 21 only 13 replicated and the effect size were about half of the of the original</transcript><transcript><audio_260>so that was disappointing finally published in nature human behavior this really large mass collaboration many labs too look at all these samples how many labs involved 36 nations 186 authors so really social</transcript><transcript><audio_261>psychologists coming together to try and understand so what replicates what doesn't replicate and finally you can see that successfully replicated 14 of the 28 and really the effects are are very disappointing much weaker</transcript> these were different projects so here we had 100 replications with a lot of labs from around the world here we had 21 famous studies that were published in science or in nature so this is a summary a uh that i took from twitter barai nosek is the director of the center of open science that does the open science framework that we just used in order to conduct our pre-registration so he built this tool because for a very long time he was looking for a website where he can store and share his materials where he can do pre-registrations and there wasn't any so he built one and right now because of him and because of the non-profit that he is headed you know the center of open science we now have this amazing tool um called the open the open science framework so what we have is that from 2015 from this 97 replications that originally had significant effect when we tried to repeat this only 36 of them 36 were significant in the same direction and of those the effect size was about half then people said okay you just try to replicate psychological science and jpsp these social psychology journals we didn't expect very much but if you try to publish science in nature then everything is going to replicate but once again out of 21 only 13 replicated and the effect size were about half of the of the original so that was disappointing finally published in nature human behavior this really large mass collaboration many labs too look at all these samples how many labs involved 36 nations 186 authors so really social psychologists coming together to try and understand so what replicates what doesn't replicate and finally you can see that successfully replicated 14 of the 28 and really the effects are are very disappointing much weaker
{"source": "grass-yt-cc-by.0lkjMtLpDZM|shard_10051_61|create_multimodal_data.extract_yt_and_generate_transcripts.60|shard_10051|create_multimodal_data.generate_captions.30|shard_10051|create_multimodal_data.generate_captions.41", "params": {"id": "0lkjMtLpDZM", "channel_id": "UCP0U3Ily7OP2CmfBhcTBbzA", "duration": 9240, "view_count": 708, "age_limit": 0, "chapters": [{"start_time": 0.0, "title": "Introduction", "end_time": 150.0}, {"start_time": 150.0, "title": "Live demonstration of pre-registration on Open Science Framework", "end_time": 1760.0}, {"start_time": 1760.0, "title": "Live demonstration of data collection after pre-registration", "end_time": 1896.0}, {"start_time": 1896.0, "title": "Live demonstration of creating a JAMOVI data analysis pre-registration plan template", "end_time": 2209.0}, {"start_time": 2209.0, "title": "Live demonstration of data analysis on collected data according to pre-registration plan", "end_time": 2997.0}, {"start_time": 2997.0, "title": "Quick intro to replication/reproducibility crisis and credibility revolution", "end_time": 3874.0}, {"start_time": 3874.0, "title": "Pre-registration: Background", "end_time": 4905.0}, {"start_time": 4905.0, "title": "Pre-registration of secondary data and synthetic datasets", "end_time": 5720.0}, {"start_time": 5720.0, "title": "Registered Reports", "end_time": 7101.0}, {"start_time": 7101.0, "title": "Our team's experience with Registered Reports", "end_time": 7475.0}, {"start_time": 7475.0, "title": "Our Registered Reports and pre-registrations resources", "end_time": 8029.0}, {"start_time": 8029.0, "title": "Frequently Asked Questions about Registered Reports", "end_time": 9240}], "like_count": 11, "channel_follower_count": 836, "license": "Creative Commons Attribution license (reuse allowed)", "uploader_id": "@GiladFeldmanScience", "yt_tar_file": "/leonardo_work/EUHPC_E03_068/audio/fixed_download/grass-yt-cc-by//shard_10051/0lkjMtLpDZM.tar.gz"}}