Code analyis for "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics: Comment"
This is an automated report of the Stata do files in the code and data supplement of the article Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics: Comment (AER, 2022) by Sebastian Kranz and Peter Pütz. The report was generated using the Repbox project (pilot version) by Sebastian Kranz (Ulm University).
Overview
- Stata commands without error: 100%
- Missing data files: 0
- Existing data files: 24
- Has timeout? No
Note that even if a human can reproduce the analysis, often less than 100% of commands run without error in the automatic reproduction.
Do files
The following table shows a summary for all Stata do files in the code supplement.
| Runtime | All commands | Info | |||
|---|---|---|---|---|---|
| (sec.) | Runs | No data | Error | ||
| TOTAL | 160 | 1119 | 0 | 0 | |
| setup.do | 0 | 7 | 0 | 0 | |
| BCH_figures_replicated.do | 73 | 62 | 0 | 0 | |
| caliper_tables.do | 66 | 128 | 0 | 0 | |
| read_in_and_transform_stata_data.do | 21 | 922 | 0 | 0 | |
The table shows for each do file how many commands were succesfully run, for how many commands the data set was missing and how many other errors occured. You can click on a do file to view an HTML based log file of the executed code.
Missing Data Sets (0)
--- No missing data sets detected ---
Existing Data Sets (24)
Below are existing data set files. Note that sometimes a file for confidential or proprietary data set may exist, but it is empty or has simulated fake data.
| Data set | Size | Loaded in | Info |
|---|---|---|---|
| MM Data.dta | 101 MB | read_in_and_transform_stata_data.do | |
| MM Data with WP.dta | 82 MB | ||
| final_stars_supp.dta | 36 MB | ||
| MM_new.dta | 12 MB | caliper_tables.do, BCH_figures_replicated.do | |
| mm_data_ready.dta | 9.3 MB | ||
| starwars_bch_pk.dta | 4.1 MB | BCH_figures_replicated.do | |
| MM Data with only WP.dta | 3.3 MB | ||
| MM Data with WP ready.dta | 2.6 MB | BCH_figures_replicated.do | |
| Star Wars Data.dta | 1.7 MB | ||
| RCT_aer_100.csv | 85 KB | ||
| RCT_aer_10.csv | 82 KB | ||
| DID_aer_100.csv | 71 KB | ||
| DID_aer_10.csv | 67 KB | ||
| IV_aer_100.csv | 64 KB | ||
| IV_aer_10.csv | 61 KB | ||
| RCT_drop_10.csv | 54 KB | ||
| IV_drop_10.csv | 45 KB | ||
| RDD_aer_100.csv | 39 KB | ||
| DID_drop_10.csv | 38 KB | ||
| RDD_aer_10.csv | 37 KB | ||
| RDD_drop_10.csv | 22 KB | ||
| labels_MM_new.csv | 2 KB | ||
| ak_cor_sum.csv | 2 KB | ||
| table_A1.csv | 1 KB |
About
This report and the HTML based log files were automatically generated using a pilot version of a software project called Repbox currently developed by Sebastian Kranz (Ulm University). Repbox tries to automatically run Stata code in supplements, using strategies like automatic file path correction to improve reproducibility. Currently only the pilot version of Repbox exists. I am part of a group of researchers who plan to submit a proposal for third party funding to substantially extend the features and the reliability of the Repbox project.