"miningscripts.zip" contains our mining scripts.
Download link to miningscripts.zip
- miningInformation.py constructs MySQL Database of submission information data.
- miningSource.py collects text source files which are submissions on Codeforces during May 19th 2016 to November 15th 2016.
To use our scripts,
- Install Python and "pip"
- "pip install pyquery", "pip install mysql-connector"
- Create MySQL database named codeforces (any name is available)
- Change username, password and database name in Connector.py script
- Run miningInformation.py
- Run miningSource.py
You have to run miningInformation.py before miningSource.py because it uses information in database to find url of source files.