_AugmentedIntelligence Wikipedia2MySQL
The following guide will teach one step by step to upload Wikipedia and other Wikia XML Wikidumps to MySQL.
- Install MySQL if you have not installed already.
- Download the community version of MySQL
- After the executable has been downloaded; execute it.
- Install the community installer and the most recent version of MySQL server. Note: I would recommend installing the Visual Studio C++ Connector if you plan to edit or mod the source of _AugmentedIntelligence or if you wish to use your own or third party software.
- Make sure MySQL Server is installed as a service.
- Download a Wikia Dump from https://dumps.wikimedia.org/backup-index.html
- Download 7-zip if you have not installed it already.
- Go to https://www.7-zip.org/download.html
- I recommend downloading the 64-bit Windows Executable file (64-bit Windows x64)
- After the executable has been downloaded, install it
- Extract the Wikia dump XML file from the archive.
- Download the following PowerShell tool for extracting the dump.
- Open PowerShell as an administrator.
- Run the following: Install-Script Split-Wikipedia -Scope CurrentUser
- Close PowerShell and launch it again as an administrator.
- In PowerShell Prompt type: Split-Wikipedia -Path ./enwiki-latest-pages-articles.xml
- This process will take a number of hours.
- The articles are saved to ./articles
- Download and install Git
- If you have not installed git; Go to:https://git-scm.com/download/win
- Download and install git.
- Open Advanced System Settings by right clicking on This PC and left clicking on Properties.
- Click on Environment Variables.
- Under the Path variable, paste the installation path or bin directory of git.
- Save and close Environment Variables.
- Download or Clone the repository
- Go to: https://github.com/Macdaddy4sure/WikipediaParser3
- Click on the green button toward the top right of the page.
- Copy the text URL inside the menu.
- Open Command Prompt and navigate to the directory you would like to store the source and executable for Wikipedia Parser.
- Type in the prompt: git clone https://github.com/Macdaddy4sure/WikipediaParser3.git
- Use DirectoryUpLevel.exe to move all files inside of ./articles to another directory.
- DirectoryUpLevel.exe is located inside the x64 directory under the cloned repository.
- Open DirectoryUpLevel.exe and type in the path to the articles directory.
- I recommend creating a directory on the same level as the articles directory and call it ./Done.
- Enter that directory into the second prompt in DirectoriesUpLevel.
- Press enter and the process will be executed.
- Open Command Prompt and Create a new database inside of MySQL for the Wiki you are uploading.
- Open WikipediaParser3 and configure the program.
- Open WikipediaParser3
- Press 0 (Zero) and press enter to open the settings menu.
- Use the options in the menu to configure the program.
- Option 5. The Wiki Dump location should be the directory of the “Done” folder.
- Make sure all of the forward slashes are forward slashes (/).
- Press 0 to return to the main menu.
- Press 1 to start the process.
Filed under: Uncategorized - @ July 27, 2023 8:16 pm