6. Extract

Step 1: Convert datasets to bibliography files

Export each dataset from each in ".bib" format

1. WOS: select export >> Other File Formats >> Record Content: "Full Record and Cited References" >> File Format: BibTex , 500 records at a time,

   1. • Note: WoS cannot export works cited in excel format

2. Scopus: select All Results >> select BibTex Export. I had to download as excel to get the works cited list which was not available in BibTex format. Changing to the old Scopus view did allow this but it (see email from Michael Baker, Librarian UniSA, "Issue with exporting documents as BibTeX [240605-012500]") BUT it did not allow me to download the entire search list.

Step 2: Convert both to Bibliometrix format

1. Load Biblioshiny and run with this text:

library(bibliometrix)

biblioshiny() 

RStudio Version: 2024.04.1+748 | Released: 2024-05-11  (downloaded 4/6/2024)

2. Repeat this for both Scopus and WoS data: >> In Biblioshiny: Select Import raw file(s) >> Import the .bib file(s) >> select Save as Excel

3. Rename exported files with WOS.xlsx and Scopus.xlsx

   • Note: It appears that BiblioShiny only retains the first author of each cited reference (therefore, co-authors are not included)

Step 3: Merge manually from Excel (using WoS as template)

Merge the two datasets manually from Excel

1. Use Excel to open both WOS.xlsx and Scopus.xlsx files: Arrange windows in horizontal above/below arrangement >> select one file as master file (WoS) >> Both files will have the same tag fields in row 1, but the information will be arranged on different columns. (some less relevant information may not be present in one or the other, eg. URL is not present in WoS)

2. Simplify one of the files  to be used as the master: >> remove coloumns not required in the analysis >> rearrange the colomns in the second xlsx file to match the master file

3. Copy one file to the other manually

4. Remove duplicates using "Remove Duplicates" function under the data menu. The duplicate criteria set to author, year, and title .

Step 4: Additional Data Cleaning

See these steps for data cleaning

1. Use conditional formating

2. Then use Macros

Step 5: Load into Biblioshiny for Analysis

Step 1: Search databases

Scopus (.bib), WoS (.bib), Goggle Scholar (excel via Publish or Perish),  IEEE Explore (.bib), ACM (.bib), Science Direct (.bib), Pubmed (.txt).

Step 2: Format GS excel 

Keywords need to be separated by ';' (instead of ','). Rename tags according to guidelines provided by Biblioshiny. -- See FAQ -- : "Bibliometrix/biblioshiny need a bibtex file formatted exactly as exported by WoS or Scopus and with the full set of mandatory metadata (authors' name, affiliations, references, etc.). If not, it will not work." "WoS metadata is characterized by a higher quality than Scopus, and, if it is possible, I prefer to use WoS. On the other hand, Scopus is a better choice when your analysis regards Arts & Humanities. In this case, Scopus DB is extremely richer than WoS."

Step 3: Integration

Import data, one by one, into Biblioshiny, then export to Excel

1. Open a new document

2. Click on "data" and "Get data" and then "Launch Power Query Editor".

3. On the top right, click on "New Source" >> file >> Excel Workbooks >> Open the first file.

4. Import all remaining files similarly.

5. Select one of the files, >> click Append Queries >> Appnd Queries as new, 

6. In the new window, select "Three or more tables and add all the sheets to the "Tables to Append" window (Hold ctrl to select more than one sheet while adding) >> click OK.

7. This will append all the sheets together and give them a name such as "Append". Click on "Close and Load", which will load the data from all sheets to a new sheet.

8. Save the data in .xlsx format.

Step 4: Data Cleaning

1. Remove unwanted articles (using Conditional Formatting and Macro)

Next:

1. Remove any spaces in the merged file in the Author "AU" column

2. Replace empty values for "SR" and "SR full" columns as Nil for GS Data.

3. PY: don't need to sort by PY to remove old articles

4. Remove duplicates: "Title TI AND author AU AND year PY" : "Remove Duplicates"

5. Check for duplicate removals:  Home tab >> Conditional Formatting >> Highlight Cell rules >> Duplicate values used. (This will highlight duplicates not deleted by the merge above). 

6. Save the cleaned data in .xlsx format.