Initial commit of project folder
initial commit. Code currently can scrape a user page from Google Scholar or use a designated html file and then extract just the block of html containing the publication relevant data from the user page.
initial commit of test data file
Have parsed out paper info from html and used regular expressions to extract paper title, authors, and journal info. Year and citation info got lost in the extraction of paper info. Need to add code to extract that from html file.
initial commit. Forked off of import_html.py. This is now the main branch. Code extracts the citation table from Google Scholar html page and then parses the table into a list of lists for each list is the info for a single paper. It then cleans out some random empty list items that got created in the process, returning a list of lists where each item in a sub list contains paper info.
moved functioning code into functions. Added code to convert list of citation numbers to ints and add real zeros to the list for 'missing values'.
moved citation processing code to function. Added code to calculate h_index, and total citations. Currently working on mean and median.
Fixed the >100 papers in a profile problem by rewriting the get_Scholarprofile function. Code now can import <700 papers, extract citation data, and combine with data from the Google_Scholars csv file.
Linked extraction of scientist citation info with a SQL database. Code now deposits new citation info into the database and makes sure that a scientist is not already in the database before bothering google scholar.
deleted dead end for google project
renamed test_table.py to be more desciptive of the function of the file.
updated doc string
Changed hard limit to number of papers in get_Scholarprofile to a logic check where the while loop stops when an empty list is returned.
Removed median function and replaced with np.median. Removed typo in insert_newdata_into_db
added code to check if there is a url in the .csv file before executing functions
added code to extract records from ecologist citation database for analysis
now plots PhD year vs. h-index and conducts a simple linear regression on the two variables.
Added code to scrape institution from Google Scholar Page
removing extraneous testing code
Merge branch 'master' of github.com:weecology/bibliometrics