housekeeping before starting next task
starting to adapt the IF functions to SC data
rolling back some changes, errors introduced
IF data analysis - with only the necessary code for scdb_sna.demonstrate() uncommented
getting snowball sampling working. Implemented as test function to populate data rather than scrape SoundCloud and save - this is to do
Collecting User and Track data through snowball sampling, need to create follower/following data during collection then save all this data in an external DB
now populates data and entities (except entities.recognisers - TODO). To test, import getSoundCloudData as gscd; gscd.main()
snowball sampling now picks up x users, the follow relations between those users and the tracks associated with their users. To test, getSoundCloudData.main()
Starting to add functionality to export data to external sqlite db - not yet functional
Matching export db table structure against SoundCloud data structures
code now functional. getSoundCloudData downloads a sample of data (currently sample size 15) and saves to an external sqlite db file. scdb_sna demonstrates the analysis of soundcloud networking data based on follow relationships
pulling in full soundcloud data for each user including information on their likes, playlists, groups joined and comments on their tracks
not quite functional but gathers all data about a user and likes. small fix to do on the fields returned for groups, playlists, favourites and comments
debugging functions for saving data to DB and refining data collection
bugs fixed, now collects data from SoundCloud using exception handling and time delays. Some small bugs with duplicate comments/problems with tracks to sort out
minor changes
small edit to exception handling in clientGet() function
bugs fixed with duplicate items in sets. Python 2.7 issue with not recognising objects as being duplicates of each other - workaround of retaining lists of ids of objects within a set, to check an object isnt already in the set
bugs fixed with duplicate items in sets. Python 2.7 issue with not recognising objects as being duplicates of each other - workaround of retaining lists of ids of objects within a set, to check an object isnt already in the set. Still a bug to fix with adding track information to DB
bugs fixed with duplicate items in sets. Python 2.7 issue with not recognising objects as being duplicates of each other - workaround of retaining lists of ids of objects within a set, to check an object isnt already in the set. Still a bug to fix with adding track information to DB