dkoshman commited on
Commit
5663632
1 Parent(s): e539f81
.gitattributes CHANGED
@@ -31,3 +31,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
31
  *.zip filter=lfs diff=lfs merge=lfs -text
32
  *.zst filter=lfs diff=lfs merge=lfs -text
33
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
31
  *.zip filter=lfs diff=lfs merge=lfs -text
32
  *.zst filter=lfs diff=lfs merge=lfs -text
33
  *tfevents* filter=lfs diff=lfs merge=lfs -text
34
+ *.csv filter=lfs diff=lfs merge=lfs -text
app.py ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ import wandb
2
+ from machine_learning.recommending.app import app
3
+
4
+ wandb.init(job_type="app", project="Recommending", entity="dkoshman")
5
+ app.launch()
ml-25m/README.txt ADDED
@@ -0,0 +1,195 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Summary
2
+ =======
3
+
4
+ This dataset (ml-25m) describes 5-star rating and free-text tagging activity from [MovieLens](http://movielens.org), a movie recommendation service. It contains 25000095 ratings and 1093360 tag applications across 62423 movies. These data were created by 162541 users between January 09, 1995 and November 21, 2019. This dataset was generated on November 21, 2019.
5
+
6
+ Users were selected at random for inclusion. All selected users had rated at least 20 movies. No demographic information is included. Each user is represented by an id, and no other information is provided.
7
+
8
+ The data are contained in the files `genome-scores.csv`, `genome-tags.csv`, `links.csv`, `movies.csv`, `ratings.csv` and `tags.csv`. More details about the contents and use of all these files follows.
9
+
10
+ This and other GroupLens data sets are publicly available for download at <http://grouplens.org/datasets/>.
11
+
12
+
13
+ Usage License
14
+ =============
15
+
16
+ Neither the University of Minnesota nor any of the researchers involved can guarantee the correctness of the data, its suitability for any particular purpose, or the validity of results based on the use of the data set. The data set may be used for any research purposes under the following conditions:
17
+
18
+ * The user may not state or imply any endorsement from the University of Minnesota or the GroupLens Research Group.
19
+ * The user must acknowledge the use of the data set in publications resulting from the use of the data set (see below for citation information).
20
+ * The user may not redistribute the data without separate permission.
21
+ * The user may not use this information for any commercial or revenue-bearing purposes without first obtaining permission from a faculty member of the GroupLens Research Project at the University of Minnesota.
22
+ * The executable software scripts are provided "as is" without warranty of any kind, either expressed or implied, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. The entire risk as to the quality and performance of them is with you. Should the program prove defective, you assume the cost of all necessary servicing, repair or correction.
23
+
24
+ In no event shall the University of Minnesota, its affiliates or employees be liable to you for any damages arising out of the use or inability to use these programs (including but not limited to loss of data or data being rendered inaccurate).
25
+
26
+ If you have any further questions or comments, please email <grouplens-info@umn.edu>
27
+
28
+
29
+ Citation
30
+ ========
31
+
32
+ To acknowledge use of the dataset in publications, please cite the following paper:
33
+
34
+ > F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Transactions on Interactive Intelligent Systems (TiiS) 5, 4: 19:1–19:19. <https://doi.org/10.1145/2827872>
35
+
36
+
37
+ Further Information About GroupLens
38
+ ===================================
39
+
40
+ GroupLens is a research group in the Department of Computer Science and Engineering at the University of Minnesota. Since its inception in 1992, GroupLens's research projects have explored a variety of fields including:
41
+
42
+ * recommender systems
43
+ * online communities
44
+ * mobile and ubiquitious technologies
45
+ * digital libraries
46
+ * local geographic information systems
47
+
48
+ GroupLens Research operates a movie recommender based on collaborative filtering, MovieLens, which is the source of these data. We encourage you to visit <http://movielens.org> to try it out! If you have exciting ideas for experimental work to conduct on MovieLens, send us an email at <grouplens-info@cs.umn.edu> - we are always interested in working with external collaborators.
49
+
50
+
51
+ Content and Use of Files
52
+ ========================
53
+
54
+ Verifying the Dataset Contents
55
+ ------------------------------
56
+
57
+ We encourage you to verify that the dataset you have on your computer is identical to the ones hosted at [grouplens.org](http://grouplens.org). This is an important step if you downloaded the dataset from a location other than [grouplens.org](http://grouplens.org), or if you wish to publish research results based on analysis of the MovieLens dataset.
58
+
59
+ We provide a [MD5 checksum](http://en.wikipedia.org/wiki/Md5sum) with the same name as the downloadable `.zip` file, but with a `.md5` file extension. To verify the dataset:
60
+
61
+ # on linux
62
+ md5sum ml-25m.zip; cat ml-25m.zip.md5
63
+
64
+ # on OSX
65
+ md5 ml-25m.zip; cat ml-25m.zip.md5
66
+
67
+ # windows users can download a tool from Microsoft (or elsewhere) that verifies MD5 checksums
68
+
69
+ Check that the two lines of output contain the same hash value.
70
+
71
+
72
+ Formatting and Encoding
73
+ -----------------------
74
+
75
+ The dataset files are written as [comma-separated values](http://en.wikipedia.org/wiki/Comma-separated_values) files with a single header row. Columns that contain commas (`,`) are escaped using double-quotes (`"`). These files are encoded as UTF-8. If accented characters in movie titles or tag values (e.g. Misérables, Les (1995)) display incorrectly, make sure that any program reading the data, such as a text editor, terminal, or script, is configured for UTF-8.
76
+
77
+
78
+ User Ids
79
+ --------
80
+
81
+ MovieLens users were selected at random for inclusion. Their ids have been anonymized. User ids are consistent between `ratings.csv` and `tags.csv` (i.e., the same id refers to the same user across the two files).
82
+
83
+
84
+ Movie Ids
85
+ ---------
86
+
87
+ Only movies with at least one rating or tag are included in the dataset. These movie ids are consistent with those used on the MovieLens web site (e.g., id `1` corresponds to the URL <https://movielens.org/movies/1>). Movie ids are consistent between `ratings.csv`, `tags.csv`, `movies.csv`, and `links.csv` (i.e., the same id refers to the same movie across these four data files).
88
+
89
+
90
+ Ratings Data File Structure (ratings.csv)
91
+ -----------------------------------------
92
+
93
+ All ratings are contained in the file `ratings.csv`. Each line of this file after the header row represents one rating of one movie by one user, and has the following format:
94
+
95
+ userId,movieId,rating,timestamp
96
+
97
+ The lines within this file are ordered first by userId, then, within user, by movieId.
98
+
99
+ Ratings are made on a 5-star scale, with half-star increments (0.5 stars - 5.0 stars).
100
+
101
+ Timestamps represent seconds since midnight Coordinated Universal Time (UTC) of January 1, 1970.
102
+
103
+
104
+ Tags Data File Structure (tags.csv)
105
+ -----------------------------------
106
+
107
+ All tags are contained in the file `tags.csv`. Each line of this file after the header row represents one tag applied to one movie by one user, and has the following format:
108
+
109
+ userId,movieId,tag,timestamp
110
+
111
+ The lines within this file are ordered first by userId, then, within user, by movieId.
112
+
113
+ Tags are user-generated metadata about movies. Each tag is typically a single word or short phrase. The meaning, value, and purpose of a particular tag is determined by each user.
114
+
115
+ Timestamps represent seconds since midnight Coordinated Universal Time (UTC) of January 1, 1970.
116
+
117
+
118
+ Movies Data File Structure (movies.csv)
119
+ ---------------------------------------
120
+
121
+ Movie information is contained in the file `movies.csv`. Each line of this file after the header row represents one movie, and has the following format:
122
+
123
+ movieId,title,genres
124
+
125
+ Movie titles are entered manually or imported from <https://www.themoviedb.org/>, and include the year of release in parentheses. Errors and inconsistencies may exist in these titles.
126
+
127
+ Genres are a pipe-separated list, and are selected from the following:
128
+
129
+ * Action
130
+ * Adventure
131
+ * Animation
132
+ * Children's
133
+ * Comedy
134
+ * Crime
135
+ * Documentary
136
+ * Drama
137
+ * Fantasy
138
+ * Film-Noir
139
+ * Horror
140
+ * Musical
141
+ * Mystery
142
+ * Romance
143
+ * Sci-Fi
144
+ * Thriller
145
+ * War
146
+ * Western
147
+ * (no genres listed)
148
+
149
+
150
+ Links Data File Structure (links.csv)
151
+ ---------------------------------------
152
+
153
+ Identifiers that can be used to link to other sources of movie data are contained in the file `links.csv`. Each line of this file after the header row represents one movie, and has the following format:
154
+
155
+ movieId,imdbId,tmdbId
156
+
157
+ movieId is an identifier for movies used by <https://movielens.org>. E.g., the movie Toy Story has the link <https://movielens.org/movies/1>.
158
+
159
+ imdbId is an identifier for movies used by <http://www.imdb.com>. E.g., the movie Toy Story has the link <http://www.imdb.com/title/tt0114709/>.
160
+
161
+ tmdbId is an identifier for movies used by <https://www.themoviedb.org>. E.g., the movie Toy Story has the link <https://www.themoviedb.org/movie/862>.
162
+
163
+ Use of the resources listed above is subject to the terms of each provider.
164
+
165
+
166
+ Tag Genome (genome-scores.csv and genome-tags.csv)
167
+ -------------------------------------------------
168
+
169
+ This data set includes a current copy of the Tag Genome.
170
+
171
+ [genome-paper]: http://files.grouplens.org/papers/tag_genome.pdf
172
+
173
+ The tag genome is a data structure that contains tag relevance scores for movies. The structure is a dense matrix: each movie in the genome has a value for *every* tag in the genome.
174
+
175
+ As described in [this article][genome-paper], the tag genome encodes how strongly movies exhibit particular properties represented by tags (atmospheric, thought-provoking, realistic, etc.). The tag genome was computed using a machine learning algorithm on user-contributed content including tags, ratings, and textual reviews.
176
+
177
+ The genome is split into two files. The file `genome-scores.csv` contains movie-tag relevance data in the following format:
178
+
179
+ movieId,tagId,relevance
180
+
181
+ The second file, `genome-tags.csv`, provides the tag descriptions for the tag IDs in the genome file, in the following format:
182
+
183
+ tagId,tag
184
+
185
+ The `tagId` values are generated when the data set is exported, so they may vary from version to version of the MovieLens data sets.
186
+
187
+ Please include the following citation if referencing tag genome data:
188
+
189
+ > Jesse Vig, Shilad Sen, and John Riedl. 2012. The Tag Genome: Encoding Community Knowledge to Support Novel Interaction. ACM Trans. Interact. Intell. Syst. 2, 3: 13:1–13:44. <https://doi.org/10.1145/2362394.2362395>
190
+
191
+
192
+ Cross-Validation
193
+ ----------------
194
+
195
+ Prior versions of the MovieLens dataset included either pre-computed cross-folds or scripts to perform this computation. We no longer bundle either of these features with the dataset, since most modern toolkits provide this as a built-in feature. If you wish to learn about standard approaches to cross-fold computation in the context of recommender systems evaluation, see [LensKit](http://lenskit.org) for tools, documentation, and open-source code examples.
ml-25m/links.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd07bbd9aa8e76d263d8323ddd18ec87b6e00a79a68a5896afe9a737af22322b
3
+ size 1368578
ml-25m/movies.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c50dea6973e619f9bc1decd4afa3e35358b83a5fb663dac0ec82252a011d023d
3
+ size 3038099
ml-25m/ratings.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c85525758597dca76e8d98cebb9c13e018c2317b09a0878b6d383179526e385
3
+ size 678260987
ml-25m/tags.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84793c391a8e2a8b93190b5e780f781563a184c413d02ff2104cc2f442e2830a
3
+ size 38810332
requirements.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ wandb
2
+ ysda
svd.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16ba92d82dc2fac9629e34f4de0f9c228b123d093c2e9dcf95effd5c63133c26
3
+ size 701072999