Is there an equivalent for PubMed (abstracts or full?)
#1
by
wdavies
- opened
This wikipedia embedding database is great! I've used it for testing Q&A, but I'm now wondering if there is an equivalent, but for PubMed abstracts. I've seen you have PubMedBert embeddings, but that's not the same as a pre-indexed set of retrievable docs.
I've scoured the internet thinking someone would have done this as a service to humanity, but apparently not. Given how many people have processed PubMed in various forms for LLMs, is there a legal or logistical reason why this hasn't been done yet?
Answered here: https://github.com/neuml/txtai/issues/598
davidmezzetti
changed discussion status to
closed