MythicalCow
commited on
Commit
•
6154f77
1
Parent(s):
74582bf
readme update
Browse files
README.md
CHANGED
@@ -100,6 +100,21 @@ widget:
|
|
100 |
|
101 |
'
|
102 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
103 |
|
104 |
# SentenceTransformer based on Snowflake/snowflake-arctic-embed-s
|
105 |
|
|
|
100 |
|
101 |
'
|
102 |
---
|
103 |
+
# Github and Technical Report
|
104 |
+
To view our technical report and for access to other model and dataset related scripts visit our github [Github](https://github.com/khoj-ai/timely/tree/main)
|
105 |
+
|
106 |
+
# Timely: An Embeddings Model For Temporal Reasoning
|
107 |
+
|
108 |
+
At Khoj, we develop open-source personal AI to simplify how people engage with machines. The RAG component in modern AI systems commonly uses an embedding model to retrieve relevant documents for a user query. This retrieved-context enables accurate and personalized responses.
|
109 |
+
|
110 |
+
However, most of these models struggle with temporal reasoning. For instance, if asked "Where was I last summer?", the model would struggle to understand the framing of that question. It requires us to understand the relativity of time (that 2010 is before 2011), and when summer might be (between May - September).
|
111 |
+
|
112 |
+
When we express dates, we often use shorthands like ‘back in June’, ‘on summer break’, and ‘06/15’; all syntaxes that models don’t presently handle well. As such, your embedding model may not find documents with dates within that specific period. This limitation is significant, given the importance of time and date in language and daily life.
|
113 |
+
|
114 |
+
To address this problem, we propose **Timely**, a comprehensive pipeline for date-aware dataset generation, model fine-tuning, and benchmarking. Specifically, our goal is to create models that can:
|
115 |
+
|
116 |
+
1. Identify natural language dates in queries and documents better
|
117 |
+
2. Can handle relative and soft data filters more naturally (e.g. discerning that June is closer than November when talking about Spring).
|
118 |
|
119 |
# SentenceTransformer based on Snowflake/snowflake-arctic-embed-s
|
120 |
|