Update README.md
Browse files
README.md
CHANGED
@@ -38,10 +38,12 @@ def extract_last_assistant_response(input_text):
|
|
38 |
return response
|
39 |
|
40 |
|
|
|
|
|
|
|
|
|
41 |
|
42 |
|
43 |
-
text_to_anonymize = "Sophia had always been enchanted by Venice, a historic city nestled in the heart of the Venetian lagoon. She had explored Venice on numerous occasions, each visit revealing hidden treasures in the enchanting city. On her latest trip, Sophia met Marco, a local historian, who shared captivating stories about the history of Venice."
|
44 |
-
|
45 |
prompt = f'USER: Resample the entities: {text_to_anonymize}\n\nASSISTANT:'
|
46 |
inputs = tokenizer(prompt, return_tensors='pt').to('cuda')
|
47 |
output_entities = model.generate(inputs.input_ids, max_new_tokens=250, do_sample=False, top_k=50, top_p=0.98, num_beams=1)
|
@@ -57,6 +59,14 @@ output_resampled_text = tokenizer.decode(output_resampled[0], skip_special_token
|
|
57 |
|
58 |
|
59 |
print(output_resampled_text)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
```
|
61 |
…
|
62 |
# Dataset and Training Documentation for Audit
|
|
|
38 |
return response
|
39 |
|
40 |
|
41 |
+
text_to_anonymize = '''Our organization manages a sophisticated data analytics platform ([login to view URL]) that highlights our cutting-edge data visualization techniques. In response to evolving business needs, we've recognized the imperative to optimize our data handling processes. As part of this initiative, we're seizing the opportunity to standardize the codebase for our web and mobile applications using a unified approach with Vue.js.
|
42 |
+
We're currently seeking a talented developer to spearhead this transformation, ensuring a seamless separation between backend data processing and frontend presentation layers. The revised architecture will incorporate three critical APIs (Google Maps for location services, AccuWeather for weather data, and our in-house Analytica API for advanced analytics).
|
43 |
+
The backend restructuring is a critical component, designed to serve as a showcase for the capabilities of our Analytica API. The frontend, both for the web and mobile interfaces, will maintain the current user experience using the existing design assets.
|
44 |
+
We are actively searching for a Vue.js developer who can efficiently interpret our project vision and deliver an elegant, sustainable solution.'''
|
45 |
|
46 |
|
|
|
|
|
47 |
prompt = f'USER: Resample the entities: {text_to_anonymize}\n\nASSISTANT:'
|
48 |
inputs = tokenizer(prompt, return_tensors='pt').to('cuda')
|
49 |
output_entities = model.generate(inputs.input_ids, max_new_tokens=250, do_sample=False, top_k=50, top_p=0.98, num_beams=1)
|
|
|
59 |
|
60 |
|
61 |
print(output_resampled_text)
|
62 |
+
|
63 |
+
#output
|
64 |
+
'''
|
65 |
+
Our enterprise manages an advanced data analysis platform ([login to view URL]) that highlights our innovative data visualization methods. In response to evolving business needs, we've recognized the imperative to optimize our data handling processes. As part of this initiative, we're seizing the opportunity to standardize the codebase for our online and mobile applications using a unified approach with Vega.js.
|
66 |
+
We're currently seeking a talented developer to spearhead this transformation, ensuring a seamless separation between backend data processing and frontend presentation layers. The revised architecture will incorporate three critical APIs (Maple Maps for location services, MeteorWeather for weather data, and our in-house Analytica API for advanced analytics).
|
67 |
+
The backend restructuring is a critical component, designed to serve as a showcase for the capabilities of our Analytica API. The frontend, both for the web and mobile interfaces, will maintain the current user experience using the existing design assets.
|
68 |
+
We are actively searching for a Vega.js developer who can efficiently interpret our project vision and deliver an elegant, sustainable solution
|
69 |
+
'''
|
70 |
```
|
71 |
…
|
72 |
# Dataset and Training Documentation for Audit
|