jilijeanlouis commited on
Commit
ae848cd
1 Parent(s): 61d5c71

Upload question-answering_deepset_xlm-roberta-base-squad2_tensorrt_inference/config.pbtxt with huggingface_hub

Browse files
question-answering_deepset_xlm-roberta-base-squad2_tensorrt_inference/config.pbtxt ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ name: "question-answering_deepset_xlm-roberta-base-squad2_tensorrt_inference"
2
+ max_batch_size: 0
3
+ backend: "python"
4
+
5
+ input [
6
+ {
7
+ name: "QUESTION"
8
+ data_type: TYPE_STRING
9
+ dims: [ -1 ]
10
+ },
11
+ {
12
+ name: "CONTEXT"
13
+ data_type: TYPE_STRING
14
+ dims: [ -1 ]
15
+ }
16
+ ]
17
+
18
+ output [
19
+ {
20
+ name: "output"
21
+ data_type: TYPE_STRING
22
+ dims: [ -1 ]
23
+ }
24
+ ]
25
+
26
+ instance_group [
27
+ {
28
+ count: 1
29
+ kind: KIND_GPU
30
+ }
31
+ ]
32
+
33
+
34
+ parameters: {
35
+ key: "FORCE_CPU_ONLY_INPUT_TENSORS"
36
+ value: {
37
+ string_value:"no"
38
+ }
39
+ }