SlowGuess/NeurIPS_2023_OCR huggingface dataset:
Hyperparameter	Value
Optimizer	Adam
Critic learning rate	3e-4
Actor learning rate	3e-4
Mini-batch size	256
Discount factor	0.99
Target update rate	5e-3
Policy noise	0.2
Policy noise clipping	(-0.5, 0.5)
TD3+BC parameter α	2.5
Architecture	Value
Critic hidden dim	256
Critic hidden layers	2
Critic activation function	ReLU
Actor hidden dim	256
Actor hidden layers	2
Actor activation function	ReLU
Random Net hidden dim	256
Random Net hidden layers	2
Random Net activation function	ReLU
UBER Parameters	Value
Random reward dim n	256
PEX temperature α	10
Table 4: Hyper-parameters sheet of UBER in Mujoco tasks.
Baselines Implementation. We adopt the author-provided implementations from GitHub for TD3 *, TD3+BC†, IQL‡, RLPD§ and DrQ-v2¶. All experiments are conducted on the same experimental setup, a single GeForce RTX 3090 GPU and an Intel Core i7-6700k CPU at 4.00GHz.
*https://github.com/s Fujim/TD3
$\dagger$ https://github.com/sfujim/TD3_BC
$\ddagger$ https://github.com/ikostrikov/implicit_q_learning
$\S$  https://github.com/ikostrikov/rlpd
https://github.com/facebookresearch/drqv2
Hyperparameter	Value
Optimizer	Adam
Critic learning rate	3e-4
Actor learning rate	3e-4
Mini-batch size	256
Discount factor	0.99
Target update rate	5e-3
Policy noise	0.2
Policy noise clipping	(-0.5, 0.5)
TD3+BC parameter α	2.5
Architecture	Value
Critic hidden dim	256
Critic hidden layers	2
Critic activation function	ReLU
Actor hidden dim	256
Actor hidden layers	2
Actor activation function	ReLU
Random Net hidden dim	256
Random Net hidden layers	2
Random Net activation function	ReLU
UBER Parameters	Value
Random reward dim n	100
PEX temperature α	10
Table 5: Hyper-parameters sheet of UBER in metaworld tasks.
Hyperparameter	Value
Optimizer	Adam
Critic learning rate	3e-4
Actor learning rate	3e-4
Mini-batch size	256
Discount factor	0.99
Target update rate	5e-3
IQL parameter τ	0.9
RLPD parameter G	20
Ensemble Size	10
Architecture	Value
Critic hidden dim	256
Critic hidden layers	2
Critic activation function	ReLU
Actor hidden dim	256
Actor hidden layers	2
Actor activation function	ReLU
Random Net hidden dim	256
Random Net hidden layers	2
Random Net activation function	ReLU
UBER Parameters	Value
Random reward dim n	256
PEX temperature α	10
Table 6: Hyper-parameters sheet of UBER in Antmaze tasks.