\begin{table}[tbh]
\centering
\caption{Data augmentation specifications and the model architectures of the supervised reward models and the discriminators.}
\begin{tabular}{l|r}
\hline
Discriminator / Reward Network & Specifications                                 \\ \hline
Residual Conv Blocks           & {[}2, 2, 2{]}                                  \\
Conv Channels                  & {[}16, 32, 32{]}                               \\
Conv Kernels Sizes             & {[}(3, 3), (3, 3), (3, 3){]}                   \\
Pooling                        & MaxPooling = {[}(2, 2), (2, 2), (2, 2){]}      \\
Activation                     & ReLU                                           \\
Supervised Reward Loss         & Mean-Squared Error                             \\
Optimizer              & Adam~\citep{kingma2014adam}                                                                                 \\
Learning Rate (Supervised)     & 0.0001 \\ 
Learning Rate (Discriminator)  & 0.00001 \\
\hline
Data Augmentation              & Specifications                                  \\ \hline
Dropout                        & ProbKeep=0.5                                   \\
Random flip                    & Horizontal                                     \\
Random crop ratio              & 0.8                                            \\
Random satuation range         & {[}0.5, 2.0{]}                                 \\
Random hue                     & max\_delta=0.05                                \\
Random contrast range          & {[}0.5, 2.0{]}                                 \\
Clipped pixel noise            & {[}-16, 16{]}                                  \\
\hline
\end{tabular}
\label{table:reward_model_spec}
\end{table}
Discriminator / Reward Network Specifications
Residual Conv Blocks
Conv Channels
Conv Kernels Sizes
Pooling
Activation
Supervised Reward Loss
Optimizer
Learning Rate (Supervised)
Learning Rate (Discriminator) [2, 2, 2]
[16, 32, 32]
[(3, 3), (3, 3), (3, 3)]
MaxPooling = [(2, 2), (2, 2), (2, 2)]
ReLU
Mean-Squared Error
Adam (Kingma & Ba, 2014)
0.0001
0.00001
Data Augmentation Specifications
Dropout
Random flip
Random crop ratio
Random satuation range
Random hue
Random contrast range
Clipped pixel noise ProbKeep=0.5
Horizontal
0.8
[0.5, 2.0]
max delta=0.05
[0.5, 2.0]
[-16, 16]