\begin{table}[t]
\centering
\begin{tabular}{l|p{8cm}}
\hline
Active learners & All learners\\
\hline
Remaining learnable parameters & Encoder's architecture of all learners\\
\hline
Validation datasets& Validation datasets of all learners\\
\hline
Active auxiliary datasets & -- \\
\hline
Validation loss & The sum of every learner's validation loss on its validation dataset: $\sum_{k=1}^K L(A, \widetilde{W}_k^{(M)}(A), \widetilde{H}_k^{(M)}(A),D_k^{(\textrm{val})}) $ \\
\hline
Interaction function & -- \\
\hline
Optimization problem & $\textrm{min}_{A} \;
  \sum_{k=1}^K L(A, \widetilde{W}_k^{(M)}(A), \widetilde{H}_k^{(M)}(A),D_k^{(\textrm{val})})  $ \\
\hline
\end{tabular}
\caption{Validation stage in interleaving learning}
\label{tb:il-val}
\end{table}
Active learners All learners
Remaining learnable parameters Encoder’s architecture of all learners
Validation datasets Validation datasets of all learners
Active auxiliary datasets –
Validation loss The sum of every learner’s valida-
tion loss on its validation dataset:
PK L(A, W k(M) (A), H ek(M) (A), D k(val) )
k=1 f
Interaction function –
Optimization problem min PK L(A, W k(M) (A), H ek(M) (A), D k(val) )
A k=1 f