\begin{table}[t]
\centering
\begin{tabular}{l|p{8cm}}
\hline
Active learners & The first learner\\
\hline
Active learnable parameters & Weights of the data encoder and weights of the task-specific head in the first learner\\
\hline
Supporting learnable parameters & Encoder architecture shared by all learners \\
\hline
Active training datasets &  Training dataset of the first learner\\
\hline
Active auxiliary datasets & --  \\
\hline
Training loss &  The first learner trains the weights of its data encoder and the weights of its task-specific head on its training dataset: $L(A, W^{(1)}_1, H^{(1)}_1,D_1^{(\textrm{tr})})$.  \\
\hline
Interaction function & -- \\
\hline
Optimization problem &  $\widetilde{W}_1^{(1)}(A) =\textrm{min}_{W^{(1)}_1,H^{(1)}_1} \; L(A, W^{(1)}_1, H^{(1)}_1,D_1^{(\textrm{tr})})$ \\
\hline
\end{tabular}
\caption{Learning stage 1 in interleaving learning}
\label{tb:il-1}
\end{table}
Active learners The first learner
Active learnable parameters Weights of the data encoder and weights of the
task-specific head in the first learner
Supporting learnable parameters Encoder architecture shared by all learners
Active training datasets Training dataset of the first learner
Active auxiliary datasets –
Training loss The first learner trains the weights of its data
encoder and the weights of its task-specific head
(1) (1) (tr)
on its training dataset: L(A, W , H , D ).
1 1 1
Interaction function –
Optimization problem (1) (1) (1) (tr)
W (A) = min L(A, W , H , D )
f 1 W 1(1),H 1(1) 1 1 1