\begin{table}[t]
\centering
\begin{tabular}{l|p{10.5cm}}
\hline
Skillearn & Learning by Passing Tests\\
\hline 
Learners & 1) Testee; 2) Tester \\
\hline
Learnable parameters &  1) Architecture of testee; 2) Network weights of testee; 3) Data encoder of tester; 4) Target-task executor of tester; 5) Test creator of tester. \\
\hline
Interaction function & Testee's prediction loss defined on the test created by the tester: $ L(A, W^{*}(A), \sigma(C, E^{*}(C), D_{b}))/|\sigma(C, E^{*}(C), D_{b})|$ \\
\hline
Learning stages &  Learning stage I: the testee learns its network weights on its training data: $W^{*}(A)=\min _{W} L(A, W, D_{ee}^{(\mathrm{tr})})$\newline
Learning stage II: the tester uses its test creator to select a subset of examples from the test bank, then it learns its data encoder and target-task executor on its training data and on the selected examples from the test bank: $E^{*}(C), X^{*}(C)=\min _{E, X} \;\; L(E, X, D_{er}^{(\mathrm{tr})}) +\gamma L(E, X, \sigma(C, E, D_{b})).$
\\
\hline 
Validation stage & 1) The testee updates its architecture to minimize the prediction loss on the test created by the tester; 2) The tester updates its test creator to maximize the testee's prediction loss and minimize its own validation loss. $\max _{C} \min _{A}\;\; \frac{1}{|\sigma(C, E^{*}(C), D_{b})|} L(A, W^{*}(A), \sigma(C, E^{*}(C), D_{b}))-\lambda L(E^{*}(C), X^{*}(C), D_{er}^{(\mathrm{val})}).$\\
\hline 
Datasets & 1) Training data of the testee; 2) Training data of the tester; 3) Validation data of the tester; 4) Test bank.\\
\hline
\end{tabular}
\caption{Instantiation of Skillearn to LPT}
\label{tb:sltolpt}
\end{table}
Skillearn Learning by Passing Tests
Learners 1) Testee; 2) Tester
Learnable parameters 1) Architecture of testee; 2) Network weights of testee; 3) Data
encoder of tester; 4) Target-task executor of tester; 5) Test
creator of tester.
Interaction function Testee’s prediction loss defined on the test created by the tester:
L(A, W ∗(A), σ(C, E∗(C), D b))/ |σ(C, E∗(C), D b)
|
Learning stages Learning stage I: the testee learns its network weights on its
(tr)
training data: W ∗(A) = min L(A, W, D )
W ee
Learning stage II: the tester uses its test creator to select a
subset of examples from the test bank, then it learns its data
encoder and target-task executor on its training data and on
the selected examples from the test bank: E∗(C), X∗(C) =
(tr)
min L(E, X, D ) + γL(E, X, σ(C, E, D b)).
E,X er
Validation stage 1) The testee updates its architecture to minimize the
prediction loss on the test created by the tester; 2)
The tester updates its test creator to maximize the tes-
tee’s prediction loss and minimize its own validation loss.
max min |σ(C,E∗1 (C),Db)|L(A, W ∗(A), σ(C, E∗(C), D b))
C A −
(val)
λL(E∗(C), X∗(C), D ).
er
Datasets 1) Training data of the testee; 2) Training data of the tester;
3) Validation data of the tester; 4) Test bank.