Tabular-LLM-Study-Forward-Simulation

Sleeping

luulinh90s commited on Sep 18, 2024

Commit

215a612

1 Parent(s): 72d281f

update

Files changed (4) hide show

templates/attribution.html CHANGED Viewed

@@ -159,7 +159,7 @@
             <li>Green highlights (cells): Pinpoint the exact information (opposing team's score of 0) that directly answer the question.</li>
         </ul>
         <p>
-            During the experiment, you will use explanations to guess model prediction. Your task will be to look at the provided explanations and guess what the model says on the Statement (SUPPORTED or NOT SUPPORTED).
         </p>
         <button onclick="location.href='{{ url_for('index') }}'">Proceed to Experiment</button>
     </div>

             <li>Green highlights (cells): Pinpoint the exact information (opposing team's score of 0) that directly answer the question.</li>
         </ul>
         <p>
+            During the experiment, you will use explanations to guess model prediction (TRUE or FALSE), regardless of groundtruth.
         </p>
         <button onclick="location.href='{{ url_for('index') }}'">Proceed to Experiment</button>
     </div>

templates/experiment.html CHANGED Viewed

@@ -129,11 +129,11 @@
         <div class="buttons">
             <form action="{{ url_for('feedback') }}" method="post" onsubmit="showLoader()">
                 <input type="hidden" name="session_id" value="{{ session_id }}">
-                <button type="submit" name="prediction" value="TRUE"><h1>Model predicts: Supported</h1></button>
             </form>
             <form action="{{ url_for('feedback') }}" method="post" onsubmit="showLoader()">
                 <input type="hidden" name="session_id" value="{{ session_id }}">
-                <button type="submit" name="prediction" value="FALSE"><h1>Model predicts: Not supported</h1></button>
             </form>
         </div>
     </div>

         <div class="buttons">
             <form action="{{ url_for('feedback') }}" method="post" onsubmit="showLoader()">
                 <input type="hidden" name="session_id" value="{{ session_id }}">
+                <button type="submit" name="prediction" value="TRUE"><h1>Model will predict: TRUE</h1></button>
             </form>
             <form action="{{ url_for('feedback') }}" method="post" onsubmit="showLoader()">
                 <input type="hidden" name="session_id" value="{{ session_id }}">
+                <button type="submit" name="prediction" value="FALSE"><h1>Model will predict: FALSE</h1></button>
             </form>
         </div>
     </div>

templates/introduction.html CHANGED Viewed

@@ -65,7 +65,7 @@
         </div>
         <div class="sample-container">
-            <h2>Verify if the following Statement is SUPPORTED or NOT SUPPORTED</h2>
             <iframe srcdoc="
             <html><head>
             <style>
@@ -194,14 +194,14 @@
             </tr>
             </table>
             </body></html>
-            <h3>Model thinks this Statement is:</span> SUPPORTED</h3>
             </body></html>
             "></iframe>
         </div>
         <div class="outro">
             <h2>Your Task</h2>
-            <p>Your task in this experiment is to use an explanation to guess what the TableQA model will predict (Supported or Not supported).</p>
         </div>
         <div class="button-container">

         </div>
         <div class="sample-container">
+            <h2>Verify if the following Statement is TRUE or FALSE</h2>
             <iframe srcdoc="
             <html><head>
             <style>
             </tr>
             </table>
             </body></html>
+            <h3>Model thinks this Statement is:</span> TRUE</h3>
             </body></html>
             "></iframe>
         </div>
         <div class="outro">
             <h2>Your Task</h2>
+            <p>Your task in this experiment is to use an explanation to guess what the TableQA model will predict (TRUE or FALSE), regardless of the groundtruth. For example, if the model predicts TRUE but the Statement is FALSE, you should guess TRUE. The task is called Model Simulation.</p>
         </div>
         <div class="button-container">

templates/text2sql_intro.html CHANGED Viewed

@@ -116,21 +116,11 @@ WHERE opponents = 0;
                 <li>If the count is exactly 4, it returns 'TRUE', otherwise 'FALSE'.</li>
             </ol>
         </div>
-<!--        <div class="step">-->
-<!--            <div class="step-title">Explanation</div>-->
-<!--            <p>The SQL command serves as an explanation by showing:</p>-->
-<!--            <ul>-->
-<!--                <li>What data is being queried (the '1947_kentucky_wildcats_football_team' table)</li>-->
-<!--                <li>What condition is being checked (opponents = 0)</li>-->
-<!--                <li>How many instances should satisfy the condition (COUNT(*) = 4)</li>-->
-<!--                <li>What the final output means (TRUE if the condition is met, FALSE otherwise)</li>-->
-<!--            </ul>-->
-<!--        </div>-->
-        <h2>Text-to-SQL Example</h2>
-        <iframe src="{{ url_for('send_examples', filename='htmls_Text2SQL/TP/test-0.html') }}"></iframe>
-        <p>
-            In this example, you can see how the SQL command directly addresses the statement by counting the number of games where the opposing team didn't score.
-        </p>
         <button onclick="location.href='{{ url_for('experiment', session_id=session_id) }}'">Proceed to Experiment</button>
     </div>
 </body>

                 <li>If the count is exactly 4, it returns 'TRUE', otherwise 'FALSE'.</li>
             </ol>
         </div>
+<!--        <h2>Text-to-SQL Example</h2>-->
+<!--        <iframe src="{{ url_for('send_examples', filename='htmls_Text2SQL/TP/test-0.html') }}"></iframe>-->
+<!--        <p>-->
+<!--            In this example, you can see how the SQL command directly addresses the statement by counting the number of games where the opposing team didn't score.-->
+<!--        </p>-->
         <button onclick="location.href='{{ url_for('experiment', session_id=session_id) }}'">Proceed to Experiment</button>
     </div>
 </body>