Experimental Syntax Using IBEX / PCIBEX

.title[
# Experimental Syntax Using<br>IBEX / PCIBEX
]
.subtitle[
## SICOL 2022
]
.author[
### Nayoun Kim and June Choe
]
.date[
### August 12, 2022
]

---

.remark-code-line-highlighted {
  margin-left: .6em;
}

.showme:hover + .hide {
  display: block;
}

.hide {
  display: none;
}
.hide:hover {
  display: block;
}

.hljs-github .hljs-keyword {
  color: black;
  font-weight:normal;
}

.hljs-github .hljs-literal {
  color: black;
}

.hljs-github .hljs-string {
  color: black;
}

.hljs-github .hljs-number {
  color: black;
}

.blue{
  font-weight: bold;
  color: #003087;
}

.green{
  font-weight: bold;
  color: #006747;
}

.orange{
  font-weight: bold;
  color: #FB5315;
}

.purple{
  font-weight: bold;
  color: #9312A0;
}

.bl {
  font-weight: bold;
  color: black;
  border: 0px;
}

.super{
  vertical-align: super;
  font-size: .5em;
}

.sub{
  vertical-align: sub;
  font-size: .5em;
 }

/*-- 3 column layout --*/
.left-col {
  width: 29%;
  text-align: left;
  padding-left: 20px;
  padding-right: 20px;
  float: left;
}

.center-col {
  width: 29%;
  text-align: left;
  padding-left: 20px;
  padding-right: 20px;
  float: left;
}

.right-col {
  width: 29%;
  text-align: left;
  padding-left: 20px;
  padding-right: 20px;
  float: left;
}

.pull-left {
  padding-top: 0px;
}

.pull-left-narrow {
  float: left;
  width: 20%;
}

.pull-right-wide {
  float: right;
  width: 75%;
}

.pull-left-about {
  float: left;
  width: 30%;
}

.pull-right-about {
  float: right;
  width: 64%;
}

.deemph {
  color: #bebebe;
}

/* Clear floats after the columns */
.pull-right-wide + * { clear: both; }
</style>

# About us

.pull-left-about[.center[
  <img src="https://skb.skku.edu/_attach/professor/UixcDmscMvMXIToHMSbe.jpg" width="130px" style="margin-top:-20px;"/>
]]

.pull-right-about[.middle[]
  **Nayoun Kim** nayoun@skku.edu
  
  Assistant Professor, Sungkyunkwan University
  Department of English Language and Literature
  
  Syntax, Experimental Syntax, Psycholinguistics
  <br>
  <br>
  <br>
]

.pull-left-about[.center[
  <img src="https://yjunechoe.github.io/static/img/profile_rect.jpeg" width="150px"/>
]]

.pull-right-about[.middle[]
  **June Choe** yjchoe@sas.upenn.edu
  
  Ph.D. Student, University of Pennsylvania
  Department of Linguistics
  
  Psycholinguistics, Acquisition, Computational Linguistics
]

---

# Presentation Outline

.pull-left-narrow[.center[
  <img src="https://www.pcibex.net/wp-content/uploads/2019/04/pcibex-logo-3.png" width="80px"/>
]]

.pull-right-wide[.middle[]
  Introduction to [IBEX](https://github.com/addrummond/ibex/blob/master/docs/manual.md) and [PCIbex](https://doc.pcibex.net/)
  - Basic ideas (IBEX code + PCIbex farm)
  - Navigating the platform
  - File structure
]

.pull-left-narrow[.center[
  &nbsp;
  <svg viewBox="0 0 640 512" xmlns="http://www.w3.org/2000/svg" style="position:relative;display:inline-block;top:.1em;fill:#006747;height:4em;">  [ comment ]  <path d="M278.9 511.5l-61-17.7c-6.4-1.8-10-8.5-8.2-14.9L346.2 8.7c1.8-6.4 8.5-10 14.9-8.2l61 17.7c6.4 1.8 10 8.5 8.2 14.9L293.8 503.3c-1.9 6.4-8.5 10.1-14.9 8.2zm-114-112.2l43.5-46.4c4.6-4.9 4.3-12.7-.8-17.2L117 256l90.6-79.7c5.1-4.5 5.5-12.3.8-17.2l-43.5-46.4c-4.5-4.8-12.1-5.1-17-.5L3.8 247.2c-5.1 4.7-5.1 12.8 0 17.5l144.1 135.1c4.9 4.6 12.5 4.4 17-.5zm327.2.6l144.1-135.1c5.1-4.7 5.1-12.8 0-17.5L492.1 112.1c-4.8-4.5-12.4-4.3-17 .5L431.6 159c-4.6 4.9-4.3 12.7.8 17.2L523 256l-90.6 79.7c-5.1 4.5-5.5 12.3-.8 17.2l43.5 46.4c4.5 4.9 12.1 5.1 17 .6z"></path></svg>
]]

.pull-right-wide[
  Scripting an experiment
  - Overview of critical components
  - Code walkthrough
]

.pull-left-narrow[.center[
  &nbsp;
  <svg viewBox="0 0 384 512" xmlns="http://www.w3.org/2000/svg" style="position:relative;display:inline-block;top:.1em;fill:#768692;height:4em;">  [ comment ]  <path d="M224 136V0H24C10.7 0 0 10.7 0 24v464c0 13.3 10.7 24 24 24h336c13.3 0 24-10.7 24-24V160H248c-13.2 0-24-10.8-24-24zm160-14.1v6.1H256V0h6.1c6.4 0 12.5 2.5 17 7l97.9 98c4.5 4.5 7 10.6 7 16.9z"></path></svg>
]]

.pull-right-wide[
  Analysis of the results
  - Understanding the output format
  - Importing into Excel and R
]

---

# 1. Introduction to IBEX and PCIbex

---

# What is IBEX and PCIbex?

**IBEX**

- (.bl[I])nternet-(.bl[B])ased (.bl[EX])periments developed by Alex Drummond.

- Refers to both the **framework for scripting experiments** and the **platform for hosting experiments**.

- IBEX the _platform_ ["IBEXfarm"](https://adrummond.net/ibexfarm) has been [discontinued in late 2021](https://groups.google.com/g/ibexexperiments/c/UMnpZgawfIc), but the IBEX _framework_ survives and is supported by extensions and spinoffs.

<br>

**PCIbex**

- PennController for IBEX developed by Jeremy Zehr and Florian Schwarz at the University of Pennsylvania.

- A platform for hosting experiments that **supports and extends IBEX**

- Also introduces its own, alternative framework for scripting experiments.

---

---

---

# Navigating the PCIbex platform

- <p>Go to the PCIbex farm <a href='https://farm.pcibex.net'>https://farm.pcibex.net</a> </p>

- **Sign up** with an email (or **Log in**)

- Once logged in, click **Empty project** under **Start a new project**

- Change the name of the project at the top to something unique (e.g., "SICOL2022")

- Your new project will appear on the main page

---

# PCIbex Dashboard Interface

---

# Experiment file structure

**Resources**
- Files for experiment materials go here

**Scripts**
- Experiment scripts go here

**Aesthetics**
- Style sheets go here

**Modules**
- Controllers (a.k.a. "Elements") go here

]

---

# Experiment file structure

<strong style='color:#bebebe'>Resources</strong>
- .deemph[Files for experiment materials go here]

**Scripts**
- Experiment scripts go here

<strong style='color:#bebebe'>Aesthetics</strong>
- .deemph[Style sheets go here]

<strong style='color:#bebebe'>Modules</strong>
- .deemph[Controllers (a.k.a. "Elements") go here]

]

---

# 2. Scripting an experiment

---

# The script

When scripting with IBEX, we often only need **one file**: _main.js_

At creation, the default file looks like this:

This is a snippet of code from the **PCIbex scripting framework**, which is not the focus of the workshop today (we will briefly revisit PCIbex at the end).

---

# Writing your own script

To demonstrate the **IBEX scripting framework**, we use our own <strong><a href="ibex_files/full_exp.js">template file</a></strong>.

The following IBEX code _just works_ thanks to PCIbex's backward compatibility.

This script creates an [acceptability judgment experiment](https://farm.pcibex.net/r/YBYAwi/).

---

# A simple layout

]

**Parts of the `main.js` Script**

- Specifies the ordering of the different parts of the experiment

- Includes the actual material that will be shown to the participants

]

---

# A simple layout

]

**Body**

- Introduction page, consent form, directions, language background, demographic information, etc.

- Stimuli for the experiment

- **practice** trials
    
    - **critical** trials
    
    - **filler** trials

]

---

<h1 style='margin-bottom:0px'>Walkthrough of the components</h1>

---

# Our first experiment

**Study**: We are interested in how people recover from .bl[garden-path sentences].

.center[... <span style='vertical-align:super; font-size:.7em'>✓</span>[.sub[VP] dressed], the kitten ...]

**Hypothesis**: Verbs that are frequently .blue[transitive] make recovery (reanalysis) more difficult, compared to verbs that are frequently .green[intransitive].

**Prediction**: Lower .bl[acceptability ratings] in the transitive-biased condition (.blue[_gp.trans_]) than in the intransitive-biased condition (.green[_gp.intrans_]).

<div style = 'padding-top: 20px'>
.center[.bl[We also want a _within-participant_ design!]]
</div>

---

# Trial Syntax

For each trial in our acceptability judgment experiment, we write this code:

This is a list (array) of three elements (clearer with spacing):

.bg-washed-green.b--dark-green.ba.bw2.br3.shadow-5.ph3[

\[
<br>
`\(\quad\)`
\["_Condition name_", _Item Set #_ \],
<br>
`\(\quad\)`
"_Task Type_",
<br>
`\(\quad\)`
{s: "Sentence"}
<br>
\]

]

\[
\["_Condition name_", _Item Set #_ \],
<br>
`\(\quad\)`
"_Task Type_",
<br>
`\(\quad\)`
{s: "Sentence"}
\]

]

<p style='padding-top:25px'>We have one big list (bracket) which contains <strong>three elements</strong>:</p>

1. Another list, consisting of the _name of the condition_ and _item set number_

2. A string specifying the _type of task_ (also called **Controllers** or **Elements**)

3. A curly bracket (_braces_), which has "s" and the _sentence_ separated by a colon

---