# Evaluation Methods: Setting up an Experiment

A scientific method is a plan that is followed in performing a scientific experiment and writing up the results. It is not a set of instructions for just one experiment, nor was it designed by just one person. The scientific method has evolved over time after many scientists performed experiments and wanted to communicate their results to other scientists. The scientific method allows experiments to be duplicated and results to be communicated uniformly.\
&#x20;<img src="https://1763729276-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LiPPFFn8713gkOyphHP%2F-Lng1QCCFIWJHTiwmczw%2F-Lng1mR6bRX3_pUMjnrx%2Fmethods-techniques.png?alt=media&#x26;token=eca50feb-f82f-413c-8fb5-51b426d92e9f" alt="" data-size="original"> <img src="https://1763729276-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LiPPFFn8713gkOyphHP%2F-Lng1QCCFIWJHTiwmczw%2F-Lng1uX2-zJzY8Ha6AgN%2Fprocess.jpg?alt=media&#x26;token=5e07924b-89a1-422e-a08d-c92104a0e823" alt="" data-size="original">&#x20;

### Before you start to define your experiment&#x20;

#### **1: Explore,** think about your personal motivations and your team's ambitions. <img src="https://1763729276-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LiPPFFn8713gkOyphHP%2F-Lng1QCCFIWJHTiwmczw%2F-Lng1yGGf7WizuEPShnq%2Fexplore.jpg?alt=media&#x26;token=1b544c4c-5f06-4821-91ec-6ca8cb5c4333" alt="" data-size="original">&#x20;

* What kind of human interaction is necessary to explore: hands, feet, head, fingers, body?
* What kind of devices do you have and what user tasks can you explore? See Gabbard's taxonomy of usability characteristics below:

![Taxonomy of usability characteristics, Joseph Gabbard, 1997](http://sv.rkriz.net/classes/ESM4714/Student_Proj/class00/gabbard/overview.jpg)

### Defining your experiment

#### 2: Form a hypothesis

When preparing to do research, a scientist must form a hypothesis, which is an educated guess about a particular problem or idea, and then work to support it and prove that it is correct, or refute it and prove that it is wrong. <img src="https://1763729276-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LiPPFFn8713gkOyphHP%2F-Lng1QCCFIWJHTiwmczw%2F-Lng25GJC-9D1HH5Oo2l%2Fhypothesis.jpg?alt=media&#x26;token=a55c1fac-50da-4601-93be-03f8ebfd8d75" alt="" data-size="original">&#x20;

**3: Define your research question**

```
Main objective for research: what do I want to find out?
Main research question
Subquestions
```

**4: Think through your research method**

```
- What method will I use for testing? 
- What is the goal of this method?
- What are benefits of using this method? Any possible counter effects? 
```

![](https://1763729276-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LiPPFFn8713gkOyphHP%2F-Lng1QCCFIWJHTiwmczw%2F-Lng2AX0vAogYayvboMM%2Fdefine.jpg?alt=media\&token=228cc468-e53d-4d95-9082-7c6b7a80a6d6)

#### 5: Have a real good look at your evaluation metrics

* **Independent and Dependent Variables**\
  \
  A well-designed experiment needs to have an *independent* variable and a *dependent* variable. The independent variable is what the scientist manipulates in the experiment. The dependent variable *changes* based on how the independent variable is manipulated. Therefore, the dependent variable provides the data for the experiment.<br>

### **Validity and Reliability**

![](https://1763729276-files.gitbook.io/~/files/v0/b/gitbook-legacy-files/o/assets%2F-LiPPFFn8713gkOyphHP%2F-Lng1QCCFIWJHTiwmczw%2F-Lng2HivzR6LX0Lmt7kC%2Freliable-valid-white.png?alt=media\&token=c38a6b13-2842-4807-ae52-8d91d6890ff9)

**Validity**

Validity implies the extent to which the research instrument measures, what it is intended to measure. What is the accuracy of the measurement. *A valid instrument is always reliable.*&#x20;

**Reliability**

Reliability refers to the degree to which scale produces consistent results, when repeated measurements are made. Is the experiment executed in a precise manner and is it consistent with former experiments. *A reliable instrument need not be a valid instrument.*&#x20;

[Additional info](https://www.youtube.com/watch?v=2fK1ClycBTM) about Validity and Reliability
