Basic Course Items and Foundational Concepts

class: center, middle, inverse, title-slide

.title[
# Basic Course Items and Foundational Concepts
]
.subtitle[
## EDP 617
]

---

<div>
<style type="text/css">.xaringan-extra-logo {
width: 110px;
height: 128px;
z-index: 0;
background-image: url(/Users/skynet/Documents/WVU/Teaching/GitHub.nosync/edp617/static/img/course_hex.png);
background-size: contain;
background-repeat: no-repeat;
position: absolute;
top:1em;right:1em;
}
</style>
<script>(function () {
  let tries = 0
  function addLogo () {
    if (typeof slideshow === 'undefined') {
      tries += 1
      if (tries < 10) {
        setTimeout(addLogo, 100)
      }
    } else {
      document.querySelectorAll('.remark-slide-content:not(.title-slide):not(.inverse):not(.hide_logo)')
        .forEach(function (slide) {
          const logo = document.createElement('a')
          logo.classList = 'xaringan-extra-logo'
          logo.href = 'https://edp617.asocialdatascientist.com'
          slide.appendChild(logo)
        })
    }
  }
  document.addEventListener('DOMContentLoaded', addLogo)
})()</script>
</div>

---

class: highlight-last-item
layout: true

---

# Welcome!

---

# Your Teacher

.pull-left[
<center>
<img src="img/me.png" alt="Dr. Abhik Roy" style="width: 350px;"/>
</center>
]

.pull-right[
<br>
<br>
<br>
<br>
<br>
<a href='https://iam.asocialdatascientist.com' target='_blank'>Dr. Abhik Roy</a><br>
Assistant Professor of Educational Psychology<br>
School of Education<br>
West Virginia University
]

---

# Overview

***What the &ast;&ast;&ast;&ast; is program evaluation?*** That question comes up more than you probably think! In practitioner-oriented fields like (but certainly not limited to) education and counseling, studies are often directed at developing and understanding the impact various programs have on those who receive services, those who provide services, and/or the larger context within which those programs operate. This mode of uncovering if something works and why it works is a basis for evaluating programs and in turn policy decision-making. Program evaluation has philosophical, theoretical, methodological, and practical peculiarities that make it necessary to devote an entire class to understanding why and how it is done. This course is designed to allow you to acquire an understanding of the choices available for and processes involved in conducting program evaluation by giving you hands-on experience conducting a small-scale evaluation study relevant to your interests.

---

# Course Objectives

By working hard and asking for help as needed, by the end of this course you should be able to do the following

> acquire knowledge of basic models and principles of program evaluation

> develop an understanding of program evaluation practice by designing and conducting an evaluation of a relevant program relevant

> gain an understanding of ethical, social, political, and cultural issues confronted by program evaluators

> write an evaluation report to meet stakeholder information and decision-making needs

---

# Course Materials

<br>
<br>
<br>
<br>
<br>
<br>
<center>
<div class = "rounded">
.pull-left[.tabtpl[
For submissions and grades go to<br><br>
[eCampus](https://ecampus.wvu.edu/)
]]
</div>
</center>

<center>
<div class = "rounded">
.pull-right[
For everything else and then some go to<br><br>
[EDP 617 course site](https://edp617.asocialdatascientist.com)
]
</div>
</center>

---

# Texts

.center2[
To help minimize costs, you do not have to purchase any physical texts. We'll rely on the various upcoming texts and barring the APA 7th edition handbook, they are available through the [WVU library](https://library.wvu.edu/) as digital editions.
]

---

## Required

<br>
<br>
<br>
<br>
.pull-left[
Davidson, E. J. (2007). <i>Evaluation methodology basics: The nuts and bolts of sound evaluation</i> (1st ed.). SAGE.
  - Free: [Digital](https://libwvu.on.worldcat.org/oclc/646022580)
  - Not Free: [Physical](https://us.sagepub.com/en-us/nam/evaluation-methodology-basics/book226129)
]

.pull-right[
<center>
<img src="img/eval-text.png" alt="Counseling Text" style="width: 150px;"/>
</center>
]

---

## Optional

<br>
<br>
<br>
.pull-left[
American Psychological Association. (2020). *Publication manual of the American Psychological Association* (7th ed.).
  - Free(ish): <a href='https://libguides.wvu.edu/apa' target='_blank'>APA 7th Edition Citation Style Guide</a>
  - Not Free: <a href='https://apastyle.apa.org/products/publication-manual-7th-edition' target='_blank'>Physical</a>
]

.pull-right[
<center>
<img src="img/apa7th-text.png" alt="APA 7th Ed. Text" style="width: 150px;"/>
</center>
]

---

<br>
.pull-left[
Dillman, D.A., Smyth, J.D., &amp; Christian, L.M. (2014). <i>Internet, phone, mail, and mixed-mode surveys: The Tailored Design Method</i> (4th ed.). Wiley.
  - Free: [Digital](https://ebookcentral.proquest.com/lib/wvu/detail.action?docID=1762797)
  - Not Free: [Physical](https://www.wiley.com/en-us/Internet%2C+Phone%2C+Mail%2C+and+Mixed+Mode+Surveys%3A+The+Tailored+Design+Method%2C+4th+Edition-p-9781118456149)
]

.pull-right[
<center>
<img src="img/survey-text.png" alt="Internet, Phone, Mail, and Mixed-Mode Surveys" style="width: 150px;"/>
</center>
]

<br>
<br>
.pull-left[
Mertens, D. M. (2018). <i>Mixed methods design in evaluation</i>. SAGE.
  - Free: [Digital](https://methods-sagepub-com.wvu.idm.oclc.org/book/mixed-methods-design-in-evaluation)
  - Not Free: [Physical](https://us.sagepub.com/en-us/nam/mixed-methods-design-in-evaluation/book249777)
]

.pull-right[
<center>
<img src="img/mixedevals-text.png" alt='Mixed Methods Designs in Evaluation' style="width: 150px;"/>
<center>
]

---

.center2[
*There will also occasionally be additional articles and videos to read and watch. When this happens, links to these other resources will be included on the content page for that session.*
]

---

# Class Focus on

<br>
<br>
<br>
.pull-left[
**Content**
  >- Evaluation Fundamentals
  >- Methods and Methodology
  >- Principles and Ethics
]

.pull-right[
**Practice**
  >- Evaluative Process
  >- Design and Analysis
  >- Reporting and Utility
]

---

# What I expect

- Keeping an open line of communication

- A lot of work

- Attending scheduled meetings

- Putting in your fair share of work in the evaluation

- Asking questions and reaching out as needed<sup>1</sup>

.footnote[<sup>1</sup> after going over all of the material independently]

---

# Assignments and Distribution

You can find descriptions for all the assignments on the [tasks page](https://edp617.asocialdatascientist.com/tasks/).

<br>

<table class=" lightable-paper table table-hover table-condensed table-responsive" style="font-family: Roboto Condensed; margin-left: auto; margin-right: auto; width: auto !important; margin-left: auto; margin-right: auto;">
 <thead>
  <tr>
   <th style="text-align:center;color: #f7f7f7 !important;background-color: transparent !important;"> Percent </th>
   <th style="text-align:left;color: #f7f7f7 !important;background-color: transparent !important;"> Assignment </th>
   <th style="text-align:left;color: #f7f7f7 !important;background-color: transparent !important;"> Submission </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 15 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Weekly Tasks </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Slack </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 15 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Synchronous Meetings </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Zoom </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 5 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Evaluation Prospectus </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> eCampus </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 20 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Needs Assessment </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> eCampus </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 15 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Evaluation Proposal </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> eCampus </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 25 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> Final Report </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> eCampus </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;"> 5 </td>
   <td style="text-align:left;width: 15em; color: #ffffff !important;vertical-align: middle !important;"> Presentation of Results </td>
   <td style="text-align:left;width: 9em; color: #ffffff !important;vertical-align: middle !important;"> eCampus/Slack </td>
  </tr>
</tbody>
</table>

</center>

---

# Assessment and Grading

<br>
<br>
<br>
<table class=" lightable-paper table table-hover table-condensed table-responsive" style="font-family: Roboto Condensed; margin-left: auto; margin-right: auto; width: auto !important; margin-left: auto; margin-right: auto;">
 <thead>
  <tr>
   <th style="text-align:center;color: #f7f7f7 !important;background-color: transparent !important;"> Grade </th>
   <th style="text-align:left;color: #f7f7f7 !important;background-color: transparent !important;"> Range </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> A </td>
   <td style="text-align:left;width: 6.5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 90% – 100% </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> B </td>
   <td style="text-align:left;width: 6.5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 80% - 89% </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> C </td>
   <td style="text-align:left;width: 6.5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 70% – 79% </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> D </td>
   <td style="text-align:left;width: 6.5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> 60% – 69% </td>
  </tr>
  <tr>
   <td style="text-align:center;width: 5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> F </td>
   <td style="text-align:left;width: 6.5em; color: #ffffff !important;vertical-align: middle !important;color: #f7f7f7 !important;background-color: transparent !important;"> &lt; 60% </td>
  </tr>
</tbody>
</table>

---

# Questions

<br>
<br>
<br>
.pull-left[
<center>
<img src='img/in-the-syllabus.png' alt='Email Instructions' width="500px">
</center>
]

.float-vertical-align[
<br>
<br>
<br>
.pull-right[
...unless its not (nor can you find it on the course website). In those cases try using one of the three primary modes of contact

<center>
<div class="container">
    <figure>
        <a href="https://edp617spring2023.slack.com" target='_blank'>
        <img src="img/slack-ico.png" width="55px" />
        <figcaption>Slack</figcaption>
        </a>
    </figure>
    <figure>
        <a href="mailto:abhik.roy@mail.wvu.edu" target='_blank'>
        <img src="img/email-ico.png" width="55px" />
        <figcaption>Email</figcaption>
        </a>
    </figure>
    <figure>
        <a href="https://calendly.com/nopiecharts/short15" target='_blank'>
        <img src="img/zoom-ico.png" width="55px" />
        <figcaption>Zoom</figcaption>
        </a>
    </figure>
</div>
</center>
]
]

---

# That's it!

After reviewing the site if you have questions, please send them along...

<center>
<a rel="license" href="http://creativecommons.org/licenses/by-nc-sa/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png" /></a><br /><br />This work is licensed under a <br /><a rel="license" href="http://creativecommons.org/licenses/by-nc-sa/4.0/">Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License</a>
</center>