Florida State University

Instructional Systems
Open & Distance Learning Program

-- Masters Portfolio --
for
Anthony R. Artino, Jr.





Florida State
University

Instructional
Systems


Highly Skilled

Evaluation & Research

Gathering and interpreting data applicable to various aspects of improving human performance for the purpose of making management and instructional decisions.

1. Assesses and synthesizes data from a variety of sources and draws logical conclusions from available information (excluding formative evaluation).

In EME 6636: A Systems Approach to the Management of Change, I worked with a group of classmates to conduct background research on the topic of individual change as it relates to initiating and maintaining long-term physical activity. For approximately three weeks, we reviewed journal articles, fitness web sites, and government reports in an attempt to formulate a problem statement and analyze that problem according to the transtheoretical model of personal change. In my final report entitled Analysis of Individual Change: Initiating and Maintaining Long-Term Physical Activity in American Adults, I synthesized all of our research, drew logical conclusions, and made overall recommendations. For example, on page 3 I pulled data from the Surgeon General's report on Physical Activity and Health and establish a problem statement. Then, on page 5 I began analyzing the problem using concepts from the transtheoretical model of personal change. Finally, in the last section of the report I drew conclusions and made recommendations in the form of a roadmap for personal change.

2. Conducts formative evaluations of products.

 

In EME 6415: Development of Computer Courseware, two other students and I wrote storyboards detailing instruction for an interactive, Web-Based Tutorial about how to create a drag and drop interaction using Macromedia's Authorware. After completion of the storyboard, we asked three potential learners to test out the instruction. We then took the results from this formative evaluation (a.k.a., "alpha test") and compiled an Excel spreadsheet so that we could analyze, vote on, and decide which comments to incorporate and which comments to ignore. Receiving this outside perspective was extremely valuable to our design and development process and helped us see problems that we did not realize existed.

3. Designs and implements appropriate assessments of human performance and organizational results.


In EDF 5461: Introduction to Program Evaluation, I wrote a report entitled Evaluation Study Design. Within this report, I discussed the implementation of appropriate measures designed to assess the overall performance of the Naval Aviation Survival Training Program. This report not only laid the foundation for completing the program evaluation, but also discussed the procedures needed to make an overall value assessment, as judged by program stakeholders and experts in the field of aviation survival training. For example, on page 8 I discussed the evaluation plan, which included multiple assessment tools such as a subject matter expert curriculum review, stakeholder interviews, post-course student questionnaires, and pre/post test scores.

4. Designs and implements appropriate assessments of human learning.


Designing and implementing well-written assessments is an essential part of any good instructional design process. While taking EDF 5445: Assessment of Learning Outcomes, I had the opportunity to write multiple performance objectives relevant to learners in my academic specialization and then create assessment items designed to test attainment of these objectives. I created short-answer questions , essay items (with scoring plans), multiple-choice questions, and true/false items all designed to measure different types of knowledge (i.e., declarative, procedural, and problem solving).

 
Copyright 2004, Anthony R. Artino, Jr.
[Home] [Introduction] [Table of Contents] [Analysis] [Design]
[Implementing Media & Technology] [Evaluation & Research] [Management] [Communication]