Carteret Community College Title III Grant

February 23, 2009

9th Annual Texas A&M Assessment Conference

aggie-bonfire-memorialAggie Bonfire Memorial

(Texas A&M…a marker for each student who lost her/his life, positioned so that they are looking toward that student’s hometown)

9th Annual Assessment Conference
Texas A&M University
Feb 22-24, 2009
Conference Title:  Using Assessment to Demonstrate Improvement

I’m off to College Station, Texas to take part in this well-known, well-established conference on assessment in higher education.  I am really looking forward to it because of the array of sessions that have direct relevance to the assessment activities that we are putting in place (through Title III) at Carteret Community College.  I’m going to use this space over the next couple of days to report – both during and after – the sessions I am attending.    With a look at the agenda, here are the sessions that I plan on attending.

Sunday February 22
Pre-Conference Workshop (2:00-5:00)
Program Assessment: What to Know, Do, and Avoid
Instructor: Dr. Susan Hatfield; Winona State University

Why I’ve signed up for this workshop –
The brief description in the conference program promotes the workshop as a review of “best practices and bad ideas in program level assessment,” with an opportunity for participants to “consider what to assess, how to do it, and what it all might mean.”  This description is attractive to me on a number of levels.

First, I have spent the last two years working on the Program Review process at CCC, and a lot of it has been learn-as-you-go.  This workshop will (I hope), give me an opportunity to explore this process (most likely in part, not in whole) in retrospect in a setting where ideas are shared by people from across the country who are in my shoes.

Second, if it only focuses on Program Outcomes, that’s OK as well.  This is still a critical piece of the Program Review process, and it will play a larger role as we focus more creating a logical connection between program outcomes and funding.

Finally, I am looking forward to this workshop because, as I mentioned above, I am keen on hearing how other schools are approaching this task – how they are defining Program Outcomes, how they are assessing them, and how they are meeting the challenges inherent in establishing such a systematic program.

My post-session impressions –
This was not as much about Program Review as it was about program level learning outcomes (PLLOs). Indeed, she spent a few minutes arguing how PLLOs were not program assessment [I can agree with the not program assessment part, but she did make it sound like never the twain shall meet…which I believe is inaccurate…PLLOs can very easily be a critical component of the review process…but that’s an argument for another day].

The workshop presenter laid out a coherent description of why PLLOs, how to write PLLOs, and how to assess them.  She talked primarily from the perspective of one who must inspire faculty to action regarding PLLOs, including making persuasive speeches to faculty regarding the connections between, for instance, his/her activities and the program’s need/desire to receive funding for a particular project.

We also talked a lot during this two-hour period about writing useful/articulate/concise outcomes.  What Susan spent a good deal of time on was curriculum mapping and rubrics.  She stressed the need to ensure that Program student learning outcomes were taught and assessed across the program. In connection to this, she talked about orphan outcomes or orphan courses – in either case, the PLLO is not assessed in a particular course (vertically – when looking at the completed map) or across a program (horizontally).  We are doing this to some extent, vis a vis the Gen Ed outcomes (ILLOs), and under Dr. Emory’s leadership and tutelage.

For me, there were two important take-aways from this session: 1) the discussion on rubrics.  Susan talked about different types of rubrics (e.g. Analytic & Holistic…summative and developmental), but she also gave us a great resource, which is the link to her office’s website that has a great repository of rubric samples:
http://www.winona.edu/air/rubrics.htm [While you’re at it, check out their Resources page…a little bit of everything IE, whether you are IE or are a part of the process:
http://www.winona.edu/air/resources.htm ].

2) The second take-away was, as it always is at conferences (which is why we go in the first place), the others at the round table.  The 200(?) people in the room sat at round tables, where they had randomly chosen to sit.  There were folks from Virginia, South Carolina, and Texas at our table. Rich discussions around all of the talking points took place. But the real gem for me was meeting the Assessment Specialist from the Office of Institutional Effectiveness at the University of Richmond (VA).  Ashley showed me a copy of their Assessment Workbook (and told me how to find download it from their website: http://oir.richmond.edu/Assessment.htm (it’s under “Assessment of Academic Programs”).   Their plan is similar to the one we’ve developed, but I like the extra-added dimension of dissemination of findings.  In other words, let’s not let this sit on a shelf…let’s have a discussion.

Below is a list of the sessions I intend to attend for the rest of the conference.  I’ll be checking in periodically and filling in the spaces with information about the sessions, along with my thoughts and Take-Aways.

Monday February 23

Plenary Speaker (9:00-10:30)
Mary Allen,

Prof. Emeritus, California State U.
Former Director, CSU System Institute for Teaching & Learning

Topic:  Assessing General Education Programs

Description: designing and implementing effective General Education assessment programs.

Powerpoint and handout can be downloaded HERE.

Dr. Allen provided an engaging, 1.5 hour presentation on developing an effective Gen Ed assessment plan on campus.  She provided many definitions around assessment, talking about Program Assessment, learning outcomes, the curriculum map/matrix, assessment plans, and rubrics.

Much of Dr. Allen talked about was familiar, and on the surface, not new.  However, for each of the areas she spoken on, she would add an interesting perspective or dimension.  When she talked about assessment (formative vs. summative) of learning outcomes, she framed it as a focus on “deep and lasting learning” versus “shallow and short-term.”  She stressed that assessment plans be: “Meaningful, Manageable, and Sustainable.”  The meaningful  and manageable seemed to be the thread that ran through the conference as most of the sessions addressed the need for buy-in if an assessment plan were to be successful.  Dr. Allen really emphasized these two points in order to make the process sustainable.

Other important points she made (for me, at least) were:
• Assessment plans should be multi-year and reasonable (again, the notion of creating buy-in).
• Assessment plans should be perceived as “a series of incremental improvements to the program.”  This is critical because often people want to large gains, quick.  Slow and steady wins the race was her message here.
• And the take away message for me was: When asking faculty to help read and score papers (for ILLOs, for instance), keep the numbers of papers low, get them in a room for an afternoon, train them, have them score the papers, discuss results (and use of) and let them go.  Get it done in the shortest time possible, and make sure they feel that they have done something meaningful.
Session 1 (10:45-11:45)
Ending the Paper Chase: Moving from Paper to Electronic Assessment Reporting

SACS Roundtable
12:00-1:30
General Education Competencies: Reviewer Expectations

Session 2 (1:30-2:30)
Building a Technology-Supported Culture of Assessment: Software Readiness Considerations

Session 3 (2:45-3:45)
Vertical Assessment: From Assent/Ascent to Descent/Dissent

Session 4 (4:00 – 5:00)
Achieving Institutional Effectiveness with a Multi-Layer Strategic Planning Process

Alternative:  Assessment to Promote and Sustain Online Programs

Communities of Practice Dinner
Classroom & Program Assessment

Session 5 (8:00-9:00)
QEP

David Carter of SACS, spoke on the QEP.
He talked primarily about the pitfalls that schools experience with their QEP plans.  I thought this one-hour presentation was both useful and interesting.  Particulary from the perspective of a school who is submitting it’s QEP plans within the next week (we hope!).

You can simply check out his powerpoint slides at his website.  Or, if you want the full multi-media experience, I did record his talk.  You can listen to it at the CCC iTunes site (or download it to your ipod and listen to it during your next jog).

To get the audio, go to:  The CCC iTunes Site
Scroll down to the Title III repository (under CCC Community).  Click on the Title III Grant icon.  Then, click on the Title III Grant icon again and it will take you to a list of audio files.  The last one, the “QAP”  is the one you want.  Click on it to listen, or click on “get” to download it to your computer.

p.s. if you go Dr. Carter’s website, you can download his lunch time plenary that he delivered on the day before on Gen Ed Competencies.  I don’t have the audio for this one.

Plenary (9:15-10:30)
Gloria Rogers
Using Assessment to Drive Improvement without Driving Faculty Crazy!

Advertisements

2 Comments »

  1. Great update on the T3 blog Don! There is no doubt Title III has been a major catalyst for Carteret Community College’s various self improvement initiatives. Great strides have been made in Distance learning as you point out and yes…it’s now time to put more focus and resources into assessment. Keep up the great work leading your T3 team in the areas of distance learning, advising and assessment. Great strides have been made, but as you well know there is still a great deal of work to do – the journey towards excellence is ongoing and a continued evolving process.

    Comment by Patrick Keough — February 27, 2009 @ 7:55 am | Reply

  2. Just passing by.Btw, your website have great content!

    _________________________________
    Making Money $150 An Hour

    Comment by Mike — March 1, 2009 @ 9:58 am | Reply


RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Create a free website or blog at WordPress.com.