MAC Meeting Minutes June 2007

Missouri Assessment Consortium
Meeting notes – June 21, 2007

The meeting was held at the MDHE offices. Beth Nolte hosted. Jeremy Kintzel served as historian. Other attendees/participants: Pat Gillman, Jeanie Crain, Martha Kirker, Douglas Dunham, Renee Rohs, Charles Van Middlesworth, Joe Lange, Kandis Smith, Ron Pennington, Janet Juhlin, Michael Cunningham.

Welcome and Introductions

Standardized Testing
Attendees discussed potential next steps for MAC regarding standardized general education assessment. Some institutions using the MAPP as a pre- and post-assessment stated that it was beginning to yield good longitudinal data for program review and potential value-added analysis, and was more affordable than the CLA. CLA users stated that recalculated scale scores, available ACT/SAT concordances, and ACT/COMPASS crosswalks were making the CLA more usable, but that more staff were potentially required to conduct program-level analysis. Other attendees stated that the lack of usability of CLA information had led them to switch to gen ed assessment incorporating the CAPP and/or C-BASE. Attendees discussed a new tool for assessment of distance education being piloted by ETS and the University of Phoenix. MAC members inquired as to the state of “leftover” funds held by the Value-Added Consortium; while there is considerable overlapping membership between the groups, the MVASL would need to make any decisions regarding use of those funds to support assessment or assessment research across the state.

MAPP users: State Fair, Northwest, Mineral Area, Missouri Southern, Missouri State
CLA users: MCC, Missouri Western.

Finally, attendees discussed potentially incorporating next steps on assessment into the 2008 statewide transfer conference. Jeremy Kintzel encouraged MAC members to contact him with any further reflections on the CLA, should the MDHE be asked by any national groups or commissions to formally comment on the experiences of participating institutions in Missouri.

Senate Bill 389/Core Course Outcomes Development
Jeremy Kintzel distributed copies of the SB 389 “implementation matrix” as published in the June CBHE meeting board book - (see PDF attachment at bottom of page). The MDHE is just beginning to define a process for development of statewide and institutional performance measures as directed in the legislation, although the Higher Education Funding Formula (HEFF) task force is engaging in strategic planning which will likely impact the development of performance measures under 389, as well as any eventual reintroduction of performance funding. Performance measures are mandated by SB 389 to be in place by July 1, 2008, and MAC is encouraged to comment during the process, with the recently published Guiding Principles on Assessment set forth as a useful model. Mr. Kintzel pledged more news as it becomes available, but encouraged institutions to regularly review the CBHE board book. Draft statements on accountability submitted by COPHE, MCCA, and Linn State are also included in the December 2006 board book.

Processes are more advanced for the development of core course outcomes as mandated in the legislation. Invitations have been extended for volunteers to join discipline workgroups which will begin work on entry- and exit competencies for a number of entry-level core college courses. Interested faculty and staff who have not yet seen the formal invitation sent to presidents/chancellors and chief academic officers are invited to contact Hillary.Fuhrman. MDHE staff are hopeful that the products of workgroup discussions will support more consistent messages from higher education regarding student preparation, as well as support seamless transfer, especially outside the articulated 42-hour block. MAC members discussed working collectively / formally on this issue, but decided to await further developments prior to charging a formal consortium.

Collaborative Research with the MDHE
Mr. Kintzel shared the intent of the MDHE to update its MOU and confidentiality agreements governing access to unit-record data in FY2008. Especially given the present timeline, the MDHE intends to renew an annual contract with the University of Missouri as an “authorized representative” under FERPA for purposes of program evaluation, although the MDHE will likely also seek to employ the revised documents in developing a similar relationship with DESE as greater unit-record K-12 data becomes available in the coming year. While unit-record data may be shared with DESE in the coming year (and vice-versa) for purposes of program evaluation, DESE’s constituents (local districts) would have access only to aggregate reporting.

Mr. Kintzel stated that although FERPA advisory letters published by the U.S.D.E. Family Policy Compliance Office mandated limited use of the “authorized representative” arrangement, there was interest within the MDHE in reserving a third MOU for collaborative research with at least one other Missouri institution for special research projects, and/or with single institutions on a medium-term rotating basis. Mr. Kintzel also shared his belief that institutions were also permitted to independently enter into a limited number of “authorized representative” MOUs with major feeder or transfer destination institutions for purposes of data sharing and program evaluation.

Mr. Kintzel stated that while there were other models for external access to unit-record education data, especially data stripped of identifying information or records assigned unique/secondary identification, MDHE staff believed it did not currently have appropriate data (e.g. name and date of birth) to assist institutions with multi-year transfer student follow-up as “directory information” as defined under FERPA. Mr. Kintzel advised institutions that the National Student Clearinghouse was likely the best option for this reporting, but that he was willing to assist institutions who might wish to approach the NSC as a consortium.

AIR / NASPA / NCCBP Reporting
Drs. Joe Lange, Ron Pennington, and Mr. Kintzel shared information from the annual AIR Forum. Dr. Pennington has since shared a report on the listserv regarding validation of NSSE and CSSE. Dr. Pennington also stated that St. Charles Community College will begin participating in the National Community College Benchmarking Project, which current incorporates over 100 benchmarked performance indicators. Interested MAC members may also contact Dr. Charles VanMiddlesworth for more information.

Finally, Ms. Pat Gillman and Drs. Kandis Smith and Delores Honey attended the recent conference of the National Association of Student Personnel Administrators (NASPA). The conference was recommended as a future source of useful information on outcomes assessment from a student services perspective.

Other Items

• Mr. Kintzel encouraged institutions to develop written policies on access to faculty evaluations by students, given relevant language in Senate Bill 389. Mr. Kintzel also encouraged MAC members to participate and/or spread the word regarding the upcoming discipline workgroups, and to work with BJ.White regarding program inventory updates. The new inventory is currently online. Mr. Kintzel also requested that MAC review the MDHE website to ensure that all past minutes were posted; Dr. Smith volunteered to review.
• Ms. Gillman suggested an online “common calendar” of group meetings, especially those with overlapping membership, to assist members in better planning travel, and for groups to perhaps maximize attendance by meeting on consecutive dates. MDHE is willing to host the calendar, provided information from participating groups.

Future Topics
MAC discussed the need to keep informed of developments regarding SB 389 implementation. Involvement in the 2008 COTA Transfer Conference as well as assistance with a future UCM Assessment Showcase were also discussed.

Next Meeting
Pat Gillman will host a meeting on Friday, August 10 at MDHE offices. Refreshments will be available at 9:30 prior to the 10:00 a.m. meeting.

Adjournment
The meeting was adjourned at 12:30 p.m.