Download - Ellen Bara Stolzenberg, Ph.D. CIRPs...Using the Data: 3 Perspec=ves Local campus research Program review and evaluation Merge with institutional data Institutional eﬀectiveness Campus

EllenBaraStolzenberg,Ph.D.AssistantDirector,CIRP

HigherEducationResearchInstituteUniversityofCalifornia,LosAngeles

�  Weaccomplishthismissionby:� Workingincooperationwithinstitutionsofhighereducation

�  Producinganddisseminatingoriginalresearch

�  Providingthetoolsandresourcestoutilizeresearchattheinstitutionallevel

�  Trainingresearcherstoadvanceinstitutionalassessmentandscholarshipinhighereducation

� Developingpartnershipswithhighereducationorganizationstopromoteinstitutionalexcellence

HERIMissionStatement“ThemissionoftheHigherEducationResearchInstituteistoinformeducationalpolicyandpromoteinstitutionalimprovementthroughanincreasedunderstandingofhighereducationanditsimpactoncollegestudents.”

TwoDimensionsofHERI

Grant-FundedResearch

• HHMI• HelmsleyTrust• NationalInstitutesofHealth• NationalScienceFoundation

• AnnualStudentSurveys• TriennialFacultySurvey

CIRPStudentSurveys*

CollegeSeniorSurvey

(CSS)

DiverseLearning

Environments(DLE)

YourFirstCollegeYear

(YFCY)

FreshmanSurvey(TFS)

Collegeentry Endof1styear 2ndor3rdyear Senioryear

*FacultySurveyadministeredevery3years

As=nI-E-O

Inputs

Environments

Outputs

Source:AssessmentforExcellence:ThePhilosophyandPracticeofAssessmentandEvaluationinHigherEducation(Astin,1991)

ImportanceofLongitudinalData� Linksurveyscompletedbythesameindividualatdifferentpointsintime

� Onlywaytoeffectivelyassesschange

� Demonstrategrowth

� Studentdevelopment

� Programevaluation

� Collegeimpact

HowCIRPsurveysareusedinlongitudinalassessment?� CIRPdatacanbeusedtoexamineassumptionsaboutthestudentexperienceandhowinstitutionalresourcesrelatetostudentlearning,growth,anddevelopment.

�  Institutionscanbenchmarkagainstthemselvesovertimetoexaminetrends,orlongitudinally(usingmultiplesurveys)toassessgrowthanddevelopment.

�  InstitutionscancomparetheirperformanceonindividualitemsandrelevantCIRPConstructstopeerinstitutions.

Conceptualiza=onofDiverseLearningEnvironmentsandAssessment�  Understandtheexperiencesoftargetpopulationstodiminishinequityandimproveexperiences

�  Needtoknowmoreaboutcreatingtheconditionstooptimizeengagementanddesireddiversityoutcomes

�  Understandhowtoimproveservicestomeetstudentneeds�  Builtonagrowingbodyofresearchwithdiversepopulationsatthecenter

�  Reviewed90+previousinstrumentsusedtoassessdiversityandcampusclimate

�  Builtonpreviousmodelsoftheenvironment,multiplecontextsofstudentexperience

�  Developedasurveythatlinkedclimate(perceptionsandbehaviors)andpractices(whatinstitutionsdo)withstudentoutcomes

DiverseLearningEnvironmentsProject� DLEwasnotjustasurvey.Partoflargermixedmethodsproject�  Sitevisits� AdministrationofDLEinstrument� AdvancedresearchmethodsandclimateassessmenttrainingatUCLA

�  SimultaneousdevelopmentofMMDLE–Multi-ContextualModelforDiverseLearningEnvironments

� NationalStudentClearinghousedatatostudyretention,combinedwithTFSdata

CampusClimateforDiversity

HistoricalLegacyofInclusion/Exclusion

PsychologicalClimate

(Perceptions)

BehavioralDimension

(InteractionsandPractices)

StructuralDiversity(TheNumbers)

Government/Policy Context Socio-historical Context

(Hurtado, Milem, Clayton-Pedersen, & Allen, 1999)

DLEInstrument

11

�  Integratedassessmentofclimate,diversitypractice,andoutcomes

�  Inclusiveofdiversesocialidentities�  Factors�  Longitudinal,orencourageitsuselinkedwithotherstudentdata

� Widelyavailable� Modulestargetingspecifictopics� Newfor2015

Op=onalModules� ClassroomClimate

� TransitiontotheMajor

�  IntergroupRelations

�  Spirituality(newfor2016)

� ClimateforTransferat2-YearInstitutions

� ClimateforTransferStudentsat4-YearInstitutions

DLEInstrument:Newfor2015� Additionoflimitedsetofquestionsaddressingsexualassault�  Students’experienceswith“unwantedsexualcontact”�  Follow-upsregardingincapacitation,physicalforce� Disclosurequestions

� Agnosticandatheistoptionsforreligiouspreference

� Additionalrace/ethnicityoptions� Reasonsforconsideringdroppingout

Factors

� Climate� Practices� Outcomes

•  Harassment(α=0.917)•  Microaggressions(α=0.889)•  PositiveCross-RacialInteraction(α=0.882)•  SatisfactionwithDiversePerspectivesonCampus(α=0.873)

•  InstitutionalCommitmenttoDiversity(α=0.857)

•  AcademicValidationintheClassroom(α=0.863)•  GeneralInterpersonalValidation(α=0.862)

•  CurriculumofInclusion(α=0.854)

•  Co-CurricularDiversityActivities(Campus-Facilitated)(α=0.903)

•  IntegrationofLearning(α=0.736)•  PluralisticOrientation(α=0.787)

•  SocialActionEngagement(α=0.799)

•  CivicAction(α=0.801)

Administra=on,Data,Reports,&Deliverables

Administra=on� Timing

� Customization� Welcome&Thankyoupages�  Invitation&reminders�  Logo

� Weboptionsfordisseminatingsurvey

� Additionalquestions� Upto20closed-endedquestions� Upto5open-endedquestions

Data� Accesstopreliminarydataduringadministration

� Finaldatafile

� Confidentialityvs.anonymity

� PersonalIdentifiers

� Mergingdata

Reports&Deliverables� Reports

�  InstitutionalProfile� FactorReport� ThemeReport

� Deliverables� PowerPoint�  Infographics

� Futureadditionstoreportingpackage�  Intergroupcomparisons� Themeinfographicsortargetedhandoutsfordifferentaudiences

Sample:Infographics

2015DLESample�  19,580students

� 26institutions

� 69.4%Female

� 20.8%First-Generation

Race/Ethnicity %NativeAmerican 0.2AsianAmerican 8.4Black/AfricanAmerican 5.7Hawaiian 0.2White,non-Hispanic 48.6Latino/a 20.5Unknown 10.1Twoormore,non-Hispanic 6.2

ClassStanding %Freshman/firstyear 14.4Sophomore/secondyear 23.6Junior/thirdyear 33.7Senior/fourthyear 18.0Fifth-yearsenior+ 10.4

SelectedFindings

71.8

89.682.7

23.3

69.0

28.4

0

10

20

30

40

50

60

70

80

90

100

�Iseemyselfaspartofthecampus

community

Ifasked,Iwouldrecommendthiscollegetoothers

Thiscollegehasalongstandingcommitmentto

diversity

Thiscollegehasalotofracial

tension

Thiscollegeprovidesthefinancial

supportIneedtostayenrolled

Imayhavetochoosebetween

financiallysupportingmyfamilyandgoing

tocollege

%AgreeorStronglyagree

Towhatextenthaveyouexperiencedthefollowingwithstudentsfromaracial/ethnicgroupotherthanyourown?

6.3

12.8

40.3

47.2

0

5

10

15

20

25

30

35

40

45

50

Hadtense,somewhathostile

interactions

Hadguarded,cautiousinteractions

Hadmeaningfulandhonestdiscussionsaboutrace/ethnicrelationsoutsideof

class

Sharedpersonalfeelingsandproblems

%Oftenorveryoften

Haveyoupersonallyexperiencedthefollowingformsofbias/harassment/discrimina:onwhileatthiscollege?

14.1 14.2 14.4 15.117.7

19.9

0

5

10

15

20

25

%Yes

Howmanycourseshaveyoutakenatthiscollegethatincludedmaterials/readingsabout...?

48.956.7

61.369.8

78.7 80.8

0

10

20

30

40

50

60

70

80

90

Disability Sexualorientation

Privilege Gender Socioeconomicclassdifferences

Race/ethnicity

%Oneormore

AssessingthePervasivenessofCollegeSexualAssault

•  11.0%ofwomenreportedunwantedsexualcontactcomparedto4.7%ofmen

•  Ratesofunwantedsexualcontactamongfemalesurveyrespondentsforindividualcampuses:3.9%to34.6%

Amongstudentswhoreportedunwantedsexualcontact:�  36.1%reportedtheeventoccurredwhileunabletoprovideconsentduetobeingdrugged,drunk,orotherwiseincapacitated

�  19.0%reportedtheeventinvolvedtheuseorthethreattousephysicalforce

�  57.5%indicatedtheallegedassailanthadanaffiliationwithcampus,and16.7%wereunsure

�  18.6%didn’ttellanyone,11.9%toldacounselorortherapist,5.0%toldacampusadministrator,3.9%toldcampuspolice,2.4%toldlocallawenforcement

�  77.7%toldafriend,15.2%toldaparent/guardian

UsingtheData:3Perspec=ves�  Localcampusresearch

�  Programreviewandevaluation�  Mergewithinstitutionaldata�  Institutionaleffectiveness�  Campusclimate�  Learningoutcomes�  Accreditation

�  Institutional-levelComparisons�  National�  Comparisongroups�  Institution-selectedpeers

�  HERIresearchusingnationaldata�  Peer-reviewedjournals�  Monographs�  Presentations�  BriefReports

NextStepsfortheDLE� Releaseof2015Infographic&Brief

� Continuetoanalyze2015data� Questionskips�  Surveydropoff�  Examinationacrossdemographics

� Newfor2016�  Socialidentityquestionaddedtothecore�  Addeddistinctionbetweenunwantedsexualcontactandsexualassault�  Timing,officialcomplaint,satisfactionwithoutcome

�  Spiritualitymodule

ContactInforma=onEllenBaraStolzenberg,PhD

AssistantDirector,CIRPUCLAHigherEducationResearchInstitute

(310)[email protected]