Opfrisser onderzoek - Refresher research methods 2011 (CAW Bal)

Opfrisser Onderzoek ‘Hoe studeer ik succesvol af?’

6 September 2011

C.A.W. Bal

Hogeschool Zeeland Vlissingen

Research Refresher ‘How to graduate successfully?’

September 6, 2011

C.A.W. Bal

HZ University of Applied Sciences Vlissingen, The Netherlands

There are many books on research

Luckily, they all tell the same story.

7-9-2011 ‘Research Refresher’ – C.A.W. Bal, Hogeschool Zeeland

Become a competent researcher !

Research competency:

• Phase 1: Planning and preparing your research product: research proposal (background + theory)

• Phase 2: Executing your research product: work on site (practical component)

• Phase 3: Finalising the research product: report (shared knowledge)

• Researcher’s attitude product: success (or failure…)


What is research?

• Finding answers to questions

• In a structured manner:

7-9-2011

Question/ hypothesis

Orientation

Approach/ Strategy

Gathering data

Analysis

Answer

Sharing/ using

Research phases:

(complex/scientific)

Cycle Two-way

‘Research Refresher’ – C.A.W. Bal, Hogeschool Zeeland

What is research?

• Finding answers to questions

• In a structured manner:

7-9-2011

Question/ hypothesis

Orientation

Approach/ Strategy

Gathering data

Analysis

Answer

Sharing/ using

Research phases:

(complex/scientific)

Cycle Two-way


Research Proposal Practical component

Report

Phase 1: Planning and preparation


• 1.1 Sketch of problem, research question(s), goal

• 1.2 Literature and expert review

• 1.3 Research design (using )

1.4 Research proposal

Bricks

1.1 Research Question

• Ends with “?”

• Not too simple, not too complex

• Sum of subquestions answer the main question

• Define the scope and the concepts

• Link to theory and professional practice

• Specific Measurable Attainable Relevant Timed


SMART

Brick

1.1 Research Question

• Is this question OK?: “How can firm A improve business results?”

• How about this one?: “What are firm A’s legal, technical and marketing requirements for successful introduction of product Y on the Dutch market?”


Brick

1.2 Literature review

• Search strategy (diversity of sources, keep a log)

• Search terms (synonyms, language, combinations, theory…)

• Use databases (e.g. from the Mediatheek)

• Check references for further leads

• Mind the quality (recent, trustworthy)

• Be critical (arguments in favor, arguments against)

• Write summaries, and integrate findings in a chapter

Revise research question if needed


Brick

http://hz.nl/HZ/NL/Studeren+aan+de+HZ/Faciliteiten/Mediatheek/Informatiebronnen/Databanken.htm

1.3 Research design

• Research strategy

• Sample choice (size, representative)

• Operationalisation (e.g. “customer satisfaction”)

• Measurement instrument

• Data analysis method

It is the key to finding a proper answer


1.3 Research design

7-9-2011

Question + orientation

Approach/ Strategy

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation

Quantitative analysis

Answer/ discussion

Publication

Literature review

Grounded theory

Survey Case study Action

Research

Question-naire

Interview Secundary

data

Qualitative analysis


Question

Experiment

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data


Question

Experiment

Observation


Answer/ discussion

Publication

Literature review


Brick

Question

Experiment

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data



Brick

Grounded theory

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data


Question

Observation

Answer/ discussion

Publication

Grounded theory


Coldren, J., & Hively, J., (2009). Interpersonal Teaching Style and Student Impression Formation. College Teaching; Spring2009, 57 [2], pp. 93-98

4

Does this look like an effective teaching method? Could you derive a theory?


Brick

Grounded theory

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data



Brick

Survey

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data


Question


Answer/ discussion

Publication

Literature review

Survey

Question-naire


Brick

Survey

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data



Brick

Case study

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data


Question


Answer/ discussion

Publication

Literature review

Case study

Secundary data


Emerging Energy Research, (2008). Global Wind Turbine Markets and Strategies, 2008–2020 (New market study). [On-line, Hyperlink to pdf ] (price €3350). 4


Brick

http://www.emerging-energy.com/user/GlobalWindTurbineMarketsandStrategies20082020710920415_pub/TurbinePromo.pdf




Case study

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data



Brick

Action research

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data


Question

Answer/ discussion

Literature review

Action Research

Interview


Hall, D.T., Otazo, K.L., & Hollenbeck, G.P. (1999). Behind Closed Doors: What Really Happens in Executive Coaching. Organizational Dynamics, 27 [3], pp. 39-54


Brick

Action research

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Question

Experiment

Observation


Answer/ discussion

Publication

Literature review

Grounded theory


Research

Question-naire

Interview Secundary

data



Brick



This is the document that convinces yourself and outside parties (host company, tutors) that your research is worthwhile, well prepared, and organized in such a way that you will find an answer/result

Now they will invest in you!

(time, energy, resources, money…) (NB: Count on needing four weeks, after approval and start of the graduation assignment, for finalizing your research proposal)



It consists of several paragraphs (usually 3 to 5 pages):

• Introduction (sketch of the problem or task)

• Research question

• Theoretical framework

• Practical relevance

• Research design + instrument

• Project planning and scope

Write what you plan to do, and why

Use a solid set of references!

Project planning

• Do this upfront (in your research proposal)

• Arrange budget and access

• Timing usually runs out:

– Theory/literature

– Setting up interventions/equipment

– Interviews (travel, preparation)

– Questionnaire (participants, data)

• Leave time for analysis

7-9-2011

Allow some slack!


Phase 2: Executing your research


• 2.1 Gathering the data

• 2.2 Processing the data for interpretation

• 2.3 Monitor progress and quality

2.1 Gathering the data

• Think about access to your data

• Apply the rules for proper research:

– Objectivity

– Validity

– Ethics

– Reliability - Repeatability

– Transparency

NB: Violation disqualifies research findings


‘Increase our road capacity?’

7-9-2011

How do you apply these rules: – Objectivity: Measuring cars or opinions?

– Validity: Can we use existing simulation models?

– Ethics: Tell the truth or the desired outcome?

– Reliability: Who to trust on knowledge?

– Repeatability: Will we find the same next time?

– Transparency: Is it 100% clear what we did?


Observation

• Take notes

• Sample choice is important

• Be systematic, use a coding scheme

• You only see what you’re looking for

• Do not interpret, report facts


Brick

Questionnaire

• Frequently used

• Think research through, and pilot test

• Do not ask: ‘How well do you drive?’

But ask: ‘How often do you speed?’

Such a ‘Likert scale’ has a higher reliability and validity

• Know the limitations of your sample (non-respons)

7-9-2011

1 2 3 4

1 2 3 4

1 2 3 4

very good

very bad

‘Do you drink and drive?’ ‘Do you indicate direction?’

1 2 3 4

never always


Brick

Interview

• Prepare (background of interviewee, subject knowledge, professional appearance)

• Access (person, location, time)

• Topic list

• Timing

• Make a transcript

• Listen well, use follow-up questions

• Summarize the answers (as a check)

• Ask for further contacts, ideas, suggestions


Brick

Things you could read somewhere: • One windmill is enough to power 300 households

(But what size, for how long, where on the planet, etc)

• 5% population growth means doubling in 20 years (well, not quite, how about doubling every 14 years)

• 70% of the internet respondents have experienced crime (who are they, which crime, when, is this not a bit high)

• In the crisis every investor has lost 50% of his/her wealth (on average, exactly 50%, investor in what, what is wealth)

7-9-2011

Checking numbers and statistics


Things you could read somewhere: • One windmill is enough to power 300 households

(But what size, for how long, where on the planet, etc)

• 5% population growth means doubling in 20 years (well, not quite, how about doubling every 14 years)

• 70% of the internet respondents have experienced crime (who are they, which crime, when, is this not a bit high)

• In the crisis every investor has lost 50% of his/her wealth (on average, exactly 50%, investor in what, what is wealth)

These may be calculation or (more likely) copying accidents, but could also deliberately be put there to mislead!

7-9-2011

Checking numbers and statistics


2.2 Processing the data

• Code your ‘answers’ (into numbers or categories)

• Indicate relationships (between variables or categories)

• Show overview and structure through: key numbers, graphs, tables, schemes (make them self-explanatory)

• Use of Excel

Clear and logical


2.3 Monitor progress and quality

• Stay on track Adhere to your planning Be pragmatic, keep moving the project ahead

• Intervene/change if necessary Things do not always go as you plan them! Keep a record of changes and their justification


Phase 3: Finalizing the research


• 3.1 Interpret your data

• 3.2 Report your research (process and results)

3.1 Interpret your data

• Interpret in light of your research question

• Formulate conclusions and recommendations

• Compare with other research

• Report new applications and insights

• Propose further research

‘Skills’:


Analytical thinking, Logic and coherency,

Structured writing, Hard work,

Concentration

Creativity,



Brick

• The fun part: Reporting numbers in colourful graphs and tables. Such descriptive statistics are often useful

More advanced: cross-tables, correlation and regression

• The tricky part: What can you conclude from your sampled data. Need inferential statistics (confidence levels, accuracy)

Get good advice upfront: course, book, or prof. Software is great, if you understand what it does


• Coding and structuring (search for relationships between concepts, explain categories in words, link to theory)

• Present text fragments (quotes)

• Use schematical representations (diagram or table)

• Use word processor (or qualitative analysis software such as Kwalitan, Kodani)

Motivate your choices, apply strict logic, demonstrate the arguments that lead to your conclusions


Brick

Researcher’s attitude


• Before moving to writing your report, first a few words about the fourth part of the research competency: your attitude as a researcher

• Adapt behavior to research norms, professional ethics, and professional responsability

Neutrality,

Critical mindset, High standards,

Curiosity, Perseverance,

Preciseness

Respect

Neutrality?


High standards and critical mindset

• Do not believe, until convinced

• One source is not enough

• Do not use, unless understand

• Check, check and double check

• Always consider alternatives

• Try to prove yourself wrong

You’re responsible !


Creativity and hard work

7-9-2011

Creativity is a source of ideas and solutions, but takes an investment to reap the benefits


3.2 Report your research

• Start from day one

• Make and discuss TOC (Table Of Contents) early

• Structure: Introduction/background, Method, Results,

Discussion/conclusions/implications

• Answer the research question!

• Clear and logical, Argued choices

• References

• Research should be reproducible based on report

• Target audience, use of appropriate language


Brick


7-9-2011

Only as good as your score on attitudes and skills: .

Neutrality Take some distance every now and then

Preciseness Only write what is needed (no frills, appendix)

Critical mindset If something appears simple, check for errors

High standards Be extremely strict on yourself in every phase

Curiosity Your thesis is a consequence, not a goal

Perseverance When fed up, do not give up

Analytical thinking Is every claim justified Continued


Brick


Logic and coherency The thesis should be fully self-explanatory

Structured writing Lay-out matters (references, APA?)

Creativity Give new ideas follow up

Hard work Proper effort and no result is a result too

Project planning Count on several times writing, start early

Concentration Write in half-days, not hours

Then:


Brick

A real project: ‘Series or parallel production at HP’

•Communication to MT and floor

•With adaptations, series production

•Both numbers and production concepts

• Production data, floor lay out, staffing

•Case study, secundary data

•What is flexible and cost efficient?

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

Kao, C., (2009). Efficiency measurement for parallel production systems. European Journal of Operational Research, 196 [3], pp. 1107-1112


A real project: ‘Series or parallel production at HP’

•Communication to MT and floor

•With adaptations, series production

•Both numbers and production concepts

• Production data, floor lay out, staffing

•Case study, secundary data

•What is flexible and cost efficient?

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using


Your next project: ‘Finding right job and company’

•Write application letter(s)

• Short list of positions and companies

•Qualitative and quantitative comparison

• Interviews, secundary data

• Survey of jobs and industries

•Which jobs fit my skills and interests

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using

LaGesse, D., (2009). Turning Social Networking Into a Job Offer. U.S. News & World Report, 146 [4], pp. 44-45


Your next project: ‘Finding right job and company’

•Write application letter(s)

• Short list of positions and companies

•Qualitative and quantitative comparison

• Interviews, secundary data

• Survey of jobs and industries

•Which jobs fit my skills and interests

7-9-2011


Approach

Gathering data

Analysis

Answer

Sharing/ using


Conclusion

• This is just a refresher… (to know what you do not know is a good start)

• The details are important, use your books (and any good research advice you find at school or on-line)

• Research is finding answers systematically (answers that come easily are suspicious)

• BUT: If you master the attitudes and skills, succes will follow

These are applicable everywhere, and highly valued Learning is in doing, with the thesis as living proof


Any questions?

Thank you Wish you wisdom and luck

during graduation and thereafter!

[email protected]

7-9-2011

Research Refresher: A competent researcher!


Zijn er vragen?

Dankjewel Veel wijsheid en voorspoed gewenst

bij het afstuderen en daarna!

[email protected]

7-9-2011

Opfrisser Onderzoek: Een competente onderzoeker!


Opfrisser onderzoek - Refresher research methods 2011 (CAW Bal)

Education

Transcript of Opfrisser onderzoek - Refresher research methods 2011 (CAW Bal)