Reflections on evaluations and (critical) feedback

The never ending evaluation cycle…

Recently, I have held a number of internal and external higher education workshops.

Due to the suggestions of the participants of the first workshops, I had changed some parts of my concept and was now curious to see how these interventions would be received. Surprisingly for me, those parts that were praised initially were now partially criticized. Also those parts were partially criticized which I had taken up (or changed) due to the wishes of previous participants. On the other hand, parts that I left in the workshop despite criticism from the last time participants were now positively appreciated. 

I know these contradictory statements from teaching evaluations of my own courses and lectures at my university:

“It helps that you teach with a headset microphone.” versus “I find it ridiculous and annoying that you teach with a headset microphone.”

“The speed is just right for me” versus “It’s all going way too fast (slow) for me.”

“I find the online units very helpful” versus “I don’t like the online units at all”.

“I think it’s very good how we’re developing the content step by step on the blackboard.” versus “I find it annoying when I don’t get a finished (printed) picture served.” 

And so on…

Of course there is a natural dispersion in many aspects of teaching and learning, but especially with polar and conflicting evaluation results one can start to wonder whether one is doing it right or wrong.

What do I personally learn from this?

1) Small group sizes cannot per se convey a representative picture. Each group unfolds a different dynamic, which also results from the interaction of the individual participants. Although this is a truism, we sometimes tend to take criticism personally and/or professionally very seriously. Especially if we have reflected intensively on the instructional design beforehand.

2) It is unlikely that the expectations and needs of all participants can be fully satisfied. Therefore a seemingly unconditional positive feedback should be rather critically questioned. This holds true for the reverse case as well.

3) Diplomatically phrased statements like „I would have wished for…“ indicate individual needs, which do no not have to coincide with the wishes of other participants or the intended learning outcome of the workshop. Each participant has his or her own truth. And this applies to the instructor or coach as well…

Conclusion: Although evaluations and feedback can provide important indications for interventions, the instructor or coach is responsible for a theoretically and conceptually sound workshop concept. Not every criticism or suggestion should lead directly to an intervention.

In other words: Stay true to the intended learning outcome and the corresponding instructional design. Intervene cautiously and not erratically. Do not let yourself be carried away by the wishes of selected participants who speak out loud.

Workshop on Scholarship of Teaching and Learning (SoTL) at ExAcT – RWTH Aachen University, 3 June 2019

classroom

On 3 June 2019, I held a workshop on Scholarship of Teaching and Learning (SoTL) at ExAcT, RWTH Aachen University in Aachen. Together with eleven participants, mainly research assistants, Ph.D. candidates and postdocs, we were exploring aspects of the SoTL concept. As always, it was interesting to see how the participants approached the concept. SoTL is primarily concerned with the systematic inquiry into teaching and learning of students, but essentially postulates a professional attitude. A conceptual introduction cannot replace a more in-depth examination of the methodological and methodical foundations of teaching and learning research. However, it represents the first step towards a changed view of one’s own actions in academic teaching. Ultimately, I received valuable feedback from the participants to further refine the workshop concept. I am looking forward to return to RWTH Aachen in October.

Second workshop on Digital Mastery Learning Model (DMLM)

On 31 January and 1 February, Anna Mucha, Claudia Vogeler and I held our second workshop on online courses based on the Digital Mastery Learning Model (DMLM) at HAW Hamburg, Hamburg.

As explained in an earlier blog post, the DMLM is a time-independent and decentralized virtual educational setting based on the concept of mastery learning (Bloom 1968) and modern digital learning designs. Among others, we addressed theoretical foundations, practical examples, self-concept aspects and operational implementation in Moodle.

As always, we were able to gather valuable insights from the discussions with workshop participants. One more time, the relevance of the individual professional culture and its impact on the teaching methodology of subjects (engineering, computer sciences, social sciences etc.) as well as the academic self concept and educational ideals came to light.

We would like to thank all participants for their input.

New book chapter on academic self-concept in explorative learning designs (in German)

Mucha, A., & Decker, C. (2018).
Das akademische Selbstkonzept als Adventure Capital in explorativen Lernumgebungen. In Problembasiertes Lernen, Projektorientierung, forschendes lernen & beyond: Tagungsband zum 7. Tag der Lehre an der FH St. Pölten am 18.10.2018 (S. 51 – 60). St. Pölten: Fachhochschule St. Pölten.

New article on Internationalisation-at-Home (in German)

New article:

Decker, C., Mucha, A., & Gille, M. (2018).
Organisationale Diversitätsrendite und individuelle Heterogenitätskosten: Internationalisation-at-Home in einem international ausgerichteten Studiengang. Idie hochschule. journal für wissenschaft und bildung 1–2, 138-146.

New book chapter on team teaching in e-learning and blended learning settings

Decker, C., & Frielitz, F. (2018).
Team Teaching in E-Learning and Blended Learning Settings. In B. Jansen-Schulz, & T. Tantau (ed.), Excellent Teaching. Principles, Structures and Requirements (p. 291 – 302). Bielefeld: WBV/W. Bertelsmann.

Pre-conference interview “#tdlfhstp18: Studierende übernehmen Verantwortung”, Tag der Lehre 2018, FH St. Pölten, Austria (in German)

The pre-conference interview on “Das akademische Selbstkonzept als Adventure Capital in explorativen Lernumgebungen” with Christian F. Freisleben-Teutscher as well as Dr. Anna Mucha and me is now available on YouTube:

More information can be found on the website of “SKILL – Service und Kompetenzzentrum für Innovatives Lehren und Lernen” @ FH St.Pölten.

@ Christian: Thank you very much!

Conference paper on research-based learning (in German)

New article:

Decker, C., & Mucha, A. (2018).
Bridging the Gap: Vom passiven Lesen zum aktiven Forschen.
In N. Neuber, W. Paravicini, & M. Stein (Hrsg.), Schriften zur allgemeinen Hochschuldidaktik Band 3. Forschendes Lernen. The Wider View (S. 201 – 204). Münster: WTM-Verlag.

Conference proceedings

New publication on research-based learning (in German)

New article:

Decker, C., & Mucha, A. (2018).
Forschendes Lernen lernen. Zu den didaktischen und emotionalen Herausforderungen der Integration von Lernen über, für und durch Forschung.
In die hochschullehre 4, 143 – 160.

Link to article (open access):

New publication on learning without fear and shame (in German)

New article:

Mucha, A., & Decker, C. (2018).
Lernen ohne Angst vor Scham – wie geht das?
In: DUZ. Deutsche Universitätszeitung (2), 69 – 71.

Link to article (restricted access):

DUZ

New publication on explorative learning settings in higher education (in German)

New article:

Mucha, A., & Decker, C. (2018).
Explorative Lernumgebungen in der Hochschullehre: Eine Zumutung? In: Die Neue Hochschule (1), 28 – 29.

Die Neue Hochschule

Workshop on Digital Mastery Learning Model (DMLM)

On 2 and 3 February, Anna Mucha and I held a workshop on online courses based on the Digital Mastery Learning Model (DMLM) at HAW Hamburg, Hamburg.

Anna Mucha

The DMLM is a time-independent and decentralized virtual educational setting based on the concept of mastery learning (Bloom 1968) and modern digital learning designs. Among others, we addressed theoretical foundations, practical examples, self-concept aspects and operational implementation in Moodle.

A number of colleagues will adapt the concept in order to rework their courses and to test the new design during the summer term 2018. An evaluation will accompany the transformation process.

New publication on doctoral studies as explorative learning environments (in German)

New article:

Mucha, A., & Decker, C. (2017)

Der Dissertationsprozess als explorative Lernumgebung: Warum erfolgreiches Promovieren (auch) eine Frage der sozialen Herkunft ist. In: ZDfm. Zeitschrift für Diversitätsforschung und -management 2(2), 29 – 34.

Link to article (restricted access)

Diversitätsforschung

New publication on Learning-how-to-learn (in German)

New article:

Mucha, A., Decker, C., & Szmigielski, D. (2017).
Learning-how-to-learn oder Sich selbst eine gute Lehrperson sein. Zu mehr Selbstkompetenz durch Selbstreflexion. In J. Haag, J. Weißenböck, W. Gruber, & C. F. Freisleben-Teutscher (Hrsg.), Deeper Learning – (wie) geht das?!: Tagungsband zum 6. Tag der Lehre an der FH St. Pölten am 19.10.2017 (S. 37 – 47). St. Pölten: Fachhochschule St. Pölten.

TDL17 FH St. Pölten

Pre-conference interview “Geförderte Reflexion als Form von Deeper Learning”, Tag der Lehre 2017, FH St. Pölten, Austria (in German)

The pre-conference interview on “Geförderte Reflexion als Form von Deeper Learning” with Christian F. Freisleben-Teutscher as well as Dr. Anna Mucha and me is now available on YouTube:

More information can be found on the website of “SKILL – Service und Kompetenzzentrum für Innovatives Lehren und Lernen” @ FH St.Pölten.

@ Christian: Thank you very much!

New publication on learning styles and instructional design (in German)

New article:

Decker, C., & Mucha, A. (2017).
Der Lernstilansatz als Inspiration für die universitäre Lehre: Theoretische Grundlagen und exemplarische Anwendung. In B. Berendt, A. Fleischmann, N. Schaper, B. Szczyrba, & J. Wildt (Hrsg.), Neues Handbuch Hochschullehre (Griffmarke A 3.25). Berlin: DUZ.

Conference presentation on research-based learning in corporate finance

Forschendes Lernen

On 27 September 2017, Anna Mucha and I presented our findings on a research-based learning intervention at the research conference “Forschendes Lernen – The Wider View” which took place at Wilhelms-Universität Münster.  In our presentation entitled “Bridging the Gap – From Passive Reading to Active Research”, we elaborated on an instructional design that was introduced in the Corporate Finance course of the Master of International Business Programme (M. Sc.) at HAW Hamburg. The instructional design consists of five core phases:

Phase 1: Transparent explanation of instructional design to students
Phase 2: Reception and reflection of selected seminal papers of Nobel laureates in groups of two students
Phase 3: Development of a new (own) research question
Phase 4: Exploration of the new problem
Phase 5: Presentation of (i) seminal paper and (ii) own research findings to other course participants

The instructional design helps to overcome the gap between reception of research findings (and underlying methods) on the one hand side and production (derivation) of new research findings (using newly acquired research methods) on the other hand side. Thereby, students are guided from “learning about research” via “learning for research” to “learning through research”.

In 2018, a summary of our findings will be published in the conference proceedings.

New publication on SoTL and agile (dynamic) digital higher education (in German)

New article:

Mucha, A., & Decker, C. (2017).
Scholarship of Teaching and Learning für eine agile digitale Hochschuldidaktik. In Synergie. Fachmagazin für Digitalisierung in der Lehre 3(2), 20 – 23.

Synergie

Workshop on “Online courses” at Universität zu Lübeck, 12 & 13 June 2017

On 12 and 13 June 2017, I held a workshop on “Online courses in higher education” at Dozierenden-Service-Center (DSC), Universität zu Lübeck. Together with seven participants, I was exploring selected facets of online teaching.

Among others, we did a card assisted brainstorming on identifying characteristics of “online courses”. It still seems to be a challenge to find a consistent idea among a group of informed participants about what characterises an “online course”. Maybe this should not come as a surprise since the term carries many connotations. Moreover, I observed that discussions tend to become more fruitful when moving away from technological aspects while approaching higher education issues (i.e. instructional design aspects).

@ Dr. Bettina Jansen-Schulz: Thank you very much for the invitation and your sympathy and support!

New publication on shame and failure in problem- and research-based learning scenarios (in German)

New article:

Mucha, A. & Decker, C. (2017).
(Die Angst vor) Scheitern und Scham in problemorientierten und forschenden Lehr-/Lernszenarien.
In B. Berendt, A. Fleischmann, N. Schaper, B. Szczyrba, & J. Wildt (Hrsg.), Neues Handbuch Hochschullehre. Berlin: DUZ.

Scham und Scheiter

Link to article (restricted access)

New publication on posters and poster conferences (in German)

New article:

Decker, C. (2016).
Die Posterkonferenz als hochschuldidaktische Methode und Alternative zum Referat.
In B. Berendt, A. Fleischmann, N. Schaper, B. Szczyrba, & J. Wildt (Hrsg.),
Neues Handbuch Hochschullehre. Berlin: DUZ, G 1.2.

NHHL

Link to article (restricted access)

New publication on case-based written examinations (in German)

New article:

Die fallstudienbasierte Klausur als schriftliche Prüfungsleistung: Ein Beispiel für die kompetenzorientierte Restrukturierung einer Modulprüfung. In J. Haag, J. Weißenböck, W. Gruber, & C. F. Freisleben-Teutscher (Hrsg.), Kompetenzorientiert Lehren und Prüfen. Basics – Modelle – Best Practices: Tagungsband zum 5. Tag der Lehre an der FH St. Pölten am 20.10.2016. St. Pölten: Fachhochschule St. Pölten, S. 77 – 86.

TDL16 FH St. Pölten

Download full PDF

Night train to St. Pölten (5. Tag der Lehre 2016)

On Thursday, 20 October 2016, I jumped on the night train to St. Pölten in Austria in order to attend a conference on competency-based education (5. Tag der Lehre: „Kompetenzorientiert Lehren und Prüfen“). After a strenuous ride in a very small train compartment, I arrived at the FH St. Pölten in order to discuss various aspects of competency-based education.

For the first time, I participated in a so called “DisqSpace”, a relatively new discussion format that is designed to allow for a higher level of interaction between the presenting speaker and the audience. In each corner of a room, a topic is presented by a guest speaker. All speakers and topics are introduced by a moderator. Thereafter, the participants split up into four groups, which will ascribe themselves to an individual corner (topic). After 15 to 20 minutes the groups rotate and move on to the next “station”. Within 60 to 90 minutes, the audience has visited all corners (topics) of the room.

Advantages

  • A smaller number of participants will be able to listen to a presented topic and discuss individual questions with the guest speaker.
  • Participants are able to attend four interrelated presentations on a given general topic, thereby identifying connections and realizing different solution approaches.

Disadvantages

  • The guest speaker has to present the topic four times in succession in a very condensed way, which I experienced as somehow exhausting.
  • Interesting and lively discussions might have to be aborted when the group has to move on to the next corner (topic).

The poster can be found at slideshare:

Die fallstudienbasierte Klausur als schriftliche Prüfungsleistung from Christian Decker

As always, the conference was perfectly organized by the friendly team of SKILL @ FH St. Pölten: Thank you very much!

And I really enjoyed the vegan stuffed peppers at the lunch buffet!

Pre-conference interview “Kompetenzorientierung mit fallstudienbasierten Klausuren”, Tag der Lehre 2016, FH St. Pölten, Austria (in German)

The pre-conference interview on “Kompetenzorientierung mit fallstudienbasierten Klausuren” with Christian F. Freisleben-Teutscher and me is now available on YouTube:

More information can be found one the website of “SKILL – Service und Kompetenzzentrum für Innovatives Lehren und Lernen” @ FH St.Pölten.

@ Christian F. Freisleben-Teutscher: Thank you very much for the interview!

Workshop on competency-based development of degree programs with Oliver Reis

On September 13, 2016, roughly a dozen of my colleagues and me attended a three hour workshop on competency-based development of degree programs taught by Prof. Dr. Dr. Oliver Reis (University of Paderborn). We all teach in the degree program “Foreign Trade/International Management” and already apply more or less the principles of competency-based education. However, the workshop aimed at focussing on the overall competency-driven objective of the degree program.

2016-09-13-15-43-09

We are now heading towards a (general) competency-based development model that will help us to align the competency-based learning objectives at the level of the modules. Ultimately, this might lead to a (partial) redesign of the curriculum. I will report on the process…

Workshops on “Inverted Classroom” at Hochschule Ostwestfalen-Lippe, Lemgo, 28 & 29 April 2016

Last week, I held two inspiring workshops on the inverted classroom model for some highly motivated colleagues at Hochschule Ostwestfalen-Lippe. After an unnerving breakdown of my car (transmission failure) at the periphery of Lemgo, I arrived just in time for the start of the first workshop. However, the whole team and the participants were quite empathic and helpful.

During the workshop, we had some lively, productive and insightful discussions that will help me to further refine the workshop concept.

IMG_4884

@ Doris Ternes & Melanie Reddeker: Thank you very much for the invitation and your sympathy and support!

Successful completion of advanced training on competency-based education, 14 October 2015

Today, I was awarded my certificate of completion in competency-based examination. The last twelve months were packed with seminars, self-study and didactical projects. I experienced a rewarding introduction to a theoretical concept of high practical value. Especially, the discussions with my colleagues were worthwhile and I received a great number of intellectual stimuli. I am looking forward to the implementation and further refinement of this fascinating concept.

IMG_7556

@ Oliver Reis: Thank you very much for a year full of insights!

Poster presentation on competency-based education, 26 June 2015

Yesterday, I presented my poster on the competency-based restructuring of one of my courses at an internal conference on “Competency-based teaching, learning and assessment” at Hamburg University of Applied Sciences (HAW Hamburg).

The poster can be found at slideshare:

Eine Fallstudie zur kompetenzorientierten Restrukturierung am Beispiel des Moduls „Academic Research and Writing" from Christian Decker

Interviews with Jutta Abulawi, Petra Naujoks and Christian Decker on competency-based education (in German)

The interviews with Jutta Abulawi , Petra Naujkos and me are now available on YouTube:

The interviews took place during a workshop on competency-based teaching and learning with Oliver Reis on 19 February 2015.

@ Margitta, Sabine & Ivan: Thank you very much!

Interview “Tag der Lehre 2014”, FH St. Pölten, Austria available (in German)

The interview is now available on YouTube:

@ Wolfgang Gruber, Christian F. Freisleben-Teutscher, Josef Weißenböck: Thank you very much for the perfect organisation!

Cookie Consent with Real Cookie Banner