Patrick Harms

Head of the OHM User Experience Center (OHM-UX) of the Nuremberg Institute of Technology

• More information available at www.th-nuernberg.de/ohmux

Reviewer for conferences and workshops

• ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) 2022
• ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) 2020
• Nordic Conference on Human-Computer Interaction (NordiCHI) 2020, 2022
• ACM CHI Conference on Human Factors in Computing Systems (CHI) 2018, 2019
• IFIP International Conference on Testing Software and Systems (ICTSS) 2015, 2016
• International Conference on Software Testing, Verification, and Validation (ICST) 2014
• Workshop on System Analysis and Modelling (formerly SDL and MSC Workshop) (SAM) 2013, 2014

Programme Committee

• Clausthal-Göttingen International Workshop on Simulation Science 2019
• Workshop on System Analysis and Modelling (formerly SDL and MSC Workshop) (SAM) 2024

Reviewer for journals

• International Journal of Human-Computer Studies (IJHCS) 2016, 2019, 2022
• Journal of Systems and Software 2013
• i-com Journal of Interactive Media 2023

• Best Presentation Award at the UCAAT 2016

• Member of the Industry Specification Group (ISG) for the development of a standardized Augmented Reality Framework (ARF) at the European Telecommunications Standards Institute (ETSI)

Focus:

• Usability Engineering
• User Experience Design

If required:

• Software Engineering
• Software Testing
• Object-oriented Programming

Usage of AR/MR/VR for evaluating the usability of virtual prototypes

• Development of the Vivian Framework for fast and efficient creation and deployment of virtual prototyes in AR/MR/VR
• Analysis of optimal modalities for the interaction with virtual prototypes in AR/MR/VR
• Development of concepts for performing remote usability evaluations for virtual prototypes in AR/MR/VR inclusive usability evaluation automation (see next research area)

AI-based usability evaluation

• For websites, desktop software, AR, MR, and VR
• On the basis of recorded user behaviour
• Automated derivation and analysis of task models

More information on these research areas can be found on the pages of the OHM User Experience Center (OHM-UX) of the Nuremberg Institute of Technology under "Own Research and Projects".

I regularly offer theses in the areas of Virtual Prototyping and AI-based Usability Evaluation. Details on these topics can be found on the pages of the OHM User Experience Center (OHM-UX) of the Nuremberg Institute of Technology under the heading "Own Research and Projects".

The concrete topics are manifold and vary depending on where we are in current research and which topics are already being worked on. Therefore, no list of open topics is kept here. If you are interested in writing a thesis in any of the above topics, please contact me by email. Then I will tell you the current open topics and if there are still places available for theses.

Continue to the OHM User Experience Center (OHM-UX)

Phd Thesis

2016. Patrick Harms. Automated Field Usability Evaluation Using Generated Task Trees. Georg-August-Universität Göttingen. http://hdl.handle.net/11858/00-1735-0000-0028-8684-1

Peer-Reviewed Journal Publications

2023. Dominick Leppich, Carina Bieber, Katrin Proschek, Patrick Harms, Ulf Schubert. DUX: a dataset of user interactions and user emotions. i-com, vol. 22, no. 2, 2023, pp. 101-123. https://doi.org/10.1515/icom-2023-0014

2019. Patrick Harms. Automated Usability Evaluation of Virtual Reality Applications. ACM Transactions on Computer-Human Interaction (TOCHI), 26(3), ACM. https://dl.acm.org/authorize?N671395

2016. Steffen Herbold, Patrick Harms, Jens Grabowski. Combining Usage-based and Model-based Testing for Service-oriented Architectures in the Industrial Practice. International Journal on Software Tools for Technology Transfer, 19(3), Springer. https://doi.org/10.1007/s10009-016-0437-y

2014. Patrick Harms, Steffen Herbold, Jens Grabowski. Extended Trace-based Task Tree Generation. International Journal on Advances in Intelligent Systems, Think Mind. https://www.thinkmind.org/index.php?view=article&articleid=intsys_v7_n34_2014_9

2011. Patrick Harms, Jens Grabowski. Usability of Generic Software in e-Research Infrastructures. Journal of the Chicago Colloquium on Digital Humanities and Computer Science, Vol 1, No 3 (2011), University of Chicago.

Peer-Reviewed Conference Publications

2024. Carina Bieber, Patrick Harms, Dominick Leppich, Katrin Proschek. AI-based User Emotion Recognition from Interaction Data: Challenges and Guidelines for Training Data Creation. MODELS Companion '24: Proceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems. Pages 245-252. https://doi.org/10.1109/ACII55700.2022.9953857

2022. Niklas Cosmann, Jana Haberkern, Alexander Hahn, Patrick Harms, Jan Joosten, Katharina Klug, Katharina, Tanja Kollischan. The value of mood measurement for regulating negative influences of social media usage: A case study of TikTok. 10th International Conference on Affective Computing and Intelligent Interaction (ACII). Pages 1-7. https://doi.org/10.1109/ACII55700.2022.9953857

2022. Patrick Harms, Dominick Leppich. Creating Virtual Prototypes of Technical Devices using Vivifly. EICS '22 Companion: Companion of the 2022 ACM SIGCHI Symposium on Engineering Interactive Computing Systems. Pages 61–62. https://doi.org/10.1145/3531706.3536451

2022. Dominick Leppich, Patrick Harms. Automated Usability Smell Detection in VR Application with AutoQUEST. EICS '22 Companion: Companion of the 2022 ACM SIGCHI Symposium on Engineering Interactive Computing Systems. Pages 59–60. https://doi.org/10.1145/3531706.3536449

2021. Patrick Harms. Vivian: A Technical Framework for Deploying and Operating Virtual Prototypes in XR. In Designing Interactive Systems Conference 2021 (DIS '21), Association for Computing Machinery, New York, NY, USA, 298–308. https://doi.org/10.1145/3461778.3462088

2021. Patrick Harms. There Is No One Size Fits All: The Need for Evaluating MR Interaction Techniques. Proceedings of the Workshop ‘Evaluating User Experiences in Mixed Reality’ colocated with the ACM CHI Virtual Conference on Human Factors in Computing Systems (CHI) 2021. https://doi.org/10.5281/zenodo.4674280

2019. Patrick Harms. VR Interaction Modalities for the Evaluation of Technical Device Prototypes. Proceedings of the 17th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT 2019), Springer. https://doi.org/10.1007/978-3-030-29390-1_23

2016. Patrick Harms. Representativeness and Descriptiveness of Task Trees Generated from Website Usage Traces. Proceedings of the 9th Systems Analysis and Modeling Conference (SAM 2016), Springer. http://dx.doi.org/10.1007/978-3-319-46613-2_6

2015. Patrick Harms, Jens Grabowski. Consistency of Task Trees Generated from Website Usage Traces. Proceedings of the 17th International Conference on System Design Languages 2015, Berlin. http://dx.doi.org/10.1007/978-3-319-24912-4_9

2015. Steffen Herbold, Alberto De Francesco, Jens Grabowski, Patrick Harms, Lom Messan Hillah, Fabrice Kordon, Ariele-Paolo Maesano, Libero Maesano, Claudia Di Napoli, Fabio de Rosa, Martin Schneider, Nicola Tonellotto, Marc-Florian Wendland, Pierre-Henri Wuillemin. The MIDAS Cloud Platform for Testing SOA Applications. The 8th IEEE International Conference on Software Testing, Verification and Validation (ICST) 2015 - tools track, Graz. https://doi.org/10.1109/ICST.2015.7102636

2014. Patrick Harms, Steffen Herbold, Jens Grabowski. Trace-based Task Tree Generation. ACHI 2014, The Seventh International Conference on Advances in Computer-Human Interactions, IARIA XPS Press. http://www.thinkmind.org/download.php?articleid=achi_2014_14_20_20065

2014. Patrick Harms, Jens Grabowski. Usage-based Automatic Detection of Usability Smells. Proceedings of the 5th International Conference on Human-Centered Software Engineering, Springer Berlin Heidelberg. http://dx.doi.org/10.1007/978-3-662-44811-3_13

2013. Steffen Herbold, Patrick Harms. AutoQUEST - Automated Quality Engineering of Event-driven Software. IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Fourth International Workshop on Testing Techniques & Experimentation Benchmarks for Event-Driven Software, Luxemburg. http://dx.doi.org/10.1109/ICSTW.2013.23

2010. Patrick Harms, Kathleen Smith, Andreas Aschenbrenner, Wolfgang Pempe, Mark Hedges, Angus Roberts, Bernie Ács, Tobias Blanke. The Quality in Quantity - Enhancing Text-based Research. Data Driven e-Science: Use Cases and Successful Applications of Distributed Computing Infrastructures (ISGC 2010), New York: Springer. http://dx.doi.org/10.1007/978-1-4419-8014-4_21

2007. Patrick Harms, Stephan Kiemle, Daniele Dietrich. Extensible earth observation data catalogues with multiple interfaces. Ensuring the Long-Term Preservation and Value Adding to Scientific and Technical Data (PV 2007), München.

Conference Presentations / Workshops

2024. Carina Bieber, Patrick Harms, Carolin Ebermann. Improving UX Evaluation with AI-based Emotion Recognition - How to deal with the challenges of training data creation and sharing knowledge with the community. Workshop at the Mensch & Computer 2024 in Karlsruhe.

2021. Patrick Harms. Testing at the Edge of Reality – Virtual Prototyping and Opportunities for Test Automation. Keynote auf der 8^th User Conference on Advanced Automated Testing (UCAAT) 2021.

2020. Patrick Harms. Automated Usability Evaluation of Virtual Reality Applications. Kurzvideo und Diskussion zur gleichnamigen Journal-Publikation auf der „2020 Virtual German CHI Week“, online organisiert von der German HCI.

2019. Patrick Harms. Einsatz von AR und VR zu Usabilityevaluation von virtuellen Prototypen. Vortrag in der Arbeitsgruppe „Usability und User Experience“ des Wirtschaftsverbandes bitkom, Hamburg.

2019. Patrick Harms. Passen Usability und Informatik überhaupt zusammen? Vortrag in der Arbeitsgruppe „Usability und User Experience“ des Wirtschaftsverbandes bitkom, München.

2017. Patrick Harms, Jens Grabowski. Automating Usability Testing for Prototypes of the Things in the Internet using Augmented and Virtual Reality. User Conference on Advanced Automated Testing (UCAAT) 2017.

2016. Patrick Harms, Jens Grabowski. Experiences with Automated Field Usability Testing Using Generated Task Models, User Conference on Advanced Automated Testing (UCAAT) 2016.

2015. Steffen Herbold, Patrick Harms, Jens Grabowski. Enhancing Test Models by Incorporating Monitored Usage Information. User Conference on Advanced Automated Testing (UCAAT) 2015.

Book Chapters

2024. Frank Sowa, Marco Heinrich, Patrick Harms, Katrin Proschek, Tanja Holzmeyer. Designen von digitalen Lösungen für wohnungslose Menschen - Eine Methodenreflexion. Wie gestalten wir Gesellschaft? - Interdependenzen zwischen Design und dem Feld des Sozialen, transcript.

2019. Steffen Herbold, Fabian Trautsch, Patrick Harms, Verena Herbold, Jens Grabowski. Experiences With Replicable Experiments and Replication Kits for Software Engineering Research. Advances in Computers, Volume 113, Elsevier.

Other Publications

2012. Patrick Harms. Evaluationsmethoden im Usability Engineering. Themendossier für die User Group »Usability Engineering«, Softwareforen Leipzig.

Vivian - Virtual Prototypes in Virtual and Augmented Reality

• Framework for efficient provisioning of virtual prototypes of technical devices in all types of XR for the execution of usability tests

AutoQUEST - Automated Quality Engineering of Event-Driven Software

• Toolsuite that allows, in addition to others, for an automated usability evaluation of websites and XR software
• https://autoquest.informatik.uni-goettingen.de

More information on these and other projects can be found on the pages of the OHM User Experience Center (OHM-UX) of the Nuremberg Institute of Technology under "Own Research and Projects".

Youtube Channel: https://www.youtube.com/channel/UCkLTg7m8lgm8z5XSRfnNfyg