Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/46337
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | MENTEN, Raf | - |
dc.contributor.author | VANACKEN, Davy | - |
dc.contributor.author | ROVELO RUIZ, Gustavo | - |
dc.date.accessioned | 2025-07-02T13:54:21Z | - |
dc.date.available | 2025-07-02T13:54:21Z | - |
dc.date.issued | 2025 | - |
dc.date.submitted | 2025-06-20T15:21:31Z | - |
dc.identifier.citation | Spano, Davide; Zaina, Luciana; Campos, José Creissac; Luyten, Kris; Palanque, Philippe; van der Veer, Gerrit; Ebert, Achim; Humayoun, Shah Rukh; Memmesheimer, Vera (Ed.). Engineering Interactive Computer Systems. EICS 2024 International Workshops, Springer, p. 110 -125 | - |
dc.identifier.isbn | 978-3-031-91759-2 | - |
dc.identifier.isbn | 978-3-031-91760-8 | - |
dc.identifier.issn | 0302-9743 | - |
dc.identifier.issn | 1611-3349 | - |
dc.identifier.uri | http://hdl.handle.net/1942/46337 | - |
dc.description.abstract | This paper introduces NexOz, an approach and tool to facilitate incremental integration of AI components into interactive systems using a Wizard of Oz (WOz). The paper explores various challenges of AI integration, such as contextual understanding, conversational interaction, state tracking, and gesture recognition, particularly within the context of an operator support system in the manufacturing industry. NexOz allows developers to simulate AI functionalities through human intervention, enabling rapid prototyping, experimentation, and data collection. By leveraging a human wizard to emulate AI behavior in a structured way, NexOz facilitates the design and testing of dialogue flows, interaction patterns, tracking mechanisms, and conversational designs in real-time without having a fully-fledged implementation of AI-based solutions. Through iterative refinement and continuous feedback loops, NexOz offers a pragmatic approach to navigate the complexities of AI integration in interactive systems. | - |
dc.description.sponsorship | Flanders Make - Project OperatorAssist_SBO, project number 2021-0133 Flemish Government - “Onderzoeksprogramma Artificiële Intelligentie (AI) Vlaanderen” program | - |
dc.language.iso | en | - |
dc.publisher | Springer | - |
dc.relation.ispartofseries | Lecture Notes in Computer Science | - |
dc.rights | © 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG | - |
dc.subject.other | Wizard of Oz | - |
dc.subject.other | AI Integration | - |
dc.subject.other | Engineering Interactive AI-based Systems | - |
dc.subject.other | Digital Assistant | - |
dc.subject.other | Industry 4.0 | - |
dc.subject.other | OperatorAssist | - |
dc.title | NexOz - A Wizard of Oz Approach to Facilitate the Integration of AI in Interactive Systems | - |
dc.type | Proceedings Paper | - |
dc.relation.edition | 1 | - |
local.bibliographicCitation.authors | Spano, Davide | - |
local.bibliographicCitation.authors | Zaina, Luciana | - |
local.bibliographicCitation.authors | Campos, José Creissac | - |
local.bibliographicCitation.authors | Luyten, Kris | - |
local.bibliographicCitation.authors | Palanque, Philippe | - |
local.bibliographicCitation.authors | van der Veer, Gerrit | - |
local.bibliographicCitation.authors | Ebert, Achim | - |
local.bibliographicCitation.authors | Humayoun, Shah Rukh | - |
local.bibliographicCitation.authors | Memmesheimer, Vera | - |
local.bibliographicCitation.conferencedate | 2024, June 24–28 | - |
local.bibliographicCitation.conferencename | EICS: International Symposium on Engineering Interactive Computer Systems | - |
local.bibliographicCitation.conferenceplace | Cagliari, Sardinia, Italy | - |
dc.identifier.epage | 125 | - |
dc.identifier.spage | 110 | - |
local.bibliographicCitation.jcat | C1 | - |
local.publisher.place | Cham | - |
dc.relation.references | Amershi, S., et al.: Guidelines for human-AI interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–13. ACM (2019). https://doi.org/10.1145/3290605.3300233 Ballendat, T., Marquardt, N., Greenberg, S.: Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 121–130. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1936652.1936676 Barros-Justo, J.L., Benitti, F.B., Matalonga, S.: Trends in software reuse research: a tertiary study. Comput. Stand. Interfaces 66 (2019). https://doi.org/10.1016/j.csi.2019.04.011 Browne, J.T.: Wizard of Oz prototyping for machine learning experiences. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, CHI EA 2019, pp. 1–6. ACM (2019). https://doi.org/10.1145/3290607.3312877 Butz, A., Kaltenhauser, A., Eiband, M.: The expert of Oz: a two-sided study paradigm for intelligent systems. In: Companion Publication of the 2020 ACM Designing Interactive Systems Conference, DIS 2020 Companion, pp. 269–273. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3393914.3395874 Cheyer, A., Julia, L., Martin, J.C.: A unified framework for constructing multimodal experiments and applications. In: Bunt, H., Beun, R.J. (eds.) Cooperative Multimodal Communication, pp. 234–242. Springer, Heidelberg (2001) Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of Oz studies - why and how. Know.-Based Syst. 6(4), 258–266 (1993). https://doi.org/10.1016/0950-7051(93)90017-N Detjen, H., Pfleging, B., Schneegass, S.: A wizard of Oz field study to understand non-driving-related activities, trust, and acceptance of automated vehicles. In: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2020, pp. 19–29. ACM (2020). https://doi.org/10.1145/3409120.3410662 Dow, S., MacIntyre, B., Lee, J., Oezbek, C., Bolter, J., Gandy, M.: Wizard of Oz support throughout an iterative design process. IEEE Pervasive Comput. 4(4), 18–26 (2005). https://doi.org/10.1109/MPRV.2005.93 Garcia, F.J.C., Lopes, J., Liu, X., Hastie, H.: CRWIZ: A Framework for Crowdsourcing Real-Time Wizard-of-Oz Dialogues. arXiv:2003.05995 (2020) Green, A., Huttenrauch, H., Eklundh, K.: Applying the wizard-of-Oz framework to cooperative service discovery and configuration. In: RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No. 04TH8759), pp. 575–580 (2004). https://doi.org/10.1109/ROMAN.2004.1374824 Gu, K., Grunde-McLaughlin, M., McNutt, A.M., Heer, J., Althoff, T.: How Do Data Analysts Respond to AI Assistance? A Wizard-of-Oz Study. arXiv:2309.10108 (2024) Horvitz, E.: Principles of mixed-initiative user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1999, pp. 159–166. Association for Computing Machinery (1999). https://doi.org/10.1145/302979.303030 Hou, W., Feng, G., Cheng, Y.: A fuzzy interaction scheme of mid-air gesture elicitation. J. Vis. Commun. Image Represent. 64 (2019). https://doi.org/10.1016/j.jvcir.2019.102637 Katsakioris, M.M., Hastie, H.F., Konstas, I., Laskov, A.: Corpus of multimodal interaction for collaborative planning. In: Proceedings of the Combined Workshop on Spatial Language Understanding (2019). https://api.semanticscholar.org/CorpusID:199553531 Kerly, A., Bull, S.: The potential for chatbots in negotiated learner modelling: a wizard-of-Oz study. In: International Conference on Intelligent Tutoring Systems, pp. 443–452. Springer (2006) Kocielnik, R., Amershi, S., Bennett, P.N.: Will you accept an imperfect AI? Exploring designs for adjusting end-user expectations of AI systems. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–14. ACM (2019). https://doi.org/10.1145/3290605.3300641 Luger, E., Sellen, A.: “Like having a really bad PA”: the gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, pp. 5286–5297. ACM (2016). https://doi.org/10.1145/2858036.2858288 Okamoto, M., Yang, Y., Ishida, T.: Wizard of Oz method for learning dialog agents. In: Klusch, M., Zambonelli, F. (eds.) Cooperative Information Agents V, pp. 20–25. Springer, Heidelberg (2001) OperatorAssist: A digital assistant for assembly operators that increases effectiveness by 10% (2023). https://www.youtube.com/watch?v=t8vQBLxIIDY. Accessed 11 Oct 2024 Riek, L.D.: Wizard of Oz studies in HRI: a systematic review and new reporting guidelines. J. Hum.-Robot Interact. 1(1), 119–136 (2012). https://doi.org/10.5898/JHRI.1.1.Riek Rieser, V., Lemon, O.: Learning effective multimodal dialogue strategies from wizard-of-Oz data: bootstrapping and evaluation. In: Moore, J.D., Teufel, S., Allan, J., Furui, S. (eds.) Proceedings of ACL 2008: HLT, pp. 638–646. Association for Computational Linguistics (2008). https://aclanthology.org/P08-1073 Salber, D., Coutaz, J.: Applying the Wizard of Oz Technique to the Study of Multimodal Systems. In: Bass, L.J., Gornostaev, J., Unger, C. (eds.) Human-Computer Interaction, pp. 219–230. Springer, Heidelberg (1993) Schlögl, S., Doherty, G., Karamanis, N., Luz, S.: WebWOZ: a wizard of Oz prototyping framework. In: Proceedings of the 2nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2010, pp. 109–114. ACM (2010). https://doi.org/10.1145/1822018.1822035 Schlögl, S., Doherty, G., Luz, S.: Wizard of Oz experimentation for language technology applications: challenges and tools. Interact. Comput. 27(6), 592–615 (2015). https://doi.org/10.1093/iwc/iwu016 Shen, C., Ho, B.J., Srivastava, M.: MiLift: efficient smartwatch-based workout tracking using automatic segmentation. IEEE Trans. Mob. Comput. 17(7), 1609–1622 (2018). https://doi.org/10.1109/TMC.2017.2775641 Ultraleap: Leap Motion Controller 2. https://leap2.ultraleap.com/leap-motion-controller-2/. Accessed 11 Oct 2024 Vansteenkiste, S.: Mismatch tussen vraag naar en aanbod van arbeid in vlaanderen. https://www.steunpuntwerk.be/onderzoeksthemas/mismatch. Accessed 11 Oct 2024 Xie, T.: The synergy of human and artificial intelligence in software engineering. In: 2013 2nd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE), pp. 4–6 (2013). https://api.semanticscholar.org/CorpusID:14096820 Xin, D., Ma, L., Liu, J., Macke, S., Song, S., Parameswaran, A.: Accelerating human-in-the-loop machine learning: challenges and opportunities. In: Proceedings of the Second Workshop on Data Management for End-to-End Machine Learning, DEEM 2018. ACM (2018). https://doi.org/10.1145/3209889.3209897 | - |
local.type.refereed | Refereed | - |
local.type.specified | Proceedings Paper | - |
local.relation.ispartofseriesnr | 15518 | - |
dc.identifier.doi | 10.1007/978-3-031-91760-8_8 | - |
dc.identifier.eissn | 1611-3349 | - |
local.provider.type | CrossRef | - |
local.bibliographicCitation.btitle | Engineering Interactive Computer Systems. EICS 2024 International Workshops | - |
local.uhasselt.international | no | - |
item.fulltext | With Fulltext | - |
item.embargoEndDate | 2025-11-30 | - |
item.fullcitation | MENTEN, Raf; VANACKEN, Davy & ROVELO RUIZ, Gustavo (2025) NexOz - A Wizard of Oz Approach to Facilitate the Integration of AI in Interactive Systems. In: Spano, Davide; Zaina, Luciana; Campos, José Creissac; Luyten, Kris; Palanque, Philippe; van der Veer, Gerrit; Ebert, Achim; Humayoun, Shah Rukh; Memmesheimer, Vera (Ed.). Engineering Interactive Computer Systems. EICS 2024 International Workshops, Springer, p. 110 -125. | - |
item.contributor | MENTEN, Raf | - |
item.contributor | VANACKEN, Davy | - |
item.contributor | ROVELO RUIZ, Gustavo | - |
item.accessRights | Embargoed Access | - |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
NexOz - A Wizard of Oz Approach to Facilitate the Integration of AI in Interactive Systems.pdf Restricted Access | Published version | 2.43 MB | Adobe PDF | View/Open Request a copy |
NexOz - A Wizard of Oz Approach to Facilitate the Integration of AI in Interactive Systems.pdf Until 2025-11-30 | Peer-reviewed author version | 1.33 MB | Adobe PDF | View/Open Request a copy |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.