Aryan Saini
Aman Parnami
ABSTRACT
The traditional storytelling experiences are often one dimensional, wherein they only contain a single channel of communication with the audience through narration. With the advancements in technology, storytelling experiences have been augmented with the help of digital media to be more engaging and immersive. Authoring these scenarios, however, is complicated as it requires technical knowledge to interface the means of engagement. In this work, we talk about Aesop, a system which assists the narrator to author engaging storytelling experiences. Aesop provides a block-based interface like Scratch and manifests words of a story, Cues, and Visualization (Outputs) as blocks that enable the user to create captivating stories. Our system also leverages physical actions performed by the user as Cues. These cues can trigger visualizations like robot actions, animations, environments simulation using sound and lighting effects.
- Houman Alborzi, Allison Druin, Jaime Montemayor, Michele Platner, Jessica Porteous, Lisa Sherman, Angela Boltman, Gustav Taxén, Jack Best, Joe Hammer, Alex Kruskal, Abby Lal, Thomas Plaisant Schwenn, Lauren Sumida, Rebecca Wagner, and Jim Hendler. 2000. Designing StoryRooms: Interactive Storytelling Spaces for Children. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '00). ACM, New York, NY, USA, 95--104. http://dx.doi.org/10.1145/347642.347673Google Scholar
Digital Library
- Nicoletta Blas, Franca Garzotto, Paolo Paolini, and Amalia Sabiescu. 2009. Digital Storytelling As a Whole-Class Learning Activity: Lessons from a Three-Years Project. In Proceedings of the 2Nd Joint International Conference on Interactive Digital Storytelling: Interactive Storytelling (ICIDS '09). Springer-Verlag, Berlin, Heidelberg, 14--25. http://dx.doi.org/10.1007/978--3--642--10643--9_5Google ScholarCross Ref
- Kevin M. Brooks. 1996. Do Story Agents Use Rocking Chairs? The Theory and Implementation of One Model for Computational Narrative. In Proceedings of the Fourth ACM International Conference on Multimedia (MULTIMEDIA '96). ACM, New York, NY, USA, 317--328. http://dx.doi.org/10.1145/244130.244233Google ScholarDigital Library
- Alejandro Catala, Mariët Theune, Hannie Gijlers, and Dirk Heylen. 2017. Storytelling As a Creative Activity in the Classroom. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C '17). ACM, New York, NY, USA, 237--242. http://dx.doi.org/10.1145/3059454.3078857Google ScholarDigital Library
- Allison Druin, Jamie Montemayor, Jim Hendler, Britt McAlister, Angela Boltman, Eric Fiterman, Aurelie Plaisant, Alex Kruskal, Hanne Olsen, Isabella Revett, Thomas Plaisant Schwenn, Lauren Sumida, and Rebecca Wagner. 1999. Designing PETS: A Personal Electronic Teller of Stories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 326--329. http://dx.doi.org/10.1145/302979.303103Google ScholarDigital Library
- Lu'is Fraga, António Coelho, and Pedro Branco. 2014. Meet the Frumbles: A Post-digital Toy Orchestra. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (ACE '14). ACM, New York, NY, USA, 58:1--58:4. http://dx.doi.org/10.1145/2663806.2663813Google ScholarDigital Library
- Hamizah Mohamad Hariri, A. B. Marini, and A. M. Zin. 2011. Story telling approach for Integrating Software Blocks. In Proceedings of the 2011 International Conference on Electrical Engineering and Informatics. 1--5. http://dx.doi.org/10.1109/ICEEI.2011.6021656Google ScholarCross Ref
- Björn Hartmann, Leith Abdulla, Manas Mittal, and Scott R. Klemmer. 2007. Authoring Sensor-based Interactions by Demonstration with Direct Manipulation and Pattern Recognition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 145--154. http://dx.doi.org/10.1145/1240624.1240646Google ScholarDigital Library
- Björn Hartmann, Scott R. Klemmer, Michael Bernstein, Leith Abdulla, Brandon Burr, Avi Robinson-Mosher, and Jennifer Gee. 2006. Reflective Physical Prototyping Through Integrated Design, Test, and Analysis. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 299--308. http://dx.doi.org/10.1145/1166253.1166300Google ScholarDigital Library
- Chuan-Che Huang, Yu-Jen Lin, Xinda Zeng, Mark Newman, and Sile O'Modhrain. 2015. Olegoru: A Soundscape Composition Tool to Enhance Imaginative Storytelling with Tangible Objects. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 709--714. http://dx.doi.org/10.1145/2677199.2687895Google ScholarDigital Library
- Ju-Whan Kim and Tek-Jin Nam. 2013. EventHurdle: Supporting Designers' Exploratory Interaction Prototyping with Gesture-based Sensors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 267--276. http://dx.doi.org/10.1145/2470654.2470691Google ScholarDigital Library
- Scott R. Klemmer, Anoop K. Sinha, Jack Chen, James A. Landay, Nadeem Aboobaker, and Annie Wang. 2000. Suede: A Wizard of Oz Prototyping Tool for Speech User Interfaces. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST '00). ACM, New York, NY, USA, 1--10. http://dx.doi.org/10.1145/354401.354406Google ScholarDigital Library
- J. Kory and C. Breazeal. 2014. Storytelling with robots: Learning companions for preschool children's language development. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. 643--648. http://dx.doi.org/10.1109/ROMAN.2014.6926325Google Scholar
- Brad Myers, Scott E. Hudson, Randy Pausch, and Randy Pausch. 2000. Past, Present, and Future of User Interface Software Tools. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000), 3--28. http://dx.doi.org/10.1145/344949.344959Google ScholarDigital Library
- Aman Parnami, Apurva Gupta, Gabriel Reyes, Ramik Sadana, Yang Li, and Gregory D. Abowd. 2016. Mogeste: A Mobile Tool for In-Situ Motion Gesture Design. In Proceedings of the 8th Indian Conference on Human Computer Interaction (IHCI '16). ACM, New York, NY, USA, 35--43. http://dx.doi.org/10.1145/3014362.3014365Google ScholarDigital Library
- Mitchel Resnick, John Maloney, Andrés Monroy-Hernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner, Eric Rosenbaum, Jay Silver, Brian Silverman, and Yasmin Kafai. 2009. Scratch: Programming for All. Commun. ACM 52, 11 (Nov. 2009), 60--67. http://dx.doi.org/10.1145/1592761.1592779Google ScholarDigital Library
- Bernard R. Robin. 2008. Digital Storytelling: A Powerful Technology Tool for the 21st Century Classroom. Theory Into Practice 47, 3 (2008), 220--228. http://dx.doi.org/10.1080/00405840802153916Google ScholarCross Ref
- Stephen Sutton and Ronald Cole. 1997. The CSLU Toolkit: Rapid Prototyping of Spoken Language Systems. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST '97). ACM, New York, NY, USA, 85--86. http://dx.doi.org/10.1145/263407.263517Google ScholarDigital Library
- Torben Wallbaum, Swamy Ananthanarayan, Shadan Sadeghian Borojeni, Wilko Heuten, and Susanne Boll. 2017. Towards a Tangible Storytelling Kit for Exploring Emotions with Children. In Proceedings of the on Thematic Workshops of ACM Multimedia 2017 (Thematic Workshops '17). ACM, New York, NY, USA, 10--16. http://dx.doi.org/10.1145/3126686.3126702Google ScholarDigital Library
- Torben Wallbaum, Andrii Matviienko, Swamy Ananthanarayan, Thomas Olsson, Wilko Heuten, and Susanne C.J. Boll. 2018. Supporting Communication Between Grandparents and Grandchildren Through Tangible Storytelling Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 550:1--550:12. http://dx.doi.org/10.1145/3173574.3174124Google ScholarDigital Library
- John D Walsh. 2003. The art of storytelling: Easy steps to presenting an unforgettable story. Moody Publishers.Google Scholar
- Carl Weir and Rich Fritzson. 1993. UNISYS: Description of the CBAS System Used for MUC-5. In Proceedings of the 5th Conference on Message Understanding (MUC5 '93). Association for Computational Linguistics, Stroudsburg, PA, USA, 249--261. http://dx.doi.org/10.3115/1072017.1072041Google ScholarDigital Library
Index Terms
- Aesop: Authoring Engaging Digital Storytelling Experiences
Recommendations
Interactive narrative: stepping into our own stories
CHI '98: CHI 98 Conference Summary on Human Factors in Computing SystemsInteractive TV narratives: Opportunities, progress, and challenges
This article is motivated by the question whether television should do more than simply offer interactive services alongside (and separately from) traditional linear programs, in the context of its dominance being seriously challenged and threatened by ...
Interactive documentaries: A Golden Age
SPECIAL ISSUE: TV and Video Entertainment EnvironmentsThis article is motivated by the opportunity presented by recent advances in information and communication technology—particularly by faster broadband connections and faster digital media processing capabilities—for interactive television to extend and ...
Comments