The Research:
Computational and AI techniques, combined with our research in cognitive science based work in creativity, aesthetics, sensing, movement – heralds in new forms of art and design, including new exploration / ideation / creation / collaboration techniques.
See samples of our work in the figures below:
See samples of the work in the videos below:
**Video 1:** Tour With the Advanced Stream Diffusion based artist tool we built ( ivizDiff ) - we can use source images - and even use several and blend them. And prompts ( again many and weight them) - and either live video or looped video files which we can control in realtime interactively with all our advanced parameters to make a realtime video with full interactive control including as you see here mapping live music, breath work, mic levels, hand gestures, and game controllers.
**Video 2:** Demo of live AI architecture ideation using physical controllers: boxes.
**Video 3:** We used our original tree painting as source combined with the living signals coming off our plant and our creative manipulation to make this music/visuals happen in real time.
**Video 4:** Our work commissioned at ACM SIGGRAPH
Using our systems - users can journey through art and design ideation space:
Our system allows for moving through a space where all is logged and users can journey back and forth and on creative forks - where all parts of the journey are archived and mapped.
These techniques have been used by many artists including much work in video and large scale multimedia art including with dancers, and art activism. See work with:
DANCE … and … Large Projection.
We often exhibit the work at major museums, galleries, conferences and at talks, interviews (TV News here), panels including discussing ethical implications. See News section for talks.
------ PAPERS: AI-based Exploration of Art and Design ------
Mitochondrial Crossings by
Sun P; Zinovieff F; Aceves Sep£lveda G; and DiPaola S – Journal – Special Issue on Hacking the Anthropocene. 5 pages
In Feral Feminisms 12 (2022)
VR-DesignSpace; A Creativity Support Environment Integrating Virtual Reality Technology into Collaborative Data-Informed Evaluation of Design Alternative by
Zarei M; DiPaola S – Conference – Computer and Information Science. vol 1420. (short paper). Springer
International Conference on Human Computer Interaction (HCII 21) (2021)
A Framework for Hybrid Multimodal Interactive Performances; Exploring the Virtual; Physical; and the Space in Between by
Cuykendall S; Sun P; Muntean R; DiPaola S – Conference – British Computer Society. pp. 159-166
Electronic Visualisation and the Arts (EVA) (2017)
Moving Collaborations; A Critical Inquiry into Designing Creative Interactive Systems for Choreography by
Carlson K; Schiphorst T; DiPaola S – Journal – Special Issue; Intelligent Technologies for Interactive Entertainment. Vol 16. No 6. 10 pages
EAI Journal of Creative Technologies (2016)
Exploring Different Ways of Navigating Emotionally-responsive Artwork in Immersive Virtual Environments by
Song M; DiPaola S – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2015)
Medium-Specific Properties of Urban Screens; Towards an Ontological Framework for Digital Public Displays by
Fortin C; DiPaola S; Hennessy K; Bizzocchi J; Neustaedter C – Conference – 10 pages
ACM Conference on Creativity and Cognition (2013)
