AI-based Exploration of Art and Design

See Related Papers and Related Projects:
## AI Anonymization ## Semantic Meaning & Analysis ## AI Modeling Thought & Language
## Sensing Humans (Bio/Brain/Face/Movement/VR) ## AI Cognitive Creativity ## AI Ethics: Gender ## AI Ethics: Climate

Researchers: Steve DiPaola, Suk Choi, Meehae Song, Nouf Abukhodair, Vanessa Utz, Shannon Cuykendall

The Research: Computational and AI techniques, combined with our research in cognitive science based work in creativity, aesthetics, sensing, movement – heralds in new forms of art and design, including new exploration / ideation / creation / collaboration techniques.

See samples of our work in the figures below:

See samples of the work in the videos below:

Video 1: Tour With the Advanced Stream DIffusion based artist tool we built ( ivizDiff ) - we can use source images - and even use several and blend them. And prompts ( again many and wieght them) - and either live video or looped video files which we can control in realtime interactiveluy with all our advanced paramaters to make a realtime video with full interactive control including as you see here mapping live music, breath work, mic levels, hand gestures, and game controllers. We can also have several personally trained models LORAs on a users work or ideas. Here I am using my own original art work as image inputs and a lora trained on my style ( my art work) - all with me controlling my face video. See other demos of inputs from a living tree, or physically based manipulation for realtime architecture ideation.

Video 2: Demo of live AI architecture ideation using physical controllers: boxes.

Video 3: We used our orginal tree painting as source combined with the living signals coming off our plant and our creative manipulation to make this music/visuals happen in real time. So original art mixed with trees or plants/ garden and dance (mouse controls) can make interactive moving art.

Video 4: Our work commisioned at ACM SIGGRAPH

Using our systems - users can journey through art and design ideation space:

Our system allows for moving through a space where all is logged and users can journey back and forth and on creative forks - where all parts of the journey are archived and mapped.

These techniques have been used by many artists including much work in video and large scale multimedia art including with dancers, and art activism. See work with: DANCE .. and .. Large Projection.

We often exhibit the work at major museums, galleries, conferences and at talks, interviews (TV News here), panels including discussing ethical implications. See News section for talks.

—— PAPERS: AI-based Exploration of Art and Design ——

by Zinovieff F; Aceves Seplveda G; DiPaola S; Sun P – Journal – Vol 3. No 2
Ecocene; Cappadocia Journal of Environmental Humanities (2022)

by Sun P; Zinovieff F; Aceves Sep£lveda G; and DiPaola S – Journal – Special Issue on Hacking the Anthropocene. 5 pages
In Feral Feminisms 12 (2022)

by Zarei M; DiPaola S – Conference – Computer and Information Science. vol 1420. (short paper). Springer
International Conference on Human Computer Interaction (HCII 21) (2021)

by Cuykendall S; Sun P; Muntean R; DiPaola S – Conference – British Computer Society. pp. 159-166
Electronic Visualisation and the Arts (EVA) (2017)

by Carlson K; Schiphorst T; DiPaola S – Journal – Special Issue; Intelligent Technologies for Interactive Entertainment. Vol 16. No 6. 10 pages
EAI Journal of Creative Technologies (2016)

by Cuykendall S; Soutar-Rau E; Schiphorst T; DiPaola S – Conference – pp. 234-238
ACM Conference on Designing Interactive Systems (DIS) (2016)

by Song M; DiPaola S – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2015)

by Carlson K; Schiphorst T; DiPaola S – Conference – (Springer Lecture Notes Book). V 136. pp. 46-56
Intelligent Technologies for Interactive Entertainment (2014)

by Fortin C; DiPaola S; Hennessy K; Bizzocchi J; Neustaedter C – Conference – 10 pages
ACM Conference on Creativity and Cognition (2013)

by DiPaola S – Book – by Parke & Waters. 2nd Edition. AK Peters
Book; Computer Facial Animation (2008)

by DiPaola S – Journal – Vol 4. No 9. pp. 1-8
Artciencia; Art & Science Journal (2008)