D o c u m e n t s

S e e   m y   D E A   2 7 3 0

S T U D E N T   E X A M P L E S
• enabling tools

Helping Handhelping hand, titlting t. [video]

S T U D E N T   E X A M P L E S
• assistive surface for children

Haptic Desk Interface for Austismhaptic desk [video] [documents]

S T U D E N T   E X A M P L E S
• for a university campus

project 868
Lee Hall
[video] [documents]

proj 868-2
[video] [documents]

S T U D E N T   E X A M P L E S
• on urban disaster response

pCAP [video] [documents]

SIS [video] [documents]

YOU [video] [documents]

IES-Favela [video] [documents]

S T U D E N T   E X A M P L E S
• for children

Flower [video] [documents]

iTOI [video] [documents]

S T U D E N T   E X A M P L E S
• on aging in place

[video] [documents]

ReLiS [video] [documents]

IFF [video] [documents]

mKARE [video] [documents]

Interactive and Adaptive Environments Studio
Keith Evan Green, Ph.D.
Teaching Assistant:
Carlos Araujo de Aguiar, ca449@cornell.edu
Tuesday and Thursday, 1:25-4:25pm, HEB 2L32 "Assembly Studio"

C O U R S E   D E S C R I P T I O N
  |   D E A   4 2 1 0
The built environment made interactive and adaptive by embedded computation has great promise to support and augment us at work, school, and home, as we roam, interconnect, and age. Students will design and prototype artful, meticulous, cyber-physical artifacts and environments responsive to specific challenges of an increasingly digital society.

P R E R E Q U I S I T E S   |   E N R O L L M E N T
• 4 credits; letter grade only
• The previous class had students (upper-level Bachelors, MS, M.Eng., and PhD)
from DEA, IS, CS, MAE, and FSAD. Students from ECE, Architecture, and other allied departments are also welcomed. All students from outside DEA require professor's permission.
• Prerequisites only for DEA students: 2 studios at 2000-level or higher.

S Y L L A B U S   |   C O U R S E    B L O G
M Y   F O U N D A T I O N A L   P A P E R S
"Architectural Robotics, Inevitably." ACM Interactions.
"Rethinking the Machines in Which We Live." IEEE RAS.

• Green, Keith Evan. Architectural Robotics. Cambridge, MA: MIT Press, 2016.
• Dow, S. Wizard of Oz Interfaces [WOz].
• Grönvall, E., .... "Causing commotion with a shape-changing bench...."
• Ishii, H., ... “Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials.”
• Jolliffe, Daniel. “Arduino Fever."
• Mau, Bruce. "An Incomplete Manifesto for Growth."
• McComb, G. "Making Robots with the Arduino." Servo (02/2011) pp. 67-75.
• Mitchell, William, J. "Computers for Living in" in e-topia.
• Negroponte, N. “Intelligent Environments,” Soft Architecture Machines.

We will be working mostly with the Arduino-compatible Grove suite of electronics modules. To learn how to use Grove, see: the Grove System Wiki and the Grove - Starter KIt v3 online guide. To learn how to program Arduino, see resources linked below. Material costs for this studio are expected to be approximately $100 per student. This includes the purchase, by each student, of:

  • 1 Seeedstudio "Grove for Arduino - Starter Kit V3" available widely (see retailers below) including Amazon for $49.99 at the time this document was prepared
  • 1 Arduino UNO R3 (or the most current basic Arduino board*) available widely (see retailers below) and from Amazon at $23.97 at the time this document was prepared.) *see Make's Guide to Boards, including Arduinos.
  • Typical studio project consumables (cardboard, plastic, ...) and possibly other electronic and mechanical hardware, as needed.

V I D E O   P R O D U C T I O N   G U I D E   +   E X A M P L E S
My guide for producing videos.
My previous students' videos from this course: see left-column of this page.
Examples from my lab: AWE and ART.
Marble Answering Machine (Bishop, 1995) - example of hand-drawn WOz video.

P A P E R   E X A M P L E
Example from my lab.

S C H E D U L E   B Y   W E E K
(Ahead of each session, review the supporting documents indicated by letter)
First Class 01.26 | Definitions, practices, Arduino; Assignment-1; form teams | A
Week 01.30 | Problem definition, lit review, ideation: Arduino | B C D E F G H I
Week 02.06 | Storyboard, scenario, interviews, prototyping | J K L O U
Week 02.06 | Progress reports w/ Arduino demo, prototyping, observations | N
Week 02.13 | Progress reports, prototyping, survey, video | P V
Week 02.20 | [Break 02.21] Progress reports w/ video, heuristic & Ix evaluations | M U
Week 02.27 | Demos 03.02; Intro Assignment-2; form teams | B C D
Week 03.06 | Problem definition, lit review, ideation | E F G H I
Week 03.13 | Design for emotion, ideation, personas/scenarios, | S J K L O R U
Week 03.20 | Progress reports w/ Arduino demo, prototyping, observations | N
Week 03.27 | Progress reports, prototyping, survey | P Q
Week 04.03 | [Spring Break]
Week 04.10 | Progress reports, prototyping, heuristic evaluation | M
Week 04.17 | Demonstration of working prototype, Ix evaluations | U  
Week 04.24 | First video, protytpe refinement | V
Week 05.01 | Prototype and video refinement  
Final Class 05.09 | Demos, conclusions, and lessons learned  

S U P P O R T I N G   D O C U M E N T S  /  (entire design guide)
A Design Cycle
B Problem Definition (more)
C Lit Review
D List of Requirements
E Collage (more)
F Analogies & Metaphors
G Mind Map
H Morphological Chart (more)
I Scamper
J Storyboard (more)
K Scenario (more)
L Role Playing
M Heuristic Evaluation (Jakob Nielsen's Heuristics)
O Interviews
P Questionnaires (aka Surveys)
Q Focus Groups
R Cultural Probes
S Design for Emotion
T Emotion Measurement
U Ix Prototyping & Evaluation
V Video Visualization

A S S I G N M E N T S   A N D   G R A D I N G

Assignment-1 | A "convivial tool" (30% of the course grade)

Using Arduino and the Grove kit, design a "convivial tool" inspired by Ivan Illich's Tools for Conviviality (1973). To help conceptualize your tool, select two or more gerunds that define states of the system. These gerunds may include the following: Aging, Thinking, Creating, Waiting. Connecting, Collaborating, Composing, Dreaming, Loving, Working, Performing, Presenting, Pondering, Travelling, Escaping, Wondering.

The tool should be interactive by way of a sensor and an actuator that moves physical mass, You are encouraged to add lighting and/or sound. Your delierables are:

  • documentation of your design concept(s) and articulation of the aims/motivations for your design (10%)
  • your working prototype—its functionality, aesthetic refinement, response to stated aim (10%)
  • your video and one-page paper (10%)

Assignment-2 | "Repairing 'Stellavista' (60% of your course grade)

Read J G Ballard's short story "The Thousand Dreams of Stellavista" (1962) and design an interactive/adaptive system that repairs something you discovered in Ballard's fictionalized suburban, architectural-robotic dystopia. Your user/clients are Fay and Howard Talbot, the couple in the story that is considering moving to a home in Stellavista.

The prototype should be interactive by way of sensors and actuators that move physical mass, You are encouraged to add lighting and/or sound. You may also integrate any manner of input device, actuator, hacked device (e.g. a toy, a camera), machine learning, computer vision, augmented reality,.... Your deliverables are:

  • documentation of your design concept(s) and articulation of the aims/motivations for your design (20%)
  • your working prototype—its functionality, aesthetic refinement, response to stated aim (20%)
  • your video and one-page paper (20%)

• The final 10% of your course grade is for documentation of both assignments on a CD - all documents you produced in the course, including all photos, sketches, and videos.

Format for video: H.264 encoded MP4, at least 1280px x 720px, at most 5 minutes (2-3 minutes is a more common length), captioned for accessibility in .srt or .sbv format (example video from my lab).

Format for one-page paper: Extended Abstracts Format (example one-page paper from my lab).

The above materials will be completed to meet the submission requirements for an ACM conference like DIS (Designing Interactive Systems), TEI (Tangible, Embedded and Embodied Interaction), IDC (Interaction Design and Children), or CHI (Human-Computer Interaction). For each project, the student designer(s) will be designated first authors and the professor and TA will be designated as last authors for any conference submission, as the professor and TA will be integral to the success of the submission.

A R D U I N O   S O F T W A R E   D O W N L O A D   A N D   G U I D E

G I T H U B   O N   A R D U I N O
• Find lots of Grove Arduino and Arduino code for your projects on GitHub, e.g. here

A R D U I N O   T U T O R I A L S
• Jeremy Blum's http://www.jeremyblum.com/category/arduino-tutorials/page/3/
• Arduino's http://arduino.cc/hu/Tutorial/HomePage
• Ladyada's http://www.ladyada.net/learn/arduino/
• NYU ITP Intro to Physical Computing http://itp.nyu.edu/physcomp/Tutorials/Tutorials
MAKE: Arduino projects
• Search YouTube - it's a tremendous open-source resource for this community!

O N L I N E   H A R D W A R E   R E T A I L E R S
Maker Shed
Grove from Seeed
Grove from Mouser

C L O S E   A L L I E S   W I T H   O U R   C O U R S E  :  T U   D E L F T  x  2
THE HYPERBODY research group at TU Delft
Interactive Environments Minor at TU Delft

To prepare the required paper and video for this course, enrolled students may conduct peer-to-peer participant studies using their peers, enrolled in the same course, as participants. These studies will use methods considered in my course DEA 2370, Human-Centered Design Methods, the core methods course for all DEA students. These methods may include interviews, observations, surveys, co-design activity, heuristic evaluations, and cognitive walkthroughs. As part of this design research activity, students conducting these studies may take written notes, photographs, and/or video as a means of documentation. This documentation may be reproduced in the papers and videos for submission to CHI or a like conference, and may be presented at the conference. Student will not be identified by name in such submissions/presentations, and no aspect of these studies should cause discomfort or risk to participants; nevertheless, should any student in the class choose not to participate in any aspect of the study, or have questions about her/his participation, please make this known to the instructor prior to the start of such study. Additionally, for any work of the course submitted for publication, student authors will be identified as first authors of the submission, and the instructor and any TA will follow in the list of authors of such work in recognition of their efforts in cultivating this work. If these term are not acceptable to you, please indicate so to the instructor. Non-participation will not impact your grade for this course in any way.

J O I N   S I G C H I   A N D   D R N
Students are encouraged to join email postings (aka listservs) for ACM SIGCHI ANNOUNCEMENTS and DESIGN RESEARCH NEWS (both of these for design opportunities) and also ACM SIGCHI JOBS (in design). Students are also encouraged to become a student member of SIGCHI which brings you a 1-year subscription to interactions magazine [print] and discounts on ACM conferences. Directions for joining all of these.