Pifcamp 2021 koda, dokumentacija in razno
Go to file
Martin 63990f2242 added timer var 2022-03-05 02:04:56 +01:00
3d_files post-maribor 2022-03-04 22:32:11 +01:00
8266 Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
ArduinoNano33BLE added sensor fusion calibration and diagnostic arduino sketches for arduino nano 33 ble 2022-03-04 02:43:20 +01:00
IMU_Zero/IMU_Zero Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
IMU_ZeroBT Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
esp32s2example Bluetooth funcitonality, OSC extension, new calibration for proto 2022-03-03 22:38:07 +01:00
i2cscanner Add wifi sketch, i2cscanner 2022-03-04 14:57:05 +01:00
kbd/kbd Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
kbdtest/kbdtest Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
keypadtest/keypadtest Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
osc32/osc32 Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
osc32bt merge conflict in osc32bt resolved 2022-03-05 01:54:36 +01:00
osc32final added timer var 2022-03-05 02:04:56 +01:00
osc32h/osc32h Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
osc32hh/osc32hh Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
osc32wifi Standradising the new final sketch 2022-03-05 00:50:13 +01:00
proto32 Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
proto32plot/proto32plot Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
scan32 Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
LICENSE Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
README.org Added dependencies in arduino to readme 2022-03-02 21:16:42 +01:00
installation-guide.md Update installation guide 2022-03-02 22:27:18 +01:00
motion-glove.jpg Prvi komit 2021-08-08 23:22:37 +02:00
projekt.jpg Prvi komit 2021-08-08 23:22:37 +02:00
projekt.jpg~ Prvi komit 2021-08-08 23:22:37 +02:00
projekt.kra Prvi komit 2021-08-08 23:22:37 +02:00
projekt.kra.bak Prvi komit 2021-08-08 23:22:37 +02:00
projekt.kra~ Prvi komit 2021-08-08 23:22:37 +02:00
proto1.blend Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
proto1.stl Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
proto2.blend Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
proto2.blend1 Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00
proto2.stl Arduino prototypes, license, 3d models, documentation 2021-08-14 15:19:56 +02:00

README.org

Gibalna rokavička

/g1smo/pifcamp-2021/src/commit/63990f2242ce38e151bec200978a43393d7ab448/projekt.jpg

Opis

Wavey Wind, the Modul-air Mitt

Using an ESP32 microcontroller with wifi and bluetooth capability, a gyroscope/accelerometer module and keyboards switches, I will be building an experimental low cost motion "glove" controller with a button for each finger.

The idea stems from an earlier abstract visualisation project which was intended to visualise music. After building the initial prototype and hooking it up with a touch user interface of sliders that modulate the visuals, I asked myself why should I make the program interpret music? We already do that when we listen and (can) react by dancing; using a motion sensor, the dancing can be "aplified" by turning bodily motions into shapes and colours projected on a surface.

Using the motion mitt, the operator of visuals doesn't have to get locked into a clumsy little touchscreen but can immerse in the experience of sound and video while co-creating it. A workshop will be held to build a number of gloves that can connect in an ad-hoc network, so that group of people could collaborate with them.

The glove(s) will send events via the open sound control protocol, opening the possibility to using using them for audio synthesis/modulation, or maybe even as a general interface.

"What Can a Body Do?"

Gibalna rokavička ("Wavey Wind, the Modul-air Mitt")

Z ESP32 mikrokontrolerjem, ki omogoča wifi in bluetooth povezljivost, modulom z žiroskopom in pospeškomerjem ter tipkovničnimi stikali bom izdelal eksperimentalni nizkocenovni gibalni vmesnik z gumbom za vsak prst.

Ideja izhaja iz zgodnješega projekta abstraktne vizualizacije, ki naj bi odsevala glasbo. Po izgradnji zgodnjega prototipa z vmesnikom na drsnikov na dotik, ki modulirajo prikaz, sem se vprašal zakaj bi program interpretiral glasbo? To namreč počnemo že mi, na poslušanje (lahko) odreagiramo s plesom, gibalni senzor pa bi lahko telesne gibe "ojačal" v oblike in barve, projecirane na površino.

Z gibalno rokvičko se opravljalka_ec vizualij lahko izogne ujetosti v neroden zaslon na dotitk in potopi raje v izkušnjo zvoka in videa med soustvarjanjem le-te. Organizirana bo tudi delavnica za izgradnjo večih rokavičk, ki se lahko med sabo povežejo v ad-hoc mrežo, kar skupini ljudi omogoči sodelovanje.

Rokavica oz. rokavice bodo pošiljale podatke preko OSC (open sound control) protokola, kar odpira tudi možnost rabe za zvočno sintezo/modulacijo ali celo kot splošni vmesnik.

"Kaj zmore telo?"

Shematika

ESP32 <-> MPU-6050 (gyro/accel)

  • 21 - SDA (data)
  • 22 - SCL (clock)
  • 3V3 - VCC (strom)
  • GND - GND (ZEMLA)

key switches

  • one pin of each to GND
  • other pin of each to 16, 17, 5, 18

Arduino sketch

dependencies (libraries)

  1. OSC (filter by "open sound control")
  2. MPU6050

calibration

  • IMU_Zero

testing, prototypes

  • kbdtest
  • keypadtest (kbd matrix test, didn't work)
  • proto32, proto32plot, osc32, osc32h, osc32hh

Final sketch

  • osc32final

3d models

  • proto1.blend first prototype
  • proto2.blend second prototype

visual

https://git.kompot.si/g1smo/wavey-wind

start with `npm i; npm start`

localhost:6676/ localhost:6676/test

history

The original animation, modularized with sliders, was first "exhibited" on october 6th 2017 in Modri kot, a beautiful space for performance that used to be on the side of the autonomous factory Rog in Ljubljana, which was evicted by force on january 19th 2021 by the municipality to pave way for future gentrification. Special thanks to Zala and Lio for hosting me during early development and Tisa Neža for curating the first performance.

TODO

  • fix bad rotation
  • better documentation
  • use accelerometer
  • experiment with sound (suppercollider via OSC?)
  • wireless (wifi or bluetooth?)
  • ad-hoc connection to use multiple controllers
  • better starting parameters
  • ergonomic control
  • dashboard to see parameter values
  • live coding interface