JAM

An experiment about joint action in music.

download

with a git gui client

• clone https://github.molgen.mpg.de/twinter/JAM, make sure the submodules are cloned as well

with the git command line client

• open a terminal in the directory where you want to have the files
• run git clone --recursive https://github.molgen.mpg.de/twinter/JAM

without the above (not recommended)

• download from https://github.molgen.mpg.de/twinter/JAM
• download and extract it somewhere
• open the Python folder in the downloaded files
• download https://github.molgen.mpg.de/twinter/mr_keyboard
• extract its contents in the mr_keyboard folder
• download https://github.molgen.mpg.de/twinter/serial2midi
• extract its contents in the serial2midi folder

update

Use you git GUI client or git pull -r when you're in the JAM folder.

You have to download it again if you don't have git.

usage

in the scanner

what you need to connect

• midi->serial box:
  • USB and serial in rubikon
  • midi cable that lies around
• notebook
  • HDMI (left side of the notebook)
  • VGA (back)
  • USB to the triggerbox
  • audio jack for the mixer (next to HDMI)
  • network cable (behind the flap named "I/O")
  • power
• triggerbox of the MRI
  • exchange the USB power cable there (top left of the box) with the USB cable connected to the notebook (try not to touch the cable below!)
• camera
  • power adaptor
  • video dongle
• power to the following
  • mr-keyboard (heart)
  • mixer
  • midi->audio box (mr midi)
  • the yamaha piano

startup

1. turn on the yamaha piano
2. start the python program on rubikon (you should be able to use your own login, if not: use user/user)
   • open a terminal in the Python folder (the one containing experiment.py)
   • if you haven't used it in a while (or it sounds like a lot of keys are pressed at random or you get loads of "value out of bound" errors) calibrate it before using it (step below with appended -c flag)
   • run the experiment with python3.6 experiment.py (if you want to see more information: add -vvv)
   • if your'e asked for a network interface: select the one called "enp6s0"
   • if you see errors like "write timeout": disconnect the mr keyboard from the power, wait a bit and connect it again
   • if it asks you what primary midi out to use: use the one with a name like "USB Device 0x…"
   • set the secondary midi in to "serial2midi_ttyS4" and out to the same as above (it should show tell you about "1 user(s)" already on the device
3. configure the windows notebook
   • ensure the screens are properly set up (right click on desktop -> screen resolution) ("EPSON PJ" is the beamer in the scanner, "SyncMaster" is the screen on the yamaha piano)
   • make sure the screens other than the notebooks own are set to 1280x1024
   • test (and correct the correct screen assignment in Presentation (settings tab -> video -> multiple stimulus displays)
4. start the Presentation script
   • start presentation with a double click on JAM.exp (this should start the "real" mr keyboard script on the python computer, i.e. something will happen in the terminal there)
   • run the presentation script

mock up

what you need to connect

• notebook
  • power
  • HDMI (left side)
  • VGA (rear left)
  • audio (left, next to HDMI)
  • USB (form midi->serial box)
• midi->serial box
  • midi from the rack

required modifications

This may not be a complete list, add missing points (or notify me so i can add them)!

• enable fMRI emulation in JAM.sce (should be in the upmost couple of lines)
• check if the serial input is configured correctly (see the readme in the Presentation folder)
• check if you have to enable screen mirroring (in the parameters tab in Presentation)

startup

1. the rack
   • power up the rack
   • turn off the harddisk recorder (see instructions on top of the rack)
2. turn on midi keyboard
3. notebook
   • set up screens in Windows and Presentation (see above)
   • rotate the "mri" screen in the windows display settings (same menu as above)
4. start the Presentation script