• Isadora
  • Get it
  • Forum
  • Help
  • ADD-ONS
  • Newsletter
  • Impressum
  • Dsgvo
  • Impressum
Forum
    • Categories
    • Recent
    • Popular
    • Tags
    • Register
    • Login

    How to have a person move an object that is generated/projected by Isadora

    How To... ?
    13
    50
    19.1k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SkulptureS
      Skulpture Izzy Guru
      last edited by

      @Marci I was talking about the depth image from a kinect. SO the multiple edges are the "outline" of a person.

      Graham Thorne | www.grahamthorne.co.uk
      RIG 1: Windows 11, AMD 7 Ryzen, RTX3070, 16gig RAM. 2 x M.2 SSD. HD. Lenovo Legion 5 gaming laptop.
      RIG 2: Windows 11, Intel i19 12th Gen. RTX3070ti, 16gig RAM (ddr5), 1x M.2 SSD. UHD DELL G15 Gaming laptop.
      RIG 3: Apple rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

      1 Reply Last reply Reply Quote 0
      • DusXD
        DusX Tech Staff
        last edited by

        Wow, I got to this thread late in the game.

        3D collision detection should be pretty easy in Isadora as long as you have good data.
        I would be tempted to use 2 IR cameras. One in front and one above.
        XY from the front, and Z from above. In anycase adding the Z to the Quad detection should be easy.
        I have only played with rects and circles for detection, 
        but if you want to determine more complex relations I would suggest looking into 'Point in Polygon' detection. see: https://github.com/substack/point-in-polygon
        Since the number of points in a polygon may vary, it becomes important to pass data sets together (unless you are defining a specific form). It will help keep your patch clean. see: http://dusxproductions.com/blog/pro-tip-single-patchcords-multiple-values/
        I would think that you could define a dynamic polygon based on the skeleton data that would be close to the actual figure.
        Then using this 'Point in Polygon' method you should be able to make the collision detections required.
        Again I would 'fake' the 3D to some extent by make X number of Z regions (just lowering the resolution in this dimension really)
        Its great to see that my blog has been a help 🙂

        Troikatronix Technical Support

        • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
        • Isadora Add-ons: https://troikatronix.com/add-ons/
        • My Add-ons: https://troikatronix.com/add-ons/?u=dusx

        Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

        1 Reply Last reply Reply Quote 0
        • SkulptureS
          Skulpture Izzy Guru
          last edited by

          Some context to my idea/dream 

          https://www.youtube.com/watch?v=jKB0d9vsfgA 

          Graham Thorne | www.grahamthorne.co.uk
          RIG 1: Windows 11, AMD 7 Ryzen, RTX3070, 16gig RAM. 2 x M.2 SSD. HD. Lenovo Legion 5 gaming laptop.
          RIG 2: Windows 11, Intel i19 12th Gen. RTX3070ti, 16gig RAM (ddr5), 1x M.2 SSD. UHD DELL G15 Gaming laptop.
          RIG 3: Apple rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

          1 Reply Last reply Reply Quote 0
          • FredF
            Fred
            last edited by

            And here again a unified coordinate system either normalised or pixel based would make comparative calculation and position in Isadora one million times easier.

            http://www.fredrodrigues.net/
            https://github.com/fred-dev
            OSX 10.15.15 MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
            Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD
            Windows 10 Threadripper 3960x 64g ram, 1tb NVME, rtx 2080ti + rtx2070 super

            1 Reply Last reply Reply Quote 0
            • SkulptureS
              Skulpture Izzy Guru
              last edited by

              I've found an old patch that @gavspav made for me when talking about this a while ago.

              I can't get it to work but it may be handy for some. 

              d0d4c5-bounce-off.izz

              Graham Thorne | www.grahamthorne.co.uk
              RIG 1: Windows 11, AMD 7 Ryzen, RTX3070, 16gig RAM. 2 x M.2 SSD. HD. Lenovo Legion 5 gaming laptop.
              RIG 2: Windows 11, Intel i19 12th Gen. RTX3070ti, 16gig RAM (ddr5), 1x M.2 SSD. UHD DELL G15 Gaming laptop.
              RIG 3: Apple rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

              1 Reply Last reply Reply Quote 0
              • DusXD
                DusX Tech Staff
                last edited by

                @Fred It's in the feature requests. When you say normalized, what do you mean? I think the precentage measure isadora uses can do the job. It's just knowing which elements are based on stage width vs height that makes calculations difficult. Personally I like the scalability of this method. Using a little care you can make projects that adapt to different displays very easily.

                Troikatronix Technical Support

                • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                • Isadora Add-ons: https://troikatronix.com/add-ons/
                • My Add-ons: https://troikatronix.com/add-ons/?u=dusx

                Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                1 Reply Last reply Reply Quote 0
                • J
                  JetJaguar
                  last edited by

                  DusX and Skulpture,

                  How to track an infrared LED in Isadora?.  I can see an infrared light using Processing and simple open NI tracking IR; it is being picked up by the Kinect.  Cannot figure out how to either see and use the IR LED to be tracked in Isadora and then used as a trigger.  What would that actor configuration look like?  Currently I'm simulating moving particles on the X, Y planes with a Mouse Watcher but would like to replace it with the IR LED as both DusX and Vanakuru suggested.

                  Portland, Oregon
                  Mac Pro Retina 2013: 2.6 GHz Intel Core i7, 16 GB DDR3 Ram
                  iMac 5K: 4 GHz quad-core Intel Core i7, 32 GB DDR3 SDRAM

                  1 Reply Last reply Reply Quote 0
                  • dbiniD
                    dbini
                    last edited by

                    infrared camera -> video in watcher -> sprite (to calibrate size and positioning) -> eyes -> gives you an x and y for the infrared dot.

                    John Collingswood
                    taikabox.com
                    2013 MBPR 2.3GHZ i7 OSX11.7.4 16GB
                    & 2019 MBPT 2.6GHZ i7 OSX12.3 16GB

                    1 Reply Last reply Reply Quote 0
                    • rainbowR
                      rainbow
                      last edited by

                      Wii remote and OSC, I used years ago, sure it still dose the job.

                      best ...
                      rainbow
                      1 Reply Last reply Reply Quote 0
                      • gapworksG
                        gapworks
                        last edited by

                        @rainbow

                        i don´t quite get your concept. 😞 the dancer needs to carry the Wii ?

                        Running MBP2017 / Osx 10.14.5 / 16 GB 2133 MHz LPDDR3 / Intel HD Graphics 630 1536 MB / Latest Isadora Version / www.gapworks.at / located in Vienna Austria

                        1 Reply Last reply Reply Quote 0
                        • rainbowR
                          rainbow
                          last edited by

                          ofcourse you need a IR led as well for the actor/dancer ;))

                          1 Reply Last reply Reply Quote 0
                          • J
                            JetJaguar
                            last edited by

                            gapworks-  IR led on the dancer.  Kinect watches the IR led.

                            Thanks dbini!  I will check out.

                            Portland, Oregon
                            Mac Pro Retina 2013: 2.6 GHz Intel Core i7, 16 GB DDR3 Ram
                            iMac 5K: 4 GHz quad-core Intel Core i7, 32 GB DDR3 SDRAM

                            1 Reply Last reply Reply Quote 0
                            • MichelM
                              Michel Izzy Guru
                              last edited by

                              @joedrums

                              In the link you see a video where an IR-Pen and a Wii-mote are working together, the Wiimote was about 8 meters (26ft) away the maximum distance I could get to work fine. I usede OSCulator to connect to the Wiimote and sent OSC messages to Isadora.

                              http://www.filmprojekt.ch/theater-installationen/strange-lines/

                              Best Michel

                              Michel Weber | www.filmprojekt.ch | rMBP (2019) i9, 16gig, AMD 5500M 8 GB, OS X 10.15 | located in Winterthur Switzerland.

                              1 Reply Last reply Reply Quote 0
                              • gapworksG
                                gapworks
                                last edited by

                                @ Michel would a pen this size work ?

                                 http://www.amazon.de/SALE-Fordex-Gruppe-WIRELESS-PRESENTER/dp/B00KFEPM6I/ref=sr_1_13?ie=UTF8&qid=1444551077&sr=8-13&keywords=IR+Pen
                                and how do you connect the Wii with the pen. OSCulator and Osc messages is clear as i used it before. 
                                best

                                Running MBP2017 / Osx 10.14.5 / 16 GB 2133 MHz LPDDR3 / Intel HD Graphics 630 1536 MB / Latest Isadora Version / www.gapworks.at / located in Vienna Austria

                                1 Reply Last reply Reply Quote 0
                                • N
                                  nick
                                  last edited by

                                  Even later than previous late to party people -

                                  I would approach this by trying to set up sensor/sensors that cover a plane in front of the projection (parallel to the wall where the projection is happening) to detect x y coordinates for anything that breaks the plane.
                                  Depending on how many blocks you want, stage size, budget and rigging time you may be able to do it with a series of break beam or distance sensors.
                                  If you have serious budget then a laser scanner would be the thing to go for (but test it with expected lighting conditions to see) - cheap 360 laser scanner is http://www.slamtec.com/en-US/rplidar/index
                                  You would not need full 360 if the laser is on one side or above, but this was cheaper than anything else last time I looked.

                                  MacBook Pro 11.5.2

                                  1 Reply Last reply Reply Quote 0
                                  • rainbowR
                                    rainbow
                                    last edited by

                                    Well done, glade you solved it. 😉

                                    1 Reply Last reply Reply Quote 0
                                    • MichelM
                                      Michel Izzy Guru
                                      last edited by

                                      @gapworks

                                      No that pen would not work it uses the IR signal to communicate with the usb ir receiver and that is just for sending commands and it has a laser pointer. You need an IR-Pen that has a bright IR-Light. You don't have to connect the IR-Pen with the Wiimote, the Wiimote has a built in IR-Camera and the camera sees the IR-Light.

                                      I have used this IR-Pen the wrong way around, the IR Light was not facing the surface but the Wiimote, I am sure there are cheaper ones around, or you can build your own, there are lots of tutorials online, the trick is to find a very bright IR-LED.

                                      Best Michel

                                      Michel Weber | www.filmprojekt.ch | rMBP (2019) i9, 16gig, AMD 5500M 8 GB, OS X 10.15 | located in Winterthur Switzerland.

                                      1 Reply Last reply Reply Quote 0
                                      • J
                                        JetJaguar
                                        last edited by

                                        Portland, Oregon
                                        Mac Pro Retina 2013: 2.6 GHz Intel Core i7, 16 GB DDR3 Ram
                                        iMac 5K: 4 GHz quad-core Intel Core i7, 32 GB DDR3 SDRAM

                                        1 Reply Last reply Reply Quote 0
                                        • MichelM
                                          Michel Izzy Guru
                                          last edited by

                                          @joejdrums

                                          You need to use the eyes or eyes++ actor and a blob decoder actor attached to it and something infront of the cameras lens that blocks the visible light so the camera only sees the IR light otherwise it will be difficult to track only the IR-Light.

                                          A not exposed but devoleped 35mm color photofilm is a good and cheap filter to atach to the cameras lens to block most of the visible light.

                                          Best Michel

                                          Michel Weber | www.filmprojekt.ch | rMBP (2019) i9, 16gig, AMD 5500M 8 GB, OS X 10.15 | located in Winterthur Switzerland.

                                          1 Reply Last reply Reply Quote 0
                                          • J
                                            JetJaguar
                                            last edited by

                                            Here is where I'm currently at.

                                            Started with "pushing particles.izz" to have mouse control X/Y movement of particles. 
                                            Then tried to use syphon receiver to bring in my Kinect IR stream from Processing (pushing particles + IR.izz).  As you can tell Skulpture or DusX the second experiment isn't working. I cannot figure out how to tie it into the initial pushing particles patch and have the IR light take the place of the mouse.  
                                            Any pointers would be greatly appreciated.

                                            c29f51-pushing-particles-forum.izz 280df2-pushing-particles-w-ir-forum.izz

                                            Portland, Oregon
                                            Mac Pro Retina 2013: 2.6 GHz Intel Core i7, 16 GB DDR3 Ram
                                            iMac 5K: 4 GHz quad-core Intel Core i7, 32 GB DDR3 SDRAM

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post