Connexion
Added an interpolator to the volumetric capture setup. You don’t have to buy a gimbal to stabilize the camera motion. V-SLAM works like a charm.
Play, scrub, tweak, and replay. My editing workflow of SMF (.mid file) based animation was much improved. https://github.com/keijiro/MidiAnimationTrack
Released the first version of MidiAnimationTrack that imports .mid files into Unity Timeline. It allows creating musically synchronized animation using DAWs. https://github.com/keijiro/MidiAnimationTrack
Several UI improvements to MidiAnimationTrack. Now you can fold/unfold them, enable/disable them, move them up/down and copy/paste them.
Added AnimationCurve support to MidiAnimationTrack. It’s simply triggered by key-ons. Although it’s less expressive than ADSR (as it ignores key-offs), it’s convenient to make complex animation.
In this example, I also used the Timeline Signal feature to trigger the particle effect from MIDI notes on the timeline. It’s not scrub-friendly, but handy to invoke events in play mode.
Adding Timeline Signal support to MidiAnimationTrack. Now it can trigger UnityEvents from MIDI notes on a timeline. https://github.com/keijiro/MidiAnimationTrack/tree/dev-signal
Tested the LED light in a dark room. RealSense T265 Tracking Camera doesn’t work in darkness, but it can be solved by adding a light to the camera rig.
RealSense T265/D415 multi camera mount (ver. 2) https://www.tinkercad.com/things/6ZrIcJwBqyC
Tested an HDMI EDID emulator adapter. It emulates a HDMI display connection for a computer, so that I can connect/disconnect a display without interrupting a system. It’s handy to maintain a headless rendering system. https://www.lindy-international.com/HDMI-EDID-Emulator.htm?websale8=ld0101.ld020102&pi=32103&ci=20
Refurbished the real time volumetric capturing system. It’s optimized for RealSense T265/D415 combo. Now it runs more stable and performs better. https://github.com/keijiro/Rsvfx
Implemented a frame synchronizer that matches inputs from T265 (tracking camera) and D415 (depth camera). It’s needed to remove jitter because the refresh rates of these devices vary widely. It’s still a bit noisy but stable enough for my application. https://github.com/keijiro/Rsvfx
I bought Newnex screw locking cables. I also attached iPhone to this rig to control effects via TouchOSC.
PoC of a portable volumetric capturing system. RealSense T265/D415 + backpack PC. Rendered frames are sent via WiFi using NDI. https://github.com/keijiro/Rsvfx
I resumed working on MidiAnimationTrack. Now it runs without any per-frame GC alloc. https://github.com/keijiro/MidiAnimationTrack
I’m updating the design slightly. https://www.tinkercad.com/things/6ZrIcJwBqyC
Realtime volumetric capturing with a RealSense T265/D415 combo. It works like a free-floating camera in a 3D scene. Previously I used my hand to “mount” them. Now it’s stable and easy to move around. https://github.com/keijiro/Rsvfx
This is my first time using a 3D printer to make a thing. Multi-camera mount for RealSense T265/D415 combo. https://www.tinkercad.com/things/aN96pWSNAF9
I tested the alpha channel image quality of the NDI video codec. I wondered if it could contain additional information like depth values in volumetric videos. https://github.com/keijiro/NdiQualityTest
Real time scene capture with RealSense D415 depth camera and T265 tracking camera. Visualized using VFX Graph. https://github.com/keijiro/Rsvfx
Trying RealSense T265 tracking camera combined with D415 depth camera.
In Evp3, I used a small script to present rendered frames on a secondary display. It uses the customRender delegate of HDRP, so that it can skip most part of the render pipeline. This is a small thing but useful when using HDRP for live visuals. https://github.com/keijiro/Evp3/blob/master/Assets/Script/SimpleBlit.cs
I added a project description to Evp3 – a Unity project that was used in the demonstration at Unite Shanghai last week. https://github.com/keijiro/Evp3
From the demonstration at Unite Shanghai. VFX Graph, RealSense with a Chinese traditional instrument (pipa).
I’m still working on the slides for the upcoming Unite talks. It contains tons of GIFs.
Collanews 