What is the “RICOH THETA  Type HATSUNE MIKU” app?

This is Employee sal, I made the example image released on August 15. This product has a lot of key points and among them I would like to touch on the dedicated app.
This app allows you to actually make Miku appear in a 360-degree image.

I would just like to give a simple explanation of the steps used when this example was created.

1.Viewing the shot image

First you need to think about where you want Miku to make an appearance (a wild fantasy, I know).
Anyway the image is in 360-degrees. Many unexpected things will appear in the photo. I think you can consider various situations.
You can have her flying in the sky or even create hearts. There are 24 types of poses, which when combined with facial expressions will give over 2,000 different looks. Your imagination (fantasy) will not run out of ideas.
With the example image made this time, I thought it best to use a scene that a variety of people would be pleased with so I focused on taking an image of sunflowers. I decided to have Miku pose for me taking advantage of the sunflowers facing towards me.


To have Miku appear as though she is standing behind the sunflower I masked the shape of the petal on the sunflower.
So it’s an image with a wall (mask) placed in front of Miku.
Subtle touches are required to form the mask in the shape of a petal. For equipment, I used an iPad and stylus pen that allowed me to edit the image on a large screen.
First, I roughly sketched around the shape of the petal with stylus the pen before having Miku appear in the image.
Then I had Miku stand in front of the sunflower.

This is how it first looks.
To form the shape of the finely detailed petals I had to ask Miku to cooperate. That is, Miku and I worked in collaboration to create the photo.
I asked Miku to move just a little.
If you look at Miku’s left knee, you can clearly see the area that needs masking.

This work is then repeated.
That is, “Effect” (apply mask) ↔ “Rotation” (have Miku move).
If you make a mistake, you will have to reset so it can be nerve-wracking.
It is similar to painting a plastic model I used to make long ago. The more time you take will allow you to make a better mask.
(Working in collaboration with Miku is very enjoyable and you will simply forget about the time.)

3.Adjusting color and shadows for Miku

I adjusted Miku’s color to match the color temperature of the image. It was a little cloudy so I lowered the shadow density, and the light source was close to the zenith so I adjusted the position of the shadow to lie directly beneath Miku. To match the color temperature it is a good idea to match the “white” of Miku and the “white” in the image used as a base.
Actually Miku does not have many white areas. You can change “Eyes” by selecting “Menu” → “Expression”. Setting her eyes to the “What? (Nanu!)” expression will expand the white area of her eyes so you can use this for referencing white.
I lowered the brightness slightly to match the image.


Finally, we can have Miku pose for us.
We can change the size, orientation, type of pose and her facial expression to create the most suitable scene. Changing her pose and facial expression is the most fun part and you can let loose your power of imagination (fantasy).
Save after deciding on the scene, change her pose (facial expression and gesture), and save again. That’s it, it feels as though we are taking a portrait with Miku here (there’s no way it can ever get boring!).

Here I introduce some example images that were discarded.

View 360-degree image>>
An image that looks as though Miku is coming towards us. To create a feeling of lively motion I floated the right part of her hair and balanced it with her right hand.

View 360-degree image>>
Hide and seek in the sunflowers. Her hands look a little unnatural, but it appears as if she is signaling us, which looks good.

View 360-degree image>>
I used a smaller version of the first example to give it more of a feeling of fantastical creatures such as faeries and elves. Using composite matching with sunflowers in the background, Miku really stands out when expanding the image.

What do you think?
This time, I introduced my own production process. Of course, that doesn’t mean it’s the best method.
I think everyone has their own best way of using the app. If you “discover” a convenient way of using the app, I think it will be fun to share it over SNS.
Using this app, you can recreate 360-degree images as new works of art full of imagination.
I hope you can work in collaboration with Miku, let loose the power of your imagination, and create something unique for yourself.

(Employee sal)