iPi Soft

Motion Capture for the Masses

newsletter share-facebook share-twitter

Archive for the ‘All’ Category

Film Mocap in Miami

Posted on: December 13th, 2021

Film Mocap in Miami

A Conversation with George Carvalho, Animator /Director of Animaza Studios

Miami-based Animaza Studios, led by animator George Carvalho, has been in business for nearly four years creating a mix of original and client-based animation work. More than just an animation studio, Animaza sees itself as an entertainment company, with several of their original short films serving as trailers for books that have been published by the company’s publishing arm. The studio recently invested in iPi Soft markerless motion capture technology and has put it to use, particularly in two recent short films they’ve produced, “The Goblin Pact” and “Termite Samurai.” Both films were entered into international film festivals and received accolades

We spoke with Carvalho about Animaza Studios, its work and how markerless motion capture is helping the studio achieve its creative goals.

iPi Soft: Tell us a little about your background in animation and what drew you to it? How long have you been working in the field? Prior to Animaza did you work for other studios?

GC: I’ve always liked animation, especially Japanese animation. Many years ago, I was working with a software called Infini-D (now DAZ) to create titles for corporate video work. At the time, my brother was learning Autodesk 3ds Max, and told me that it was the software that Hollywood studios use and I should try it out.

I had recently finished a live-action independent feature film where I was also the cinematographer and thought the lighting could have been better. To improve the quality, I needed access to lights, and at the time only tungsten lights were available but very expensive to rent. With 3ds Max I was able to simulate lights that behaved like real world lights and create photo real results from my home computer. To better learn the software, I started making short films. When I started posting them on YouTube the response was better than I expected. That’s when I decided to start the company.

iPi Soft: How did you initially hear about iPi Mocap? Do the two Animaza award-winning short films – “Goblin Pact” and “Termite Samurai” – both use iPi Mocap?

GC: I watch an enormous number of behind-the-scenes and making-of videos, and mocap occasionally would come up as a new way of animating characters. Both of our short films make extensive use of iPi Mocap and received either best animation short or honorable mentions. I definitely hope to enter future film projects in festivals.

iPi Soft: Tell us a bit about your motion capture process and the major benefits it brings to production? Were you using other animation processes prior to using mocap that prompted you to switch gears towards using a motion capture solution?

GC: When I started on this journey, I was using key frame animation and doing everything by hand. This took an enormous amount of time. After much research, I came across iPi Soft motion capture software and presently use it with the Microsoft Azure Kinect camera.

One of the main benefits of using iPi Mocap in the character animation production process is that it drastically cuts down on hand animating characters. I capture all the performances in my living room conveniently and efficiently. I find iPi Mocap is very simple and intuitive to use and doesn’t require a whole team to get excellent results.

In addition, the quality of the software captures, including small nuances of movement like picking up objects or turning, is helpful in allowing me to capture individual movements that bring out a characters’ unique personality to life.

iPi Soft: What other software and hardware tools were used in conjunction with iPi Mocap in the Animaza production pipeline on the above films?

GC: The main tool I use for animation is Autodesk 3ds Max with the Arnold renderer. Adobe Photoshop is used to manage the textures while we used Adobe After Effects to composite all the images rendered out of 3ds Max while Adobe Premiere is for film editing. Adobe Mixamo is used for some of the animation, with DAZ studio used to acquire 3D resources such as 3D characters and settings.

iPi Soft: Can you walk us through a couple of key scenes in Goblin Pact and Termite Samurai where iPi Mocap helped meet a particular creative challenge? Is there something in particular about a markerless mocap solution, like iPi Mocap, that makes the content creation process easier to use?

GC: A challenging scene in “The Goblin Pact” was in the beginning of the film when the fairies are admiring their wings. I had my wife act out the motions and capture them with iPi Mocap because females have a different center of gravity and move differently than males.

In “Termite Samurai”, we faced a particular challenge when the Termite Samurai must draw out his sword as the spider is attacking, and then fight the spider. The samurai motion was captured all in iPi Mocap and the spider was hand animated – all of it had to be synced together to make it believable.

The advantage of markerless mocap is that it makes if fast to capture the movements needed. So fast, in fact, that it allows me to experiment and refine the animation so that it’s the best it can be. Other solutions may be more accurate, including the use of camera rigs or wearing a suit, but are much more expensive and require a team and extensive preparation to use.

iPi Soft: Are you working on any other animation projects currently that rely on iPi Mocap?

GC: We just released the trailer for the novel “The Proto Sapien Protocol”, on November 1st. The next project is based on Aesop’s fable, “The Hare and the Tortoise”. It is currently in production and both the film and the book are on track to be released early next year.

iPi Soft: Is there anything else you’d like to tell us about your mocap workflow?

GC: The first time I used mocap was on a “Silver Surfer” fan film where an alien character is holding a baby. The moment I saw the character move in such a convincing, fluid way, I knew the software would become an integral part of my future content creation workflow, especially since all the other characters were hand animated and you can see the difference. At the time, I was using the old Xbox Kinect camera, which had limited motion accuracy. But when Microsoft released their Microsoft Azure camera, and iPi Soft updated its support, I jumped right in and haven’t looked back since. I will always be grateful for iPi software, because it has truly allowed me to create high quality animation at a reduced cost and build a thriving entertainment company.




Using iPi Soft Tools To Design A Safer Workplace

Posted on: August 31st, 2021

Using iPi Soft Tools To Design A Safer Workplace

A Q&A With Marco Capuzzimati, Research Fellow at University of Bologna

To hear many future-of-work theorists tell it, the manufacturing workspace of the future is one that will be increasingly filled with humans and robots working together. These collaborative robots — or cobots — work alongside humans without any separation. Moreover, they’re easily reprogrammed making cobots ideal for repetitive or dangerous tasks humans would prefer not doing.

But how do you know if the cobot is safe to work around humans? How far should the arm move? How fast? Figuring out those details is the job of researchers like Marco Capuzzimati, a researcher at the University of Bologna, who use markerless motion capture software tools like iPi Motion Capture to work out the range of motion details using the software before trying it out in the actual workplace.

In fact, scientist and medical researchers discovering innovative ways of incorporating motion capture technology led iPi Soft to create the Biomech Add-On, designed to enable visualization of tracking data for gait analysis and rehabilitation, sports motion analysis and research in 3D human kinematics.

We spoke with Marco about his work and how he’s using iPi Soft technology.

Q. Tell us more about your work?

MC: The project aims to create a management and feeding system for a collaborative cell, represented by a human operator and a cobot, or a collaborative robot. We are developing a system capable of being autonomous in the feeding phase, such as selection, picking and storage, of parts and components involved in the production process.

Q. How are you using iPi Soft to analyze movements? Is this being done in the assembly cell area of a warehouse?

MC: We stream mocap data from iPi Mocap Studio 4 to Unity 3D where we can do a biomechanical analysis of the movements both in the warehouse and in the assembly cell.

Q. Can you provide additional detail on the biomechanical analysis?

MC: We have developed a C-sharp code to handle the incoming mocap data. The data is then sent to a Microsoft HoloLens where we can do biomechanical analysis. We are particularly focused on the angles between certain joints so we can determine critical configurations.

Q. How does motion capture technology help in your research?

MC: Motion capture is helping us in warehouse settings where the cobots and people work together to load components and various parts onto warehouse shelving; and in the assembly phase with support from cobots and people doing tasks that cobots can’t do. The ergonomic design of the assembly cell is very important to maximize operator satisfaction and system performance, so the main objective of motion capture in this project is ergonomic optimization and risk assessment following the execution of certain assembly or load handling activities. In this way we can optimize system performance and reduce the risk of injury.

Q. Can you describe the assembly cell in greater detail? Is the assembly cell a specific area of a warehouse where the robot is assembled? 

MC: The entire area of the ‘Pilot Line,’ as we call it, consists of a warehouse setting with inclined shelves. An assembly cell is formed by a fixed cobot and a flexible working table, this is the main area of interest. These elements allow cobots to carry and move materials and components from a warehouse to the assembly cell.

The main objectives are real-time biomechanical analysis of human operators and application of the ergonomic index for risk assessment during work activities. We have to analyze every single movement during assembly and consider the weights of the parts and components handled, the frequency of handling and the efforts that the operator has to make.

Q. Finally, how long have you been conducting the motion capture research at the University of Bologna? Is there an end date?

My research in the industrial engineering department began in September 2020 and is scheduled for completion in July 2022. I’m looking forward to future projects and opportunities to deploy this motion capture technology.


Picture 1. Marco Capuzzimati, University of Bologna researcher, pictured here at the Bi-Rex: Big Data Innovation & Research Excellence competence center, is conducting biomechanical analysis using iPi Soft motion capture software on workplace safety between humans and collaborative robots (cobots).


Picture 2. Marco Capuzzimati, University of Bologna researcher, pictured here at the Bi-Rex: Big Data Innovation & Research Excellence competence center,  is using iPi Soft motion capture software to analyze workspaces between humans and collaborative robots (cobots), to ensure workplace safety.


Picture 3. Marco Capuzzimati, University of Bologna researcher, is using iPi Soft motion capture data in conjunction with the Microsoft HoloLens to conduct biomechanical analysis in warehouse settings to ensure workplace safety where humans and collaborative robots (cobots) will be working together.

Digital Media World Reports on Plugin Announcement for iPi Mocap and Unreal Engine

Posted on: April 6th, 2021

Thank you Digital Media World for reporting on our exciting plugin announcement for iPi Mocap and Unreal Engine. This integration is an ideal real-time workflow solution for game developers, virtual production content creators, and more. Take a look at the news here.


#iPiSoft #iPiMocap #UnrealEngine #gamedev #virtualproduction #motioncapture #DigitalMediaWorld


iPi Soft Announces Real-Time Integration for Unreal Engine

Posted on: March 24th, 2021

iPi Soft Announces Real-Time Integration for Unreal Engine

New Plug-in and Enhanced Features Deliver Immersive Experiences for Markerless Motion Capture in Game Development, Virtual Production

MOSCOW, RUSSIA – March 24, 2021 – iPi Soft, LLC, developers of the markerless motion capture technology iPi Motion Capture, announced a series of new enhancements supporting Unreal Engine suite of development tools for real time content creation. These iPi Motion Capture enhancements include a new plug-in that affords real-time motion tracking, motion transfer to 3D character and animation streaming into Unreal Engine.

Pavel Sorokin, iPi Soft’s recently named CEO, explains that closer integration with Unreal Engine via the new plug-in gives motion capture users the ability to stream tracking results to Unreal in both the live feedback and offline tracking mode, thus allowing creators to see how motion will look on their character in Unreal Engine and in their particular 3D setting. Additionally, users can have both iPi Mocap Studio and the Unreal Engine editor open simultaneously for viewing animation changes in real-time.

“We are excited about the creative possibilities the new plug-in will deliver to our customers already working with Unreal Engine,” Sorokin says. “Users can now preview captured motion in an actual game scene inside the Unreal Engine editor and integrate the animation stream from iPi Mocap Studio into Unreal Engine for a more seamless and immersive experience.”

Sorokin noted that previously iPi Mocap users working in Unreal Engine would have to export animation from iPi Studio to FBX or BVH files, then import assets to Unreal. “The tighter integration into Unreal is a huge benefit that will provide iPi Mocap content creators increased flexibility to create game, virtual production and other projects quickly and with more accurate results without the need to create custom code.”

Beta Results Prove Positive:

New Discovery, a full-service digital agency based in Mexico and the US, took part in the iPi Soft beta-testing program of the closer integration of iPi Mocap and Unreal Engine for a VR documentary entitled, “Northern Route, Border Identity.” Funded by the Secretary of Cultural Affairs of the State of Chihuahua, Mexico, the project takes an empathetic look at the refugee experience that has slowly become part of the border region’s social-economic fabric.

“We were incredibly impressed with the fidelity of the iPi Mocap data,” Jonalex Herrera, CEO and co-founder of New Discovery, says. “Even with two Kinect Azure sensors, the results were amazing. Best of all, we were able to push animation streams directly into Unreal to realistically share details of the refugees’ journey in search of a better future.”

Link to the press-relese on PR Web>>

Pricing and Availability:

iPi Motion Capture Version 4 is available as a perpetual license or subscription-based model. Prices range from $165 to $1995 depending on the version of the software (Express, Basic, Pro) and duration of the subscription. Additional information on iPi Soft pricing is available here.

About iPi Soft:

Moscow-based developer, iPi Soft, LLC, develops powerful markerless motion capture software technology that uses sophisticated image processing and computer vision algorithms to recognize and track the human body. The company’s software is used by creative professionals and prosumers around the world to digitize the movement of a human skeleton, rendering it expressive in 3D characters for video games, computer-generated films, as well as for medical, military and other applications. For additional information, on iPi Soft, product pricing, configurations or a 30-day free trial please visit http://www.ipisoft.com.

#   #   #

All trademarks contained herein are the property of their respective owners.


iPiSoft’s CEO Interview to Startup.Info

Posted on: March 2nd, 2021

We are excited to share this interview with our new CEO Pavel Sorokin in the business entrepreneur news site Startup.Info.

In the Q&A Pavel discusses his vision for the company, how it’s weathering the Covid pandemic and how we continue to innovate and lead in the markerless motion capture space. Enjoy!



Pavel Sorokin Appointed To iPi Soft CEO

Posted on: February 8th, 2021

Pavel Sorokin Appointed To iPi Soft CEO

Company Co-Founder Michael Nikonov To Continue As Chief Technology Architect

Moscow, Russia – February 08, 2021 – iPi Soft, LLC, the leading developer of markerless motion capture software technology named  Pavel Sorokin, current Chief Operating Officer (COO), as  the company’s new Chief Executive Officer (CEO).

“I am excited to lead iPi Soft into our next stage of growth and deliver on our promise to bring the most accessible and reliable motion capture products to market that help our customers achieve their creative goals,” Sorokin says.

“We will continue to improve our existing product inventory and remain focused on innovating products compatible with real time applications and making use of rapid advances in AI tracking tech for exceptional user-experience.”

Since co-founding iPi Soft in 2008 with Michael Nikonov, Sorokin has held various roles including lead developer, finance and administration, business development/marketing, as well as spearheading major strategy and technical shifts across the company’s product lines.


As CMO, most notably, he introduced iPi Soft and its markerless motion capture solution, iPi Motion Capture, to US, European and Asian markets leading to its adoption into some of the world’s most prestigious VFX and creative studios and educational institutions. His efforts have also been instrumental in marketing the real time capabilities available in iPi Motion Capture and the software application’s integration into leading game engine platforms including Unity and Unreal. Additionally, Sorokin managed the marketing strategy for iPi Biomech, an add-on motion capture software tool that opened new channels for markerless tracking and visualization of motion capture data for medical, sports analysis and movement science applications.

Sorokin succeeds Nikonov, current iPi Soft Chief Executive Officer and Chief Technology Architect. Nikonov will continue as Chief Technology Architect to lead technology development efforts that strengthen iPi Soft’s focus on quality and innovation.

“Pavel brings hardcore engineering skills, global business perspective and marketing savvy to his new role,” Nikonov says. “I can think of no one better to lead iPi Soft at this exciting juncture in the motion capture technology industry.”

Prior to iPi Soft, Sorokin served as Founder and CEO of Irbicon, a Moscow-based IT service provider of business analytics solutions to customers form financial and telecom industries. Before that he held project managerial roles at Samsung Research Center in Moscow. Over the course of his career, Sorokin has also assumed various software engineering positions. He holds a degree in applied math from the Moscow Institute of Physics and Technology.

About iPi Soft

Moscow-based developer, iPi Soft, LLC, develops powerful markerless motion capture software technology that uses sophisticated image processing and computer vision algorithms to recognize and track the human body. The company’s software is used by creative professionals and prosumers around the world to digitize the movement of a human skeleton, rendering it expressive in 3D characters for video games, computer generated films, as well as for medical, military and other applications. For additional information, on iPi Soft, product pricing, configurations or a 30-day free trial please visit http://www.ipisoft.com.

Markerless Mocap Trends 2021

Posted on: December 24th, 2020

iPiSoft’s Founder/Chief Creative Architect, Michael Nikonov, shares his thoughts in PostMagazine’s annual “Outlook” issue on trends that 2021 may bring to markerless motion capture technology.

Read Full Interview>>

Get To Know iPi Mocap Artist…Raul Ruiz

Posted on: December 20th, 2020

Get To Know iPi Mocap Artist…Raul Ruiz

From time to time, we like to take a closer look at the artists that are using iPi Soft technology in interesting and innovative ways. This time we are shining a spotlight on  Raul Miguel Ruiz Esquer, a Mexico-based, self-professed creative jack-of-all-trades working as an audiovisual producer and 3D animation artist. Currently, his one-man studio is focused on the realization of 3D cinematics.

Raul came to our attention in September with his submission to our mocap contest. His elegant 3D dancer piece, “Big Bang Portal” was the winning entry due to its originality and the incredible detail he was able to portray using iPi Mocap along with Autodesk Maya and Epic Games’ Unreal Engine: https://vimeo.com/446939597

We spoke with Raul from his studio in Tijuana, Mexico

Q. How did you first hear about iPi Mocap and how did you use the software in your winning entry?

RR: first time I started using iPi Mocap was around 2012 when I was a student learning 3D and downloading all kinds of software and experimenting. The idea of an affordable way to make 3D motion capture was compelling since the mocap technology at that time was expensive and not accessible to the broader audiences.I started using iPi Mocap again this year for my winning piece “Big Bang Portal” as I noticed iPi Soft had made several improvements to the software. This video captured in the piece was created using iPi Recorder and iPi Mocap Studio. It is a work in progress for a short film I am currently producing.

Q. What benefits does the software bring to your content creation workflow?

RR: Since I was young, I have always wanted to create my own 3D animated movies. I have been studying the spectrum of 3D software applications with the goal of being able to create as a solo artist. When I first heard about iPi Mocap I knew it was a perfect match for me. As a one-man studio I need to make ongoing technical and budgetary decisions to support the artistic vision. The main advantage of iPi Mocap is being able to capture high quality animation instead of making it by hand and trying to recreate the illusion of life for my characters. It was very daunting at first because just to make one shot used to require a team, but with iPi Mocap the animation can be achieved accurately without sensors with one person or a small team of individuals. This is huge because it improves the productivity from a cost-effective perspective, but also allows an independent artist to direct a creative vision instead of wrangling a production. I can prototype fast and spend more time working on the creative, fun side of the project.

Q. What hardware are you using with iPi Mocap?

RR: My studio setup is nothing extraordinary, but it delivers results: Intel Core i7-3820 (4 core 3.6 ghz) with P9X79 LE  Motherboard and 16 gb ram; Nvidia 1080 GTX; 2 Kinect Xbox One; 2 SIIG JU-P20612-S1 – Adapter PCIe 2 port USB 3.0.

Q. Can you tell us how you have already used iPi Mocap and your plans for using the software with the Unreal Engine?

RR: My plan is to produce films and series. Right now I’m continuing to experiment creatively using the iPi Mocap pro license on a personal project that I’m hoping to release soon. My plan is to acquire two additional Kinects to make a four Kinect setup to capture additional recording of acrobatic action sequences and different dancing styles.

Looking to the future I would also like to try using the software with the Azure Kinect to raise the quality of my captures.

The use of the Unreal engine was a choice made with the solo team structure in mind. It is just so much simpler to direct, assemble and render sequences using the Unreal editor. As a director, having more control of the output using the real-time pipeline provides additional creative flexibility.

I have studied and prepared myself to be able to execute my creative vision.

I’m happy that iPi Soft granted me a license and thanks to the contest, I feel closer to achieving my artistic aspirations.

To see more of Raul’s work visit his Instagram and Facebook pages.


iPi Soft’s CEO Interview Published on Shoot Publicity Wire

Posted on: October 19th, 2020

Curious about markerless motion capture software in production? In a recent interview iPi Soft Founder and CTO, Michael Nikonov, spoke about the benefits of using its iPi Mocap during the ongoing Coronavirus pandemic.

Published on Shoot Publicity Wire: https://bit.ly/3lV8xCC

iPi Soft’s CEO Michael Nikonov interview in Spanish

Posted on: October 13th, 2020

Dessignare Media published iterview with our CEO Michael Nikonov in Spanish.

Link to the inverview: