How AI Enables Intuitive Camera Control For Drone Cinematography

Drones are revolutionising how professionals and amateurs generate video content for films, live events, AR/VR etc. Aerial cameras offer dynamic viewpoints compared to traditional devices. However, despite significant advancements in autonomous flight technology, creating expressive camera behaviors pose a challenge and requires non-technical users to edit a large number of unintuitive control parameters

Register for the upcoming Free ML Workshops

Recently, researchers from Facebook AI, Carnegie Mellon University and the University of Sao Paulo have developed a data-driven framework to edit complex camera positioning parameters in semantic space.

In a research paper, ‘Batteries, camera, action! Learning a semantic control space for expressive robot cinematography,’ co-authors Jessica Hodgins, Mustafa Mukadam, Sebastian Scherer, Rogerio Bonatti and Arthur Bucker explained various frameworks implemented in the process.

Semantic space control framework

For this, the researchers generated a database of clips with a diverse range of shots in a photo-realistic simulator, and used hundreds of participants in a crowdsourcing framework to obtain scores/ranks for a set of ‘semantic descriptors’ for each clip using machine learning models. The term ‘semantic descriptor’ is commonly used in computer vision which refers to a word or phrase that describes a given object.

Once the video scores are ready, the clips are analysed for correlations between descriptors, and semantic control space is built based on cinematography guidelines and human perception studies. It is then translated through a ‘generative model’ that can map a set of desired semantic video descriptors into low-level camera trajectory parameters.

This is followed by system evaluation to generate final shots rated by participants as per the expected degree of expression for each descriptor.

#opinions #aerial drones cinematography #drone machine learning #drone technology

What is GEEK

Buddha Community

How AI Enables Intuitive Camera Control For Drone Cinematography

Drones are revolutionising how professionals and amateurs generate video content for films, live events, AR/VR etc. Aerial cameras offer dynamic viewpoints compared to traditional devices. However, despite significant advancements in autonomous flight technology, creating expressive camera behaviors pose a challenge and requires non-technical users to edit a large number of unintuitive control parameters

Register for the upcoming Free ML Workshops

Recently, researchers from Facebook AI, Carnegie Mellon University and the University of Sao Paulo have developed a data-driven framework to edit complex camera positioning parameters in semantic space.

In a research paper, ‘Batteries, camera, action! Learning a semantic control space for expressive robot cinematography,’ co-authors Jessica Hodgins, Mustafa Mukadam, Sebastian Scherer, Rogerio Bonatti and Arthur Bucker explained various frameworks implemented in the process.

Semantic space control framework

For this, the researchers generated a database of clips with a diverse range of shots in a photo-realistic simulator, and used hundreds of participants in a crowdsourcing framework to obtain scores/ranks for a set of ‘semantic descriptors’ for each clip using machine learning models. The term ‘semantic descriptor’ is commonly used in computer vision which refers to a word or phrase that describes a given object.

Once the video scores are ready, the clips are analysed for correlations between descriptors, and semantic control space is built based on cinematography guidelines and human perception studies. It is then translated through a ‘generative model’ that can map a set of desired semantic video descriptors into low-level camera trajectory parameters.

This is followed by system evaluation to generate final shots rated by participants as per the expected degree of expression for each descriptor.

#opinions #aerial drones cinematography #drone machine learning #drone technology

AI & ML Can Open Up Space For Drones To Demonstrate Full Potential

The demand for drones in the market has seen an incredible upsurge lately. As a matter of fact, the convenience of remote monitoring and its flexibility in harsh terrains has considerably increased the popularity of drone technology across segments like eCommerce, agriculture, warfare, to name a few, which was unthinkable a decade ago.

According to data, the current global market size of drone technology is about $14 billion and is expected to grow to $43 billion by the year 2024. The major chunk of this growth can be attributed to its significant usage in commercial deliveries. Currently, there are several drones start-up companies in India, which focus on the development, manufacturing, providing analytics platform for drone solutions. Some prominent names include Bangalore-based EDALL SYSTEMS and Skylark Drones and Delhi-based Atom Drones.

Having said that, while drones have seen a significant market boost, it comes with safety, security and privacy concerns, where it has been constantly scrutinised to be deployed for exploiting their security and privacy of individuals. Further, there were also cases where criminals, drug cartels and terrorists have used drones. To dig more in-depth on the drone technology and the involvement of artificial intelligence to enhance drone solutions, Analytics India Magazine spoke to Karthik Shankaran, the Chief Innovation Officer of Detroit Engineered Products (DEP).

To set the context — DEP is a product development house where customers focus strictly on drone development. While other companies work on the development and manufacturing of drones, DEP offers drone development as-a-service and solution offering, making it preferable for collaboration in solution development. With DEP, customers can get their product/solutions developed during any stage of drone development — from the conceptual phase to prototype and production. The company has the expertise and experience in the development of both rotor drones (Quadcopter) as well as fixed-wing drones.

Also Read: Leveraging Computer Vision In Drone Tech

---

#people #agricultural drones #ai drones #drones #drones in india #ai

Making Sales More Efficient: Lead Qualification Using AI

If you were to ask any organization today, you would learn that they are all becoming reliant on Artificial Intelligence Solutions and using AI to digitally transform in order to bring their organizations into the new age. AI is no longer a new concept, instead, with the technological advancements that are being made in the realm of AI, it has become a much-needed business facet.

AI has become easier to use and implement than ever before, and every business is applying AI solutions to their processes. Organizations have begun to base their digital transformation strategies around AI and the way in which they conduct their business. One of these business processes that AI has helped transform is lead qualifications.

#ai-solutions-development #artificial-intelligence #future-of-artificial-intellige #ai #ai-applications #ai-trends #future-of-ai #ai-revolution

How AI Enables Intuitive Camera Control For Drone Cinematography

Drones are revolutionising how professionals and amateurs generate video content for films, live events, AR/VR etc. Aerial cameras offer dynamic viewpoints compared to traditional devices. However, despite significant advancements in autonomous flight technology, creating expressive camera behaviors pose a challenge and requires non-technical users to edit a large number of unintuitive control parameters

Read more: https://analyticsindiamag.com/how-ai-enables-intuitive-camera-control-for-drone-cinematography/

#ai

This Week in AI | Rubik's Code

Every week we bring to you the best AI research papers, articles and videos that we have found interesting, cool or simply weird that week.

#ai #this week in ai #ai application #ai news #artificaial inteligance #artificial intelligence #artificial neural networks #deep learning #machine learning #this week in ai