FacePDFViewer— A PDF Viewer Controllable By Head Movements using Facial Landmark Detection

FacePDFViewer— A PDF Viewer Controllable By Head Movements using Facial Landmark Detection

In this post, we'll learn A real-time web tool using face-api.js to scroll through a PDF document in the browser using head movements.

A real-time web tool using face-api.js to scroll through a PDF document in the browser using head movements.

Face Landmark Detection has many useful applications in Computer Vision such as face swapping, blink detection, face alignment, emotions recognition and head pose estimation.

In this article, I will show you my project “FacePDFViewer”. I have built a simple tool that allows you to move through a PDF document on the screen without using the mouse, just the movements of the head.

You can find the source code with instructions to run it in my GitHub repository, and a live demo is available here on GitHub.io.

The software is written in _Javascript _using face-api.js for face landmark detection and pdfjsfor the PDF documents rendering.

Project structure

The software consists of 3 real-time operations:

  1. Face landmark detection
  2. Head pose estimation
  3. PDF rendering

The PDF rendering is made with the open source _pdfjs _library that uses an html _canvas _element as a container of the document. In this article, I will talk about the first two operations, while I refer to pdfjs examples for PDF rendering, since my usage of the library in this project is very basic.

face-api tensorflow computer-vision face-detection-app face-landmarks

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Top 10 API Security Threats Every API Team Should Know

Learn what are the most important API security threats engineering leaders should be aware of and steps you can take to prevent them

How long does it take to develop/build an app?

This article covers A-Z about the mobile and web app development process and answers your question on how long does it take to develop/build an app.

Best Electric Bikes and Scooters for Rental Business or Campus Facility

An ultimate guide to buying the best electric bikes/scooters for rental business or campus facility. It contains the list, prices, features, and specs.

How to start an electric scooter facility/fleet in a university campus/IT park

An ultimate guide on how to start an electric sooter/bike rental business or faility/fleet in a university campus/IT park and expert recommendations.

An API-First Approach For Designing Restful APIs | Hacker Noon

I’ve been working with Restful APIs for some time now and one thing that I love to do is to talk about APIs.