video camera

7 Articles

Tracking Drone Flight Path Via Video, Using Cameras We Can Get

November 13, 2020 by 4 Comments

Calculating three-dimensional position from two-dimensional projections are literal textbook examples in geometry, but those examples are the “assume a spherical cow” type of simplifications. Applicable only in an ideal world where the projections are made with mathematically perfect cameras at precisely known locations with infinite resolution. Making things work in the real world is a lot harder. But not only have [Jingtong Li, Jesse Murray et al.] worked through the math of tracking a drone’s 3D flight from 2D video, they’ve released their MultiViewUnsynch software on GitHub so we can all play with it.

Instead of laboratory grade optical instruments, the cameras used in these experiments are available at our local consumer electronics store. A table in their paper Reconstruction of 3D Flight Trajectories from Ad-Hoc Camera Networks (arXiv:2003.04784) listed several Huawei cell phone cameras, a few Sony digital cameras, and a GoPro 3. Video cameras don’t need to be placed in any particular arrangement, because positions are calculated from their video footage. Correlating overlapping footage from dissimilar cameras is a challenge all in itself, since these cameras record at varying framerates ranging from 25 to 59.94 frames per second. Furthermore, these cameras all have rolling shutters, which adds an extra variable as scanlines in a frame are taken at slightly different times. This is not an easy problem.

There is a lot of interest in tracking drone flights, especially those flying where they are not welcome. And not everyone have the budget for high-end equipment or the permission to emit electromagnetic signals. MultiViewUnsynch is not quite there yet, as it tracks a single target and video files were processed afterwards. The eventual goal is to evolve this capability to track multiple targets on live video, and hopefully help reduce frustrating public embarrassments.

[IROS 2020 Presentation video (duration 14:45) requires free registration, available until at least Nov. 25th 2020.]

A More Open Raspberry Pi Camera Stack With Libcamera

May 11, 2020 by 15 Comments

As open as the Raspberry Pi Foundation has been about their beloved products, they would be the first to admit there’s always more work to be done: Getting a Pi up and running still requires many closed proprietary components. But the foundation works to chip away at it bit by bit, and one of the latest steps is the release of a camera stack built on libcamera.

Most Linux applications interact with the camera via V4L2 or a similar API. These established interfaces were designed back when camera control was limited and consisted of a few simple hardware settings. Today we have far more sophisticated computational techniques for digital photography and video. Algorithms have outgrown dedicated hardware, transforming into software modules that take advantage of CPU and/or GPU processing. In practice, this trend meant bigger and bigger opaque monolithic pieces of proprietary code. Every one a mix of “secret sauce” algorithms commingling with common overhead code wastefully duplicated for each new blob.

We expect camera makers will continue to devise proprietary specialties as they seek a competitive advantage. Fortunately, some of them see benefit in an open-source framework to help break up those monoliths into more manageable pieces, letting them focus on just their own specialized parts. Leveraging something like libcamera for the remainder can reduce their software development workload, leading to faster time to market, lower support cost, and associated benefits to the bottom line that motivates adoption by corporations.

But like every new interface design borne of a grandiose vision, there’s a chicken-and-egg problem. Application developers won’t consume it if there’s no hardware, and hardware manufacturers won’t implement it if no applications use it. For the consumer side, libcamera has modules to interop with V4L2 and other popular interfaces. For the hardware side, it would be useful to have a company with wide reach who believes it is useful to open what they can and isolate the pieces they can’t. This is where the Raspberry Pi foundation found a fit.

The initial release doesn’t support their new High-Quality Camera Module though that is promised soon. In the short term, there is still a lot of work to be done, but we are excited about the long term possibilities. If libcamera can indeed lower the barrier to entry, it would encourage innovation and expanding the set of cameras beyond the officially supported list. We certainly have no shortage of offbeat camera sensor ideas around here, from a 1-kilopixel camera sensor to a decapped DRAM chip.

[via Hackster.io]

Air Knife Keeps GoPro Lens Clean In Messy Environments

January 27, 2019 by 21 Comments

Before the GoPro, shooting video of messy, fast-paced, or dangerous things was very different. There were commercial sports camera rigs and various industrial solutions, but the GoPro, with its waterproof housings and diminutive size, was the revolutionary, stick-it-anywhere camera. Despite this, the team at [tarkka] were having issues with the lens getting covered in coolant while shooting videos of their CNC machining projects. To solve this, they created an air knife to clean the lens.

The air knife consists of a wide, flat nozzle that is designed to blow fluid off of the lens. It’s a tidy 3D printed design, which wraps around the GoPro housing. Felt pads are used to give a snug fit, so the device simply slides into place and stays there. The device is fed from a hand-operated nozzle at present, though the team notes that this could be changed to a more permanent connection.

In testing, the device has performed well, even when under a constant barrage of coolant spray. This should make shooting CNC videos much easier for the team, who were formerly required to manually wipe the camera down several times during a shoot. The build was actually inspired by an earlier build by [Edge Precision], which used machined aluminum parts to create a similar tool.

The GoPro remains a popular camera wherever a small and rugged device is required. Consider mounting one to a toy car for a weekend’s worth of fun. Video after the break.

Continue reading “Air Knife Keeps GoPro Lens Clean In Messy Environments” →

Real-Time Polarimetric Imager From 1980s Tech

April 20, 2018 by 14 Comments

It’s easy to dismiss decades old electronics as effectively e-waste. With the rapid advancements and plummeting prices of modern technology, most old hardware is little more than a historical curiosity at this point. For example, why would anyone purchase something as esoteric as 1980-era video production equipment in 2018? A cheap burner phone could take better images, and if you’re looking to get video in your projects you’d be better off getting a webcam or a Raspberry Pi camera module.