M7VI Patents

M7 Visual Intelligence Patents

US Patents

12.08.09 M7VI is awarded our newest US Patent entitled "System and Method for Mosaicing Digital Ortho-Images"

1. “Vehicle Based Data Collecting and Processing System”

U.S. Pat. No. 7,127,348 (“the ‘348 Patent”)

The ‘348 Patent issued on October 24, 2006, and is generally directed toward M7VI’s system for terrain mapping. Major challenges facing remote sensing and imaging applications are spatial resolution and spectral fidelity. Photographic issues, such as spherical aberrations, astigmatism, field curvature, coma, distortion, and chromatic aberrations are well known problems that must be dealt with in any sensor/imaging application. Prior methods have often dealt with these issues by compromising either resolution or field of view. For example, if the system was designed to provide a high resolution image then the field of view of the imaging device was typically smaller. On the other hand, if the system provided a larger field of view then the resolution of the data would be decreased and the distortions increased. Accordingly, there is a need for a vehicle data collection and processing system that renders high quality images over a large field of view.

One embodiment of the invention is directed to a vehicle data collection and processing system. The system includes at least two imaging sensors with intersecting focal axes, and a number of positioning devices, which are secured to the vehicle. The vehicle is, preferably, an aircraft; however, it may also be an automobile, a satellite, a train, and the like.

The positioning devices include a global position transmitter, an elevation measurement unit, a global positing antenna, and an attitude measurement unit. A computer is used to monitor the positioning devices, and to correlate at least a portion of image data from the image sensors to a portion of the surface based on input the devices.

2. “System for Mosaicing Digital Ortho-Images Having At Least Three Imaging Sensors”

U.S. Pat. No. 6,928,194 (“the ‘194 Patent”)

The ‘194 Patent issued on August 9, 2005, and is generally directed toward M7VI’s method of improving mosacied images both during and after imaging. One conventional method of ortho-imaging involves rendering a composite image of a target by compiling varying sub-images of the target. Typically, in aerial imaging applications a digital imaging device records images of fixed subsections of a target area. Those images are then aligned according to some sequence to render a composite of the target area. Such renderings are generally time consuming and labor intensive. In addition, prior automated balancing systems proved to be susceptible to image anomalies, e.g., unusually bright or dark objects. There is a need for an ortho-image rendering system that provides efficient and versatile imaging for very large field of views while maintaining image quality and clarity.

In one embodiment of the invention is directed toward a method for maintaining desired image intensity. The method includes evaluating a target image and identifying green dominant pixels. Then, the average intensity of those green dominant pixels is determined, and evaluated against the desired image intensity. With such information, the exposure time of the imaging system can be adjusted to reduce the difference between the average and desired image intensity.

In another embodiment, the invention is directed toward a method of mosaicing two overlapping digital input images. The method includes providing a reference image and a secondary image that overlaps the reference image. The reference and secondary images are correlated to compute a balancing matrix. Then, the intensity of the pixels within the overlap area of the secondary image can be scaled to match the intensity of the pixels within the overlap area of the reference image.

In a further embodiment, the invention is directed toward a method of processing color input images to reduce bias. The method includes selecting green dominate pixels from a first and second input image, and computing each of their respective average intensity values. The average intensity values of the first and second input images are then compared, and the first or second input image is processed responsive to the results of the comparison.

3. “A Method of Using A Self-Locking Travel Pattern to Achieve In-Travel Calibration of Remote Sensors”

U.S. Pat. No. 7,212,938 (“the ‘938 Patent”)

The ‘938 Patent issued on May 1, 2007, and is generally directed toward a method of calibrating remote sensors using a self locking flight pattern. The conventional methods of calibrating remote sensors include using calibration targets during separate calibration flights. These targets, at times cloth panels, were placed at known locations within a target area. The remote sensors were flown above the calibration targets and imaged the target area. The test locations of the images were compared against the known locations of the calibration targets to determine the offset and calibrate the sensors. These methods have significant disadvantages including the costs associated with the calibration targets and the separate calibration flight. Accordingly, there is a need for remote sensor technology that provides an inexpensive calibration method, which avoids the need for calibration targets and a separate calibration flights.

In an embodiment, the inventive is directed to a method of mounting at least one remote sensor to a vehicle and moving the vehicle in a self locking pattern. The pattern includes at least three substantially parallel travel lines, wherein at least one travel line is in an opposing direction as compared to the other lines. The method further includes generating swath widths for each substantially parallel travel line, and collecting remote sensing data during movement. The remote sensing data is input into a computer to calculate calibration data. And, the calibration data is applied to the remote sensing data to remove bias in a displayable image output or in an electrical strength signal. In this manner, the calibration can be completed without ant calibrations targets or a separate calibration flight.

PATENT APPLICATIONS PENDING

1. “Retinal Array Compound Camera System” (RCA)

U.S. Pat. App. No. 10/229,626

As explained above, with respect to U.S. Pat. No. 7,127,348, there is a need for an ortho-image rendering system that provides efficient imaging for a large field of view and that maintains image quality and clarity. Some conventional digital imaging systems have attempted to address these issues with large scale single lens cameras. These cameras typically comprise a large primary optical lens, behind which a number of optical sensors are embedded. The characteristics of these configurations, especially the optical properties of the primary lens, tend to render images of very small cross sectional area. Generally, sensors in these systems have either identical or coinciding lines of sight. However, such systems have the problems of being quite costly and inefficient when a wide a field of view is desired. Rapid development of new sensor technologies renders these systems obsolete or requires cost upgrades to such systems.Other conventional systems have attempted to address the shortcomings of such primary lens configurations through the use of divergent sensor arrays. Usually, optical sensors are outwardly mounted along a convex brace or housing such that their focal axes diverge outwardly from the imaging device. Based on the intended scale factor for the images, the individual sensors in the array can be disposed such that their focal planes adjoin or slightly overlap at a desired distance from the target area. Although such a configuration can provide a wider field of view for imaging, it is still limited in application. The sensor arrays must be mounted within a host aircraft or spacecraft, and thus require a portal in the craft through which to obtain image data. Large sensor arrays require large portals to provide proper optical access for all the diverging sensors in the array. In many cases, however, large portal spaces are impractical, if not impossible, to provide within the small confines of a host craft. Furthermore, larger portals allow a relatively high degree of light backscatter in the array, causing ghost images and degrading the overall quality and reliability of the images obtained.

U.S. Pat. App. No. 10/229,626 was filed on August 28, 2002, and originally included thirty three claims generally directed to M7VI’s inventive camera system. The U.S. Patent Office reviewed the claims, and determined that they actually represent six patentably distinct inventions. M7VI elected to prosecute one group of claims, and reserved the right to file, during the pendancy of the parent application, the remaining five groups of claims as divisional patent applications. One of the divisional application, U.S. Pat. App. No. 11/805,109 was filed on May 22, 2007. Accordingly M7VI still has the option to file four more divisional applications.

In one embodiment, the pending claims of this patent application are generally directed toward at least two imaging sensors disposed within a housing that is mounted to a vehicle. The imaging sensors each have a unique lens, and a separate focal axis which independently passes through an aperture in the housing.

In another embodiment, the pending claims are generally directed to a focal axes interest within an intersection area.

2. “Retinal Array Compound Camera System Having At Least Three Imaging Sensors”

U.S. Pat. App. No. 11/805,109

U.S. Pat. App. No. 11/805,109 was filed on May 22, 2007, as a divisional application of U.S. Pat. App. No. 10/229,626. In one embodiment, the pending claims of this patent application are generally directed to a system for producing an image of a target having at least three imaging sensors, each coupled to a housing. The first sensor is centrally coupled to the housing and the other two sensors are offset therefrom. Each sensor has a focal axis that passes through an aperture of the housing, and at least the first and third focal axes intersect within an intersection area.

3. “System for Mosaicing Digital Ortho Images”

U.S. Pat. App. No. 11/128,656

As an improvement to the technology, U.S. Pat. App. No. 11/128,656 was filed on May 13, 2005, as a continuation of U.S. Pat. App. No. 10/247,441, which granted as U.S. Pat. No. 6,928,194. In one embodiment, the pending claims are directed to a system and method for mosaicing multiple input images, captured by one or more remote sensors, into a seamless mosaic of an area of interest.

4. “Vehicle Based Data Collection and Processing System and Imaging Sensor System and Methods Thereof” - CoCo™

U.S. Pat. App. No. 11/581,235

In working with its patented camera system, M7VI found that errors in imagery were greatly reduced if the sensors were rigidly mounted and registered to each other.

As an improvement to the technology, U.S. Pat. App. No. 11/581,235 (“the CoCo™ Application”) was filed on October 11, 2006. The CoCo™application was filed as a continuation in part of U.S. Pat. App. No. 10/664,737, which granted as U.S. Pat. No. 7,127,348. The pending claims are directed toward an incorporation of the co-mounted and co-registered nature into M7VI’s system for terrain mapping.

FOREIGN PATENTS GRANTED

1. “Retinal Array Compound Camera System”

Eurasian Pat. No. 007248

The Eurasian patent issued on August 26, 2006, and is generally directed to M7VI’s inventive camera system, as disclosed in U.S. Pat. App. No. 10/229,626.

FOREIGN PATENT APPLICATIONS

1. “Retinal Array Compound Camera System”

Canadian Pat. App. No. 2534978

Canadian Pat. App. No. 2534978 was filed on August 28, 2003, and is generally directed to M7VI’s inventive camera system, as disclosed in U.S. Pat. App. No. 10/229,626.

2. “Vehicle Based Data Collecting and Processing System”

Canadian Pat. App. No. 2534968

Canadian Pat. App. No. 2534968 was filed on September 3, 2003, and is generally directed to M7VI’s system for terrain mapping, as disclosed in U.S. Pat. No. 7,127,348.

*“Iris One™, Isis Earth™, CoCo™, ARCA™, Isis Sky™ and M7VI DigitalFilm™ are M7VI products based on M7VI’s U.S. Pat. No. 7,127,348 for ‘Vehicle Based Data Collecting and Processing System,’ U.S. Pat. No. 6,928,194 for ‘System for Mosaicing Digital Ortho-Images Having At Least Three Imaging Sensors,’ U.S. Pat. 7,212,938 for ‘A Method of Using A Self-Locking Travel Pattern to Achieve In-Travel Calibration of Remote Sensors,’ and other awarded or Pending Patents.