Update: new patent illustrates a wireless video conferencing iPod

Posted by Dennis Sellers Jun 13, 2006 at 10:16am

A unique patent has surfaced in the past few weeks that both illustrates and details Apple’s iPod in terminology such as “an enhanced iPod” and/or “an improved iPod.” A large portion of this patent places emphasis on “live” video streaming – and more specifically, video conferencing conducted on the “improved iPod.” In fact, the patent presents details of a new codec for QuickTime.

The reason for delaying this report rested on two things. Firstly, is the fact that the patent doesn’t appear to, at least on paper, stem from Apple. And yet the specificity of the improved iPod(s), clearly demonstrate that there is a direct connection to Apple in some capacity.

Secondly, I was initially concerned by the patent author’s many references to “iPod-like device” and/or ‘iPod type device.” And yet there are several specific mentions in the patent’s claims and elsewhere that undeniably clarify the matter. For example, patent claim 19 states that “The system of claim 2, wherein the handheld video device is an improved iPod,” and in claim 13 it states “wherein the handheld video device is an Apple iPod.”

So, with that said, the following patent report covers such matters as the new improved iPod acting as a video server within a wireless network, new optional iPod hardware modules, a new video-zoom feature in context with video conferencing and lastly, the improved iPod’s ability to send and/or receive streaming and/or “live” video.

Patent abstract

Methods, medium, and handheld, wireless devices which compress, enhance, encode, transmit, decompress and display digital video images in real time. Real time wireless videoconferences connect multiple handheld video devices. Real time compression is achieved by sub-sampling each frame of a video signal, filtering the pixel values, and encoding. Real time transmission is achieved due to high levels of effective compression. Real time decompression is achieved by decoding and decompressing the encoded data to display high quality images. A receiver can alter various setting including but not limited to the format for the compression, image size, frame rate, brightness and contrast. A zoom control can be used select a portion of interest of video being transmitted or being played back.

Wired & wireless video conferencing

Point-to-point transmission: Patent Figure 19A—illustrates a videoconference between the man at the second node 1920b and the woman at the first node 1920a. In the first mode of operation, the respective videos are transmitted over a point-to-point transmission 1940 path between the two nodes over the network 1910.

In another mode of operation each of the videos is transmitted to the reflector where both videos are displayed as first reflected video 1901b and second reflected video 1902b. The second video 1902a originates at the first node 1920a is transmitted to the reflector over first indirect path 1942. The second video 1901a originates at the second node 1920b is transmitted to the reflector over second indirect path 1944. The reflector then retransmits the two videos to the respective display nodes, 1920a and 1920b, over the indirect paths. In other configurations, the reflector would also transmit the combined video to other nodes participating in the videoconference.

In a wireless network: Patent FIG. 19B: shows an example of three nodes, third node 1920c, fourth node 1920d, and fifth node 1920e in a wireless network. The wireless connections are shown as waves. The three nodes operate in the same manner as the three nodes in FIG. 19A.

Patent FIG. 19C: shows an example of a combined network 1910c where five nodes are connect in a network comprised of both a wired network 1910a and a wireless network 1910b. Any of the five nodes could transmit video to any of the other nodes in the combined network. Any node, for example third node 1920c as shown, could act as a reflector 1930.

The iPod as a video server: In another embodiment of the present invention, any node could act as a video server and transmit pre-recorded video to one or more other nodes.

These illustrations are exemplary. In practice, combined networks could consist of any number of nodes. Any of the nodes in the network could be a handheld video device.

A first handheld embodiment

A first handheld device 2010 comprises a display, manual controls, a wireless port, and a first wired connection 2051a. While either the wireless port 2016 or the wired connection 2051a could be present, only one of the two would be necessary to receive video from or transmit video to other nodes in the network 1910.

In this example, the first handheld device is shown as an iPod-type device with an internal hard disk drive. The first handheld device 2010 further comprises a headphone 2020, connected via a speaker/microphone cable 2024, and a camera 2030, connected via a camera cable 2034. The headphone 2020 comprises a right speaker 2021, a microphone 2022, and a left speaker 2023.

In the best mode for this embodiment, the iPod-type device is implemented using a standard Apple iPod (enhanced with an audio input for the microphone and, optionally, with a wireless port, and appropriate software), and the camera 2030 is implemented using an iBot Firewire camera manufactured by Orange Micro, a lower performing Connectix USB camera, or similar camera. Alternatively, if the iPod-type device were only used of viewing video, the Apple iPod could be used without hardware modification. In another variation, the microphone could be build into the camera (not shown) instead of the headphones.

A second handheld embodiment

A second handheld device 2040 [illustrated above as 20B] comprises a second display 2012b, a second wireless port 2016b, and a second wired connection 2051b. While either the wireless port 2016b or the wired connection 2051b could be present, only one of the two would be necessary to receive video from or transmit video to other nodes in the network 1910. In this example, the second handheld device is shown as a device with a touch screen. The second handheld device 2040 further comprises a right built-in speaker 2021b, a built-in microphone 2022b, a left built-in speaker 2023b, and a built-in camera 2030b with lens 2032.

The configuration of the second handheld device 2040 has the advantage of eliminating the cables for the external headphone and camera of the first handheld device 2010 by having all elements built-in.

These two devices are exemplary. A two-device handheld videoconferencing network could have two identical handheld devices, such as the first handheld device 2010. Further, a single device with a camera (as shown) could transmit video for display on any number of hand held devices that do not have cameras or microphones.

Additional information concerning the embodiment of the second handheld device is presented in FIG. 21C displaying a zoom control. A user controls aspects and changes parameters of the image displayed within the video display window 2110 using the controls 2014 to enter input commands within the zoom control 2100 by selecting appropriate parts of the controls 2104 (or regions of the zoom control 2100 on a touch screen or with a pointing device).

Advanced zoom functions

A graphical user interface (GUI) graphically corresponds to a video display window 2110 through which a single image or a stream of video frames is displayed. The GUI and the video display window 2110 are displayed on a display 2012 (or 2012b or 2012d). The GUI includes a zoom control 2100 having an inner region 2102 positioned within an outer region 2106. The zoom control 2100 is a graphical way for the user of a remote receiver 1610 (see FIGS. 16A and 16B) to send remote control commands to set the parameters of a video transmitter (1600 or 1690) for control the area of the video to be compressed and transmitted.

An iPod: Patent FIG. 21A shows an embodiment of the iPod-type handheld device (2010) of FIG. 20C displaying a zoom control (2100) having an inner region (2102a) positioned within an outer region (2106a).

The zoomed video image is shown in video display window 2110a. In this embodiment the zoom control 2100 is displayed on top of the video display window 2110a. The size and position of the inner region 2102a relative to the outer region 1206a shows the user which portion of the original video is being received and magnified. Only the selected portion of the original video (in this example, the hair and top of the face) needs to be transmitted in full resolution or high quality.

A low resolution or thumbnail version of the original video frame is optionally displayed in the outer region 2106a. The thumbnail can be updated at a rate slower than the frame rate of the magnified video, such as once or twice a second. The magnification factor 2104a shows the text 2.times showing that the portion being displayed in the video display window 2110a is being displayed at twice the size.

A cell phone: Patent FIG. 21B shows an embodiment of the cellular integrated device 2070 of FIG. 20D displaying a zoom control 2100 having an second inner region 2102b positioned within an second outer region 2106b. The zoomed video image is shown in alternate video display window 2110b. In this embodiment, the zoom control 2100 is displayed outside and below the alternate video display window 2110b. The size and position of the second inner region 2102b relative to the second outer region 1206b shows the user which portion of the original video is being received and magnified. Only the selected portion of the original video (in this example, the lower face and tie) needs to be transmitted in full resolution or high quality. A low resolution or thumbnail version of the original video frame is optionally displayed in the second outer region 2106b. The second magnification factor 2104b shows the text 2.times showing that the portion being displayed in the alternate video display window 2110b is being displayed at twice the size.

Neo’s Notes: The fact that the iPod/cell phone combo-illustration (as noted above, and as presented in the patent) demonstrates the identical zoom controls on both devices would strongly suggest that Apple may have a cell phone or “cellular integrated device” on tap. In fact, the patent’s understanding of where the zoom feature would actually differ in position on the cell phone is even more revealing. On the other hand, Apple could simply be thinking of providing this technology in the form of a separate retail application, licensing it to cell phone OEM’s or simply providing it as a free download to cell phone users that have a WebCore based browser, like Nokia’s S60.

Optional AV and wireless iPod modules

Patent FIG. 20C illustrates an integrated handheld device 2060 comprising an iPod type device 2010, an A/V module 2062 and an optional wireless module 2064. The iPod type device 2010 comprises display 2012, controls 2014, and a wired connection 2051. The A/V module 2062 comprises a right integrated speaker 2021c, an integrated microphone 2022c, a left integrated speaker 2023c, and an integrated camera 2030c with lens 2032. The A/V module 2062 could be manufactured and marketed separately (as shown) as an add-on module for standard iPods, or could be incorporated into the iPod packaging as an enhanced iPod-type device.

The wireless module 2064 comprises an integrated wireless port 2016c. The wireless module 2064 also could be manufactured and marketed separately (as shown) as an add-on module for standard iPods, or could be incorporated into the iPod packaging as an enhanced iPod-type device.

The configuration of the integrated handheld device 2060 has the advantage of eliminating the cables for the external headphone and camera of the first handheld device 2010 by having all elements integrated into removably attached modules that form a single unit when attached. The user can configure the standard iPod based on the user’s intended use. If only a wireless connection is needed, only the wireless module 2064 can be attached to the iPod; in this configuration video can be received and displayed but not transmitted. If only video transmission is necessary and a wired connection is convenient, the wireless module 2064 can be omitted. Either configuration provides a single integrated unit that can be carried in the user’s pocket and can store and display videos.

The controls 2014 [see Fig. 20C – Click Wheel area above] can be a touch screen, touch pad, iPod-like scroll pad, remote control or other device, depending on the configuration of the handheld device.

Neo’s Notes: As far as the inventor’s iPod module concept goes, it’s totally in-line with Apple’s patent 20040224638 (see report) which discusses various module options including television, a built-in camera, push-to-talk and so forth in further detail. The modules in Apple’s patent also demonstrated that they could operate as independent devices, yet could still be controlled by a central iPod (as Apple’s Skier- scenario illustrated). The central iPod acted as a video or audio server – just as this current patent has noted.

A new QuickTime codec

The patent states that QuickTime is a component architecture for digital video compression and decompression. “Any number of methods can be encoded into a QuickTime compressor/decompressor (codec). Some popular codec are CinePak, Sorensen, and H.263. CinePak and Sorensen both require extensive computer processing to prepare a digital video sequence for playback in real time; neither can be used for live compression. H.263 compresses in real time but does so by sacrificing image quality resulting in severe blocking and smearing.” The patent then goes into great detail of how live compression is going to be achieved.

In the patent’s conclusion, this point is once again stressed: “the compression and decompression steps of the present invention provides a means of digitally compressing a video signal in real time, communicating the encoded data stream over a transmission channel, and decoding each frame and displaying the decompressed video frames in real time.

Furthermore, the present invention has additional advantages in that: 1) it enables live video transmission and display on pocket-sized handheld devices; 2) it enables wireless videoconferencing with portable, handheld video devices; 3) it provides an iPod-type device which is able to display high quality color video; 4) it provides an iPod-type device which is able to be used as a wireless video transmitter or receiver.”

Notice

Macsimum News presents only a brief summary of patents with associated graphic(s) for journalistic news purposes as each such patent application and/or grant is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent applications and/or grants should be read in its entirety for further details.

Neo’s Final Notes

After scouring through this patent several times prior to writing this report, I’ve deduced that the patent author’s cautionary terminology of iPod-like was justified. The iPod did in fact begin as an MP3 player and over time has evolved to include other features such as video, photos and so forth. However, as the “iPod” shifts to include communications services, the question becomes: will Apple still retain the iPod branding on communication devices – or not? The patent’s cautionary approach to terminology keeps that door open, while not committing to it. What branding Apple may choose is purely a marketing decision.

As for the markets that will benefit from this invention, the patent’s author notes that “it will enable enhanced personal communication between friends, family, and co-workers in ways never before possible; it will enable the transmission of video-based entertainment and education in ways never before possible; these handheld wireless video transmitters will be able to provide news coverage of wars, natural disasters, terrorist attacks, traffic and criminal activities in a way that has never before been possible.” And lastly, the patent zeroes-in on Healthcare as follows:

“The present invention would enable a physician or medical specialist to receive medical quality video any time in any location. For example, a critical emergency room ultrasound study could be monitored while it is being performed by less skilled emergency room personnel ensuring that the best medical image is acquired. A rapid diagnosis can be made and the results of a study can be verbally dictated for immediate transcription and use within the hospital. Further, the present invention could be used to transmit medical quality video from a remote, rural location, including a battleground. It could also be used to transmit guidance and advice from an expert physician into a remote, rural location. Thus, the present invention can improve medical care, reduce the turnaround for analysis of medical studies, reduce the turnaround for surgery, and provide medical professionals with continuous access to medical quality imaging.”

As far as television goes, the patent briefly mentions television strictly in relation to delivering full rate/full motion frame rates of 30 frames per second in context with handheld devices.

At the end of the day, the author of this patent appears to have a deep understanding as to the direction of the improved iPod(s) in intimate details that only someone involved in the Apple project would have access to. There was, in my opinion, a very fine line between the improved iPod, a cellular integrated device and a cell phone. Yet the cell phone alone is never once couched in terms of being iPod-like, period. The evidence to date still doesn’t support a pure stand-alone cell phone from Apple. Even though this patent’s combination illustration does in fact dance on that line, it never quite crosses it Then again, perhaps on that point; you see it a little differently.

If Apple does enter the communications device market this year, I certainly appreciate the author’s viewpoint that it will deliver devices and services “in ways never before possible.” Yes, within the context of Apple’s own “Next Wave of the Internet” roadmap, delivering services and devices “in ways never before possible’ – will simply be the norm!

If you have a comment or idea you’d like to share relating to this patent report, email me at neo@macsimumnews.com or macsimum@shaw.ca

The Patent number is 20060114987. The inventor’s name is Kendyl Roman. He has two other patents to his credit that were published in 1998 (RHN) and 2000. If it’s the same Kendyl Roman, he’s also the author of a 1987 book titled MacBaby Math.

PAID AD: Just like if you were buying video systems for your business you may want to read up on wireless barcode scanners before you buy one.

  Advanced Search

Article Information

Comment on this Article Print this Article Email this Article Digg This

Contributor

Recent Articles

Hotel München