Wednesday, November 22, 2006

More on Ripping DVDs

In Ripping DVDs with HandBrake (Part 2) I said MacTheRipper was next on my list of experiments with ripping DVDs. MacTheRipper is software that imports files from a DVD into a folder on a Mac's hard drive.

A DVD is nothing more than a bunch of computer files and folders. If it weren't for copy protection, you could just copy them to your hard drive and play them from there, using Apple's DVD Player application. In fact, I'm told that simple method actually works with some DVDs.

MacTheRipper, on the other hand, copies all DVDs, without copying the copy protection. It also defeats the regional coding which keeps you from playing DVDs from foreign lands.

MODmini's "Saving DVDs as VIDEO_TS Files" page (part of its "How-To: Turn Your Mac mini into a DVD Jukebox" article) advises to use Matinee along with MacTheRipper. Matinee front-ends your folder(s) of ripped DVDs and makes playing any of the movies in Apple's DVD Player a one-click affair. Matinee simply fires up MacTheRipper when you tell it you want to rip a new DVD.

I downloaded both of these items of free software. Once I dealt with some minor perplexities, both worked straightforwardly. So far I've ripped both discs of Lord of the Rings: Fellowship of the Ring Extended Edition and also Meet the Parents Bonus Edition. All the ripped versions seem to play in DVD Player just as if they were on the original disc. You get the whole DVD menu system intact, allowing you to choose language/subtitle options, special features, etc., as well as the main film.

The next thing to try would seem to be burning the ripped files to a do-it-yourself DVD-R and seeing if that disc works in various standalone and computer DVD players. But I ran into a snag there: the files won't all fit on a 4.7GB single-layer DVD-R! Since the original DVDs are dual-layer, it would seem that I need to use dual-layer DVD-Rs. I don't at this point even know if they exist though, or whether my MacBook Pro's internal SuperDrive could burn them.


Until I find my way down that path, more now on using HandBrake to rip and compress a DVD all in one fell swoop.

I am continuing to experiment with Handbrake's various options for choosing:

  • codecs
  • encoders within codecs
  • target file sizes, average bitrates, or "constant quality" percentages

The object of the game is to make HandBrake's output file as small as possible, consistent with "good enough" picture quality (PQ). HandBrake decodes the video on a DVD and re-encodes it in a different codec. The codec used on a DVD is always a form of MPEG-2. That used by HandBrake's output files is a form of the newer, better MPEG-4.

The main idea here is that MPEG-2 compression is inefficient and results in big files with high bitrates. MPEG-4 compression can produce nearly as good PQ with smaller output files and lower bitrates. The AVC/H.264 codec (which is one of HandBrake's two choices, in addition to MPEG-4) is actually a high-class version of MPEG-4; it supposedly does even better.


Within either of these codecs in HandBrake you can choose a target file size or an average bitrate, resulting in a constant bit rate (CBR) in the output encoding. If you want a variable bit rate (VBR) so that more bits will be allocated to scenes that are harder to encode and fewer bits will be wasted on easy-to-encode scenes, choose a "constant quality" percentage — instead of a target size or bitrate, that is.

I've been trying 50% "constant quality" (CQ50) AVC encoding with pretty good results: tolerable picture quality, fairly compact (but widely variable, depending on the movie) file sizes.

I've also been trying using a bitrate of 1000 kbps with 1-pass MPEG-4 encoding. Comparing the results in QuickTime for Lord of the Rings: Fellowship of the Ring Extended Edition Part 2, I believe a CBR MPEG-4 encoding at about 990MB for the output file looks better (!) than a VBR AVC encoding that produces a 1.15GB file. At least in some scenes — those in which there is a somewhat uniform medium-to-dark gray backdrop, mainly — there is less of a tendency for solid blocks of a single color (visible "macroblocks") to show up and flicker on and off, thereby harming the naturalness of the scene.

There are many variables here. Using a bitrate of 1000 kbps with 1-pass MPEG-4 encoding, I have tried both the XviD encoder and the FFmpeg encoder in HandBrake. The results are very, very close both in PQ and file size ... but I think the XviD encoder does just a smidgen better with at least one critical scene.


One of the things that has gotten in my way in making these evaluations is that iTunes' Full Screen mode for viewing movies seems to exacerbate the inherent macroblocking in the recordings. A movie viewed in Fit to Screen mode may look pretty good in iTunes, but switch to Full Screen mode and the overall brightness scale is boosted in a way that brings out the macroblocks. This anomaly does not happen in the equivalent modes in QuickTime Player.

A good way to evaluate the various HandBrake encoding options is to view their respective outputs side-by-side in QuickTime Player Fit-to-Screen windows. When you come to a problematic scene in one window, pause it and cue up the same scene in the other window(s). Then compare.

More later.

Tuesday, November 21, 2006

Ripping DVDs with HandBrake (Part 2)

Here's the second installment in my Ripping DVDs series. The first was Ripping DVDs with HandBrake (Part 1). HandBrake is free software your Mac can use to rip DVDs into computer files for later play without the original DVD.

At the MODmini website I found this helpful how-to on HandBrake and like topics, in addition to the three tutorials cited in the earlier post. (The HandBrake stuff is on the "Converting DVDs for QuickTime Playback" page of the four-page article.)

The MODmini turorial talks about doing just what I want to do: turn the Mac mini I intend to purchase into a discless "DVD jukebox." The same site also offers "DVD Kiosk How-To," discussing the ins and outs of using the Mac mini as a simple DVD player, complete with a functional remote control, to play optical discs directly.


I am still fooling around with HandBrake in an effort to figure out just how I want to use it. One option would be to rip each DVD movie into as small a computer file as will yield tolerable picture quality (PQ) on playback. The enemy of picture quality is digital video compression. Too much compression causes picture artifacts: digital "noise," pixellation, macroblocking, etc. But as you reduce the degree of compression to minimize artifacts, the file size explodes.

Going for small file sizes results in PQ compromises. I experimented yesterday with the idea of using a target size that will fit on a writeable CD, and I found the strategy to be somewhat viable but problematic. My idea was that squeezing files down to CD size will allow me to store a lot more movies on my hard drive and will let me optionally archive them to CD.

A recordable CD (a CD-R or CD-RW) holds 650 or 700 megabytes, depending on the CD. When I set HandBrake to use a target size of 700 MB, it actually produced a file a bit larger than that — too large for my purposes. Re-ripping with a 650-MB target size gave me a file comfortably under 700 MB. However, the 700-MB CD-RWs I first tried to use to test burning my HandBrake files seemed to cause unrecoverable problems or have fatal defects in them, so I re-ripped yet again with a 600-MB target size, for a file under 650 MB that would fit onto a 650-MB CD-R.

I had in earlier experiments determined that, for any given target file size, HandBrake's AVC/H.264 video "codec" ("coder-decoder") gives better PQ results that its alternative, the MPEG-4 codec — at the expense of longer ripping times.

I don't really understand that lingo, but I believe the "AVC/H.264" codec implements Part 10 of the MPEG-4 standard for video encoding and compression. The "MPEG-4" codec implements Part 2 of the same standard. Any AVC/H.264 or Part 10 codec is supposedly "capable of providing good video quality at bit rates that are substantially lower (e.g., half or less) than what previous standards [including MPEG-4 Part 2] would need." So Part 10 is better than Part 2 at any give bitrate — though slower. From now on I'll refer to these two codecs in HandBrake as simply MPEG-4 (for Part 2) and AVC (for Part 10).

So my under-650-MB experimental file used AVC, not MPEG-4. The actual AVC "encoder" choice that I selected in HandBrake was "x264 (Main profile)," not "x264 (Base profile)." The ability to select among different encoders within a given codec is not one I fully understand the ramifications of yet. In earlier experiments I have found the Base Profile AVC encoder generates slightly larger files than the Main Profile encoder.

That ripped-DVD-file-copied-to-CD proved to work fine on my MacBook Pro, the fast new Intel-based computer on which I made it. But when I tried it in iTunes on my older, slower iMac, playback stuttered. Yet playback in QuickTime on the same iMac went fine. iTunes likewise stuttered when I copied the AVC file from the CD to its hard drive and played the copy. It also stuttered when, via my AirPort Extreme network, I played the original file that was on the MacBook's hard drive into iTunes on the iMac.

My conclusion: my iMac's 1-GHz PowerPC CPU just isn't fast enough to cope with AVC video in iTunes, though it unaccountably does fine with the same AVC video in QuickTime. The actual source of the AVC video file — the iMac's own hard drive, a CD, the network — doesn't matter.

On the other hand, the iTunes/iMac combintion does just fine with MPEG-4 video rips. Still and all, for now I'm sticking with the higher quality of AVC and expecting to play the results either on a fast Mac or in QuickTime on my slower Mac.


Even though the PQ is better with AVC than MPEG-4, for any given target file size, HandBrake offers you ways of improving it even more. One is to abandon the target file size in favor of a target average bitrate in kilobits per second. The two are joined at the hip. If you input a target size, the bitrate (though grayed in the HandBrake panel) changes accordingly, and vice versa. Both methods use a constant bitrate; they provide two different ways to determine what that bitrate will be. You can set the bitrate you want directly. Or you can set the file size and let HandBrake figure out what bitrate goes with it.

But as the "Converting DVDs for QuickTime Playback" page of the MODmini DVD Jukebox article says, a constant bitrate (CBR) limits the quality of scenes that need higher bitrates. With a variable bitrate (VBR), "the movie takes more space where more things are happening, and less space when not much is going on."

You are telling HandBrake to use VBR when you choose "constant quality" video instead of a target file size or bitrate. When you do that, you get to adjust a slider to set the quality you want. It's graduated in percentages, where 100% gives you the best possible PQ, using the most hard drive space. The default setting is 50%. MODmini says each additional 10% above that roughly doubles the file size.

Right at this minute, I'm experimenting with constant-quality AVC and MPEG-4 rips. My attempts to encode full-length movies at CQ100 (i.e., a constant quality of 100%) have thus far caused mysterious HandBrake failures toward the end of the ripping process, generating huge unopenable files. Possibly the file sizes became too big for Mac OS X to deal with.

When I switched to experimenting with ripping just a single chapter of a DVD, CQ100 worked fine, at least with MPEG-4 video. The result looks pretty good, too ... but so does CQ90 or even CQ80 with AVC video. I'm currently experimenting with CQ80 AVC. Specifically, I'm ripping Lord of the Rings: Fellowship of the Rings, Pt. 1, from the Special Extended DVD Edition of that already-classic film. It's the first 1 hour, 45 minutes, 30 seconds of the movie on the disc.


Well, that didn't work! HandBrake went through its connipitions and combobulations for an hour or two, got to where its progress bar reached 100%, and vanished without a trace, leaving me with another unusable output file, this one of some 5.5 GB. Again, I think these may be file sizes too large for Mac OS to handle. Or maybe HandBrake can't handle them when it tries to finish up — during the delay after the progress bar reaches 100% before HandBrake is done with the rip.

It occurs to me, though: do I really care whether HandBrake can produce files that aren't much smaller than the content of the original DVD? The dual-layer Fellowship DVD contains 6.9 GB of material. That includes several soundtracks, several separate video and audio files for the individual chapters of the movie, multiple menus, multiple subtitles, a lot of control information for the DVD player to figure out how to use the disc, etc. When I rip it in HandBrake, I filter out a lot of that information.

For example, when I choose a subtitle or captioning option — since I'm hard of hearing — the captions get "burned into" the movie. In playing the ripped copy, I can't turn them off. As such, they don't represent "extra" information, as they do on the DVD.

Likewise, all information about chapter stops is lost in the ripped copy of the DVD.

So a rip that exceeds 5 GB while giving me lower picture quality and less playback flexibility isn't all that wonderful. If I want to give up 5 GB of hard drive space, I might as well give up 6.9 GB and have all the picture quality and flexibility of a DVD.

One simple way to do that that sometimes works (see the MODmini "Introduction" page) is to open the DVD in Finder as if it were an ordinary hard drive or folder and drag its VIDEO_TS and AUDIO_TS folders to the Desktop, or to one of your own folders. Copies of the original DVD's folders will be made on your hard drive; it takes several minutes. Then, fire up DVD Player and, per MODmini, "select Open VIDEO_TS Folder in DVD Player's File menu. Navigate to the copied VIDEO_TS folder and your movie will play just as if from the DVD. Easy, free, and no additional software is needed."

Alas, with some DVDs it may be that simple, but "the Finder-copy method may not work on all DVDs, or on all computers. We’ve successfully tested many, many DVDs, but we’ve also seen Finder fail to copy some and DVD Player refuse to play others." With Fellowship, I can copy the necessary folders, but DVD Player won't play them, due to copy protection.

That's where MODmini's "Saving DVDs as VIDEO_TS Files" page comes in. It's method, more general if more complex, relies on Matinee and MacTheRipper software.

"MacTheRipper streamlines the process of saving your DVDs to your hard drive. Not only does it slice and dice exactly which of the DVD’s contents should be saved, but it can also reset region encoding, remove Macrovision copy-protection, and perform a number of other advanced tasks."

Then it's Matinee's turn. "Matinee provides a convenient, TV-suitable interface for selecting the movies on your hard drive, and watching them via DVD Player. It comfortably fills the gap between the Finder and DVD Player, and is easily controlled with a remote."

I've downloaded MacTheRipper (great name!) but haven't played with it yet. That's next on my agenda. Stay tuned!

Sunday, November 19, 2006

Ripping DVDs with HandBrake (Part 1)

HandBrake is free software you can use on your Mac to "rip" DVDs into computer files for viewing as:

  • Front Row movies
  • QuickTime movies
  • iTunes movies
  • iPod movies (video iPod required)

If you hook your Mac to an HDTV, the ripped DVD files can be viewed on its large screen. With networked Macs the ripped files can be viewed on a different Mac than the one where the files reside.

HandBrake is not hard to download and launch. It's user interface is fairly simple, basically a single panel containing a variety of options (click image to enlarge).


But figuring out which way to use those options to rip your DVDs with HandBrake isn't easy.

I've been making some experiments with HandBrake, about which I'll report soon, and I've found some helpful tutorials to help me through my perplexity. One of these is at iLounge.com. Another is from MethodShop.com. A third is from FreeSMUG.org. Check 'em out.

More later.

Saturday, November 18, 2006

The Convergence Scene

In Media Center Mac Mini for My Bedroom? (Part 1) and Media Center Mac Mini for My Bedroom? (Part 2) I spoke of equipping a Sharp AQUOS LC-37D90U 37" flat-panel LCD HDTV I intend to buy with a "media center PC": a Mac mini, suitably enhanced to capture and archive programs from cable TV. In my Apple's Forthcoming iTV post I discussed iTV, the pre-announced $299 product from Apple which can route media files from computers and their networks over into a TV and its associated audio gear. With iTV and a wireless or wired home computer network, you'd be able to point an ultra-simple remote control at an equally simple box next to your TV and summon up movies, music, photos, and any other sort of digital media files that your computer houses or can access.

All this is part of the "convergence" of home computers and home theaters. Convergence is the natural by-product of the fact that everything is now digital. Movies and other video items are digital on DVD, HD DVD, and Blu-ray; on over-the-air (OTA) digital broadcast TV; on digital cable; on satellite TV; on the Internet, if not always legally; at the Apple iTunes Store; on iPods, BlackBerrys, and cell phones, etc., etc., etc. Ditto, TV shows, podcasts, movie trailers, YouTube uploads, and so on — they're all available digitally. Photo albums and home movies, too, are computerized and alive in the digital domain.

For audio-only media it's the same deal. CDs are digital. So are the MP3 files you rip from CDs in iTunes or in like computer applications. So are the songs you download from the iTunes Store, or wherever.

As for home-theater gear: most of the TVs you can buy today are either flat panels or "microdisplay" front/rear projectors. Both create their images digitally. And audio/video receivers in home-theater sound systems can take in, manipulate, and optionally output audio streams that are wholly in the digital domain.


In fact, you can divide most digital entertainment content today into just four categories:
  1. content on home computers and their networks
  2. content online, including the World Wide Web and the iTunes Store
  3. content on non-computer feeds coming into your home, such as OTA, cable, and satellite TV, satellite radio, etc.
  4. content on hard media like CDs and DVDs
Apple's iTV is designed to bring category-1 and category-2 content into your home theater environment. Simple as that.

iTunes, with its CD-ripping functionality, brings some category-4 content — specifically, CDs — into your computer environment, including your iPod, as category-1 content. (You can use third-party rippers like HandBrake to capture DVDs.) The iTunes software also taps into a fair amount of the category-2 content: the sort available online at the iTunes Store.


The big problem, convergence-wise, is with category-3 content. How do you bring over-the-air, cable, and satellite TV, satellite radio, and so forth into your computer environment, where it lives as files holding category-1 content that can be bridged to your home theater by the likes of iTV.

I have no personal experience with satellite radio and can't comment on it. My interest is mainly in the "TV taps" that you can turn on and off in your home: specifically, the "cable-TV tap."

When you hook the wire that brings cable TV into your home to a suitable device such as a digital cable box — or a "digital cable ready" television equipped with a cable tuner and a CableCARD — you can turn on the tap at will and get any and all of the programming you've signed up for. Some if it is still analog, while much of it is now digital. Some of the digital cable channels are standard-definition, some are high-def.

You can even record cable programming that you are authorized to receive by saving it on a digital video recorder (DVR) built into the cable box. If you go to the trouble and expense of leasing a DVR box from the cable company, such temporary recordings of (even high-def) digital programming, made for the sole purpose of time-shifting the viewing experience, are perfectly legal.

Likewise, you can legally use a TiVo Series 3 HD-DVR to do your time-shifting. Put one or two CableCARDs from your cable company into this TiVo, and you can have it do what the DVR in the cable box would ordinarily do: capture SDTV analog, SDTV digital, and HDTV digital cable programming for later enjoyment. In the case of SDTV analog content, the programs are digitized and compressed by the TiVo itself. With SD and HD digital content, the TiVo just saves the original digital program stream as is.

I don't think, however, that you can export the digitized-or-saved content from either a cable DVR box or a TiVo to a computer. Oh, you can play that content back into a TV-capture device in a computer and try to capture it that way. The playback all too often is analog, coming out of the cable box or TiVo along component-video, S-Video, composite-video, or 75-ohm "RF" wires.

The best of these analog options is component video; it would be nice to find a TV-capture device for a computer that digitizes it, compresses it, and archives it. As yet, though, the only TV-capture devices I know of for the Mac or the PC take only S-Video, composite-video, or 75-ohm "RF" input. (One such product, which I intend to investigate thoroughly, is the ConvertX PX-TV402U PVR from Plextor, shown at left.)

None of these connection types other than component video has enough bandwidth to carry high-definition images without losing resolution. All introduce noise and artifacts into the picture. So ... it beats me why there are no component-video TV-capture devices for the Mac.


Better still would be devices that could capture digital video at 720p or 1080i, and even at 1080p, with no intermediate detours into the analog domain. Ideally, it would have to work with both broadcast (OTA) and cable, which unfortunately encode the signal differently. Optionally, it would also work with satellite TV, with yet a different encoding.

For the Mac, Elgato Systems' EyeTV Hybrid (shown in a laptop) already seems to do the job with OTA digital TV, but not with digital cable. For the latter, a CableCARD would be needed. Elgato has told me via e-mail that "It would be nice to have a product that supports the CableCARD however it is too early in the development of the CableCARD to be viable. At the moment, there are no such products available."

CableCARD is a thin device that slips into a TV set (or another device like a TiVo) and allows the TV's internal cable-TV tuner to gain access to the channels the cable company authorizes you to receive — including, of course, digital channels. The cable company brings the CableCARD to your home, installs it, and authorizes it. You (or the cable guy) just plug the wire that would normally go to a cable box into the TV itself.

Then you don't need the cable box — unless, that is, you depend on interactive, two-way cable-box communications for getting a program guide, pay-per-view, or video-on-demand. CableCARD can't deal with those three functions. If you can dispense with them, you can tell the cable guy who delivers the CableCARD to take his cable box and put it where the sun don't shine.

The next revision of CableCARD will eliminate the two-way interactivity problem. Unfortunately, CableCARD 2.0 will not be backward compatible with the CableCARD-equipped TVs of today. Those TVs are merely "digital cable ready." TVs expected in 2007 0r 2008 — the ones with the new CableCARD 2.0 slots — will be "interactive digital cable ready."

(An editorial aside: a few years back, the Federal Communications Commission in Washington, D.C., mandated that cable companies offer CableCARDs to their customers and that TV makers put CableCARD slots in their TVs. Score one for "government interference in the marketplace." CableCARDs are a goo idea. But the commissioners were too namby-pamby to mandate the equivalent of CableCARD 2.0 right off the bat, ensuring that there would one day be a clumsy, confusing, consumer-angering transition between the original CableCARD and the newer, non-crippled one. That day is going to be here soon. Score one for the marketplace libertarians who would have shown the FCC the door in the first place.)

(Note also that there is already a move afoot to make even CableCARD 2.0 obsolete. It's called OpenCable. Here is it's website.)


Why are we having such a long wait for everything to fall into place, convergence-wise? Espeically with regard to category-3 "TV tap" content, there is no good solution yet for capturing and archiving it. Why not?

You can, if you like, blame the typically long gestation period for any cutting-edge technology. You can blame the Feds either for not exercising strong enough dominion over teh technology or getting in its way, depending on your political persuasion. But part of the blame stems from the legitimate anxiety that content owners have over digital rights management (DRM).


DRM is, in essence, copy protection that can be supervised digitally — plus, of course, access authorization. Do you have legitimate access to a digital cable channel such as Fox Digital or HBO? DRM decides. Can you make a temporary time-shifting copy of, say, 24 or The Sopranos? DRM decides. Can you make a permanent archival copy on a computer hard drive or a home-brew CD? DRM decides. Can you upload your copy onto the Internet for other people to download? DRM decides.

DRM extends to "hard" digital media such as DVDs, HD DVDs, and Blu-ray discs. CDs don't use it — which is why they were so easily "napsterized." The digital copy protection on DVDs has, meanwhile, been compromised, which is how HandBrake allows you to create legal archival copies of your DVDs.

DRM also extends to online content. If you buy a song at the iTunes Store, it plays back only on your authorized computers, or on the iPods sync'ed to them.

DRM also extends to over-the-air digital TV broadcasts. By law, anybody can access OTA content, but can that content be recorded? If so, how may those recordings be distributed and used? Here is where the infamous "broadcast flag" rears its ugly head. Until struck down by a federal court, a mandate by the FCC was bout to require that TV makers build into their TVs the ability to respond to a set of bits (a "flag") in a digital broadcast that could (optionally, at the behest of program originators) block or hamper digital recordings of the content in the home of the user.


Digital content, unless access or copying is blocked somehow, moves easily from device to device — say, from a Blu-ray disc player or a cable box to a TV. If the receiving device can capture it in the form of a digital recording, content owners would like to be able to limit such recording activity to that which is legal under copyright law. Modern digital copy protection schemes typically allow them to place their digital content into one of three categories:
  • copy freely
  • copy one time
  • copy never
This is done by "flags" inserted in the digital content. These copy management flags are separate from but akin to the broadcast flag. Since over-the-air TV broadcasts are "free," they themselves do not typically invoke such copy management flags. But when your local cable-TV company retransmits these broadcasts, the copy management flags may come into play.

A "copy freely" program sent out by a cable-TV company can be copied at will as many times and for as many generations as you like. A "copy never" program cannot be copied, period. A "copy one time" program lets you make as many first-generation copies of it as you like, but the copies will be flagged "copy no more," or "no more copies," so copies of the copies cannot be made.

The same kind of flags can be used with content on HD DVD and Blu-ray discs. Plus, copy protection flags can be brought into play whenever you try to transfer digital content in your home from one device to another in your home: over a computer network, via Firewire, via DVI or HDMI, etc. If you try to transfer a "copy never" program, the source and receiving device may collaborate to keep you from doing so. The same with a "copy no more" program.


At this point, I don't think anybody really knows how well DRM and copy management work in the real world. There are two potential problem areas. One, DRM might be too "leaky"; it might let copyright violations occur too easily. Two, DRM might be over-strict and keep consumers from exercising their legitimate rights. In fact, it's possible that DRM might be both too leaky in some respects and too strict in others.

We have yet to find out how well DRM works because today, before we run into DRM, we typically run into "brute force" methods of copy protection.

If you have a cable box today that has a built-in DVR, chances are it simply does not provide any way to export a digital signal — with the obvious exception of HDMI, or its predecessor, DVI. HDMI/DVI use uncompressed digital video signals only; these signals require too much bandwidth to be shunted into a recording device.

Recorders need digital video that is still compressed, the way it comes into the cable box before it is decoded and sent out over HDMI to the TV. Some cable boxes do offer the ability to send compressed digital video out over Firewire to an outboard recording device. I have heard surprisingly little about this, and I do not know whether my own cable boxes can do it. As yet, I have no recording device which could capture the Firewire output.

That's exactly what I would like my anticipated Mac mini to do. Now you know why I feel like a pioneer, when I'd much rather feel like a settler!

Friday, November 17, 2006

Apple's Forthcoming iTV

As I said in Media Center Mac Mini for My Bedroom? (Part 2), I'm looking to feed a Sharp AQUOS LCD flat panel TV with input from a Mac-based media center, probably a Mac mini. In researching that plan, I learned that Apple has a pre-announced product, code-named iTV, that may fit into my scheme.

Here is an article about iTV. The article includes photos, such as the one at left, of the giant screen behind Apple CEO Steve Jobs during his presentation at the Yerba Buena Center for the Arts Theater in San Francisco, California on September 12, 2006.

iTV's details are sketchy. We know that iTV:
  • is a "a wireless video streaming set-top box to be released in Q1 2007."
  • appears to have a footprint identical with that of a Mac mini. I assume you can stack it under or on top of a Mac mini.
  • features a built-in power supply; USB 2.0 and Ethernet ports; HDMI audio/video output; optical digital audio output; RCA stereo analog audio outputs; and 802.11 (I assume 802.11g) wireless connectivity.
  • is "controllable by the standard Apple remote [and] will come with an updated version of [Apple's] Front Row [software] interface that shares Front Row's smooth 3D graphics, but differs in that it has a menu on the right side of the screen."
  • "works with ... iTunes on both PCs and Macs," and
  • "will sell for $299."
I note in passing that iTV does not have an internal optical media player for DVDs and the like. What could Apple be thinking?


iTV's network connectivity will allow its use as a front end to access recorded media files — movies, music, etc. — on the Internet or on a home computer network, whether wired, wireless, or a combination of the two. My particular network could build in a Mac mini, but it wouldn't need to, since I already have other Macs on a wireless AirPort network.

The iTV itself would serve as my network's video connection to my flat-panel TV, ideally via its HDMI port. It would provide an audio connection to a separate sound system, ideally via either HDMI or the digital optical audio output.


Another article about iTV
appears in Wikipedia (with a link to this page offering streaming video of Jobs' full Yerba Buena presentation). The article mentions rumors "that the iTV will sport other features, such as a built in DVR feature, or even Live TV, but this is highly unlikely. Like the iPod, the iTV will start out as a mainly recorded media [gathering] device" — that is, on a home computer network.

In Media Center Mac Mini for My Bedroom? (Part 1) I looked at two TV-related Mac products from Elgato Systems, EyeHome and EyeTV Hybrid. The first of these looks like a direct competitor to iTV — whose advent will probably spell curtains for it, since EyeHome is, like iTV, a networked media-client hub. The second Elgato product, EyeTV Hybrid, offers the live TV and DVR features the Apple product apparently lacks. It is not itself network-oriented.

When you think about it, then, iTV (like Elgato's EyeHome) is all about gathering, accessing, and playing existing media content from many disparate network sources seamlessly — a worthy goal.

But the EyeTV hardware, in its Hybrid form or as EyeTV 250, is all about capturing live content piped into the home via cable or satellite or obtained over the air via an antenna. This function is one which Apple has not addressed.


iTV seems very carefully designed not to be usable as a high-def digital video recorder — by running a Firewire or USB 2.0 cable to it from, say, a digital cable box.

Some digital cable boxes (I am told) can output HD video content in digital form on Firewire, potentially allowing it to be recorded on external devices such as DVD recorders. I've never tried it, so I don't know its ins and outs. Nor have I heard of any cable boxes that output USB 2.0. But iTV is seemingly not going to be in the business of allowing digital cable-TV content to be archived on it, or even via it to its back-end computer network.

It would of course be nice if iTV could record digital 720p and 1080i HDTV programming as such. Or, if not capturing it directly on its own hard drive, at least passing it along to other computers on a home network.

But, alas, no. iTV has no intrinsic video input capability. It can retrieve already recorded video material from a home network or from the Internet, but it cannot capture live TV.


Even if an external TV-capture device like EyeTV Hybrid could be connected to iTV's USB 2.0 port, as if to enable the iTV to capture a television signal, how would the requisite EyeTV software be installed on Apple's iTV?

And even if Apple's iTV could somehow host Elgato's EyeTV software, Elgato's EyeTV hardware can't accept digital cable input ... not without the signal already having been converted to merely standard-def analog by a separate cable box.

Specifically, EyeTV lacks the ability to accept TV signals in digital form directly from the 75-ohm wire that feeds a cable box. It does not have an onboard cable-TV tuner. Nor does it accept a CableCard for decoding digital cable input. Nor does it have a Firewire input to allow it to receive a digital signal output from a standalone cable box.

In fact, Elgato tech support informs me: "There are no products for the Mac or PC that can natively decode the encrypted signal from the cable company." That's where CableCard support could come in handy. As far as I know, most or all digital cable channels are encrypted to ensure that only authorized cable boxes (or CableCards) can receive them. This includes premium channels like HBO, high-definition channels, and in fact any and all digital channels that are not part of the cable company's basic tier of service.

My own cable company, Comcast Cablevision of Baltimore County, Maryland, charges extra for all digital channels, since it basic tier channels are still all-analog. So all digital cable channels that are available to customers require decoding.

Currently, no products for either the Mac or PC will do that. That may change someday. If it does, I could conceivably make a Mac mini into the equivalent of a TiVo Series 3 HD-DVR, but with the ability to permanently archive high-def and standard-def TV content in its original form.


There's also the problem of bandwidth, though. Broadcast 720p and 1080i signals require up to 19.2 Mbps. They're only lightly digitally compressed — though cable companies typically squeeze broadcast digital channels down, bandwidth-wise, yet more.

Suppose you could somehow input 1080i at up to 19.2 Mbps into iTV and wanted to record it on a Mac mini, to which the iTV wirelessly networks via one of Apple's AirPort 802.11g products. 802.11g (also called WiFi) can run as fast as 54 Mbps, with a "typical" rate of 25 Mbps. That conceivably could be fast enough for shunting a single HDTV signal around a home network — assuming optimal wireless reception conditions. So, technically speaking, it might be possible for Apple or a third party to enhance iTV to serve as an HD-DVR — a high-definition digital video recorder.

Hence it would be nice if digital cable boxes and satellite receivers offered USB 2.0 output of their digital video signals for use by the likes of iTV. Then any digitally compressed TV signal received by the cable box might be exported into iTV, where software such as Elgato's EyeTV could capture it, either on iTV itself or elsewhere on the home network, via 802.11g.

That would be nirvana, but it's not apt to happen. Think of the copy-protection issues. Though you have a legal right to archive, for you own enjoyment and use, TV programs you legitimately receive, content providers are not about to make it easy for you. We've all heard about the "broadcast flag" that might one day be inserted into digital TV programs so you can't copy them. There are other flags in digital television that can do the same sort of thing. I've yet to hear whether, or how, they're in use today, but you can bet they'll sprout right up once a product something like iTV makes digital-TV capture simple for the masses.


Meanwhile, the prerecorded content Steve Jobs has in mind for iTV play is mainly what's available at Apple's iTunes Store. There you can now get songs, as always, plus movies, TV shows, podcasts, music videos, and movie trailers. All but the original music-only files feature video. The movies and TV shows are of near-DVD video quality, 640 pixels by 480. (DVDs are something like 704 x 480.)

That's a long way from high-def. Apple is betting that the convenience, usability, archivability, networkability, and reasonable pricing of their media content will offset the lower video resolution. Apple may be right. I can't be the only one to have noticed that 720p and 1080i/p HDTV content remains decidedly "niche" in appeal and availability, years after the HD revolution supposedly began.

Thursday, November 16, 2006

Media Center Mac Mini for My Bedroom? (Part 2)

In Media Center Mac Mini for My Bedroom? (Part 1) I may have gotten the cart before the horse. I was musing about how to record TV on a Mac mini equipped with an add-on TV tuner. I was also pondering how to play that and other digital content back into a new LCD flat-panel TV and sound system, probably via a digital media player that communicates with the Mac over a local area network. But first, I think, I ought to consider what the Mac mini can do videowise, all by itself.

The Mac mini is a bare-bones desktop Mac which you trick out with a monitor, a wired or wireless keyboard, and a wired or wireless mouse. It has a front slot for DVDs and other optical media. You can hook the mini to a flat-panel TV via its DVI port, insert a DVD, and have Apple's Front Row software play the DVD right on the TV screen.

In the setup I have in mind, I expect to route video to the TV with a DVI-to-HDMI cable and 5.1-channel audio to an audio system over a cable plugged into the audio output of the mini. For the video connection, I could also get away with hooking the DVI-to-HDMI adapter which Apple includes with the mini to a DVI-to-DVI cable which I already have on hand. See below for more.

Front Row is media software that is controlled by the Apple Remote shown at left in the picture above, and alternatively by keyboard shortcuts (if your mini has a keyboard). It also plays back home movies, photos, and music files from the mini itself or shared by any computer networked to it. "Apple’s zero-configuration technology, Bonjour, lets Front Row find your content easily," says this review from Macworld.

So far, no call for a keyboard or mouse. But, as this later Macworld review notes, you need these input devices to get everything working to your satisfaction. (That review, by the way mentions "Apple’s forthcoming iTV product [which] better fills this niche by doing away with the computer interface and relying solely on a simple, Front Row-style menu system." I see I'll have to find out more about that iTV product.)

Another Macworld article
tells of one reporter's experiences using the mini as a media center. It's amplified by this further article discussing issues people have run into connecting the mini to an HDTV.

In the first article, the reporter (Christopher Breen) found that "When outfitted with the proper peripherals (and those peripherals are correctly configured) the mini performed as a workable media center as long as its media files were stored on the mini or a hard drive attached to it. As a client tasked with streaming media from another computer, Front Row and the mini have a way to go."

But Breen (in my opinion inexcusably, these days) wasn't using an HDTV! He needed to use Apple's optional DVI-to-video adapter ($19) to hook the mini to his dinosaur non-digital SDTV. He also notes that you need to buy a special adapter to convert the mini's audio output connection to TosLink, the standard for digital optical transmission of audio signals. He says that "Griffin Technology’s $20 XpressCable includes the adapter necessary for the cable to work with the mini’s audio jack." Shame on Apple for not including it with the mini.

Breen found that the dumbed-down 800x600 resolution the mini chose for his TV was fine for DVDs but made ordinary computer graphics "a bit squished and fuzzy." There was also the drawback that the Front Row software gave him no control over the audio volume, though his AV receiver did.

Breen added in Elgato's now-discontinued EyeTV 200 tuner/recorder/playback/editing box and Eye2 software to "watch live TV, record TV programs, create schedules for [TV] recordings, and automatically export those recordings in a format compatible with an iPod with video." This use of the mini as a TiVo-like device worked, but with drawbacks. I'll skip those drawbacks for now.

Breen, by the way, recommends Belkin’s $99 MediaPilot as a combination wireless keyboard/wireless mouse, over Apple's Bluetooth-based equivalents. But the Belkin's software, he says, isn't yet compatible with the new Intel-based Macs. Pah!


Breen tried streaming video from his other Macs to the mini wirelessly via AirPort, with mixed results. Part of the problem was that his Airport signal strength was marginal. But even switching to wired Gigabit Ethernet didn't cure all the woes he encountered, with Front Row refusing to play some of the remote video movie files it should have been able to cope with.

Breen later followed up with this postscript discussing how to obviate some of those drawbacks, summarizable thus: "Despite creating the fastest network possible as well as providing Front Row with the slimmest movies possible, it and iTunes refused to play them unless I created an alias of the original movie, mounted the network volume where that movie resided, and copied the alias to the mini’s Movies folder." The solution: "... movies [i.e., computer movie files] must have their streaming option enabled" by means of a procedure which Breen details.

Even so, streaming video "choked" over anything but a wired Gigabit Ethernet network. A "solid AirPort" wireless network wasn't fast enough. And movies that were "too long," if they also had high bitrates, wouldn't stream even over Gigabit Ethernet.


Now, on to the mini-to-HDTV connection perplexities discussed here. One such perplexity is, of course, that the mini provides (only) a DVI video output. DVI was all the rage on HDTVs a couple of years ago, but it's since been overtaken by HDMI. Both DVI and HDMI are digital connections. They're capable of routing uncompressed digital video signals from a source device such as a DVD player or a Mac mini to a TV. But DVI uses a bigger, clumsier connector and doesn't carry any audio signal whatsoever.

Shame on Apple for not putting HDMI output on the mini, then. In fact, I think I can guarantee that the day after I buy a mini, Steve Jobs will announce an all-new Mac mini, replete with the latest-and-greatest version of HDMI, which happens to be HDMI 1.3, and everything else that it needs to bring Apple front-and-center in the race computer-TV convergence reace. That's probably when the anticipated Apple iTV product (see above) will debut as well.

Anyhow, the current mini requires that you buy a DVI-to-HDMI conversion cable in order to hook it to an HDTV's HDMI input. Or you can get either a DVI-to-DVI cable and a DVI-to-HDMI adapter, or an HDMI-to-HDMI cable with a similar adapter. You can find what you need at reasonable prices at Pacific Custom Cable.

There is also the question of what screen resolution the Mac will use with any given model of HDTV. For example, according to this part of the previously mentioned article in Macworld, with a Panasonic TH-42PX60U 42-inch plasma TV the Mac mini's screen resolution automatically changes to 1,600-by-900 pixels at a refresh rate of 60 Hertz.

The Panasonic TH-42PX60U's native screen resolution is 1024 x 768, a common value in plasma HDTVs. That native resolution is neither of the two standards of HDTV resolution: 1920 x 1080 for 1080i and 1080p, and 1280 x 720 for 720p. The 1600 x 900 of the Mac mini's self-selected output exceeds both 1024 x 768 and 1280 x 720, in both the horizontal and vertical directions. It has the correct widescreen 16:9 aspect ratio (note that 1024 x 768 does not translate to 16:9, so the Panasonic's screen pixels are not actually "square").

But the Mac mini may not actually produce full 1920 x 1080 resolution for input to a true 1080p display. In fact, it's not clear whether the Mac mini will sync to a resolution and refresh rate that your HDTV can handle. If, say, your HDTV can sync to 1080i, 720p, or 480p at 60Hz, then perhaps it cannot sync to what amounts to 900p resolution at 60 Hz. It's unclear whether the mini is smart enough to self-select another resolution/refresh rate in such a case.

You can manually set the mini's Displays preference panel to use a different screen resolution if you like, at the cost of making text either too small to read or too "bloated." This can be done in the Displays panel of System Preferences ... but only if you have a properly sync'ed picture on the screen to begin with.

Macworld found 1600 x 900 just right for both computer use and DVD playback on the Panasonic TH-42PX60U. But there was also a problem with "overscan" — the tendency of almost all TVs to put the top, bottom, and side edges of the image beyond the boundaries of the screen. This has been standard practice since the early days of television, since the image on a picture tube shrinks with age. In the digital era, overscan hides the ofttimes noisy image edges.

But computers want to use every pixel of the screen, so displaying their video on an HDTV can cause problems. Macworld found the mini's Displays preferences to have an option to compensate for overscan. Using it put a black border around the whole image on the Panasonic. A DVD then would not fill the entire screen.


The Macworld article also mentioned the need to use the mini's Displays panel to create a custom color profile for the Panasonic, to keep the metallic color of the Mac's windows from having a pinkish cast.

Here is one of the great things about using a Mac as a video source; I don't think the Macworld article did it justice. The Color tab of the Displays preference panel lets you calibrate your display, thereby creating an ideal profile you can use evermore for that display.

The calibration is fairly easy to do. You are walked through a series of steps in which you use the mouse (or, better still, the arrow and tab keys) to adjust a drawing of a filled-in apple-in-silhouette so it is a neutral shade of gray (i.e., lacking any tinge of color) and has exactly the same lightness or darkness as the area surrounding it. This process of adjusting the renditions of grays, oddly enough, makes sure that all colors, at all brightness levels, look just as they should. I think of this as adjusting the image's color balance, but the correct term is performing a grayscale adjustment.

I find on my MacBook Pro that I get the best results if I temporarily change the screen resolution to its lowest available value, so that the apple shape within its surrounding area is as big as possible.

After a number of these color balance or grayscale adjustment steps — and you may want to back up and repeat some of them to get them all just right — you are next asked to choose a "gamma" value via an adjustable slider. This determines how much contrast the screen image will appear to have. If gamma is too low, the image will look flat and washed out. If too high, the image will be objectionably dim for the most part, with glaring highlights.

Next, you choose a target "white point" — a "color temperature" which determines how yellowish-to-bluish the cast of the overall image will be. Ideally, you'd like the white point to be D65, or 6504 degrees Kelvin. Most HDTVs don't hew to that supposed ideal, for reasons I won't go into here. Often, their best approximation is their so-called "Warm" temperature setting, but color temperature may still vary widely with brightness levels within the image. The Mac calibration I'm currently discussing can compensate for all this — but only, of course, when the Mac itself is being used as the HDTV's video source.

One nice thing about how Apple implements all this calibration stuff is that you are doing it in a separate window on the "computer" screen. In another window you can display, say, a freeze frame from a black & white DVD. As you make all the calibration adjustments, you can immediately see the effect on the DVD image. If, for example, the DVD image looks tinged with a bit of green, you know right away you have made some mistake in the calibration and can correct it accordingly.

That's basically it. At the end of the calibration process, you decide whether or not you want to deny other users of your Mac access to your color profile, and you give your profile a name by which you will thenceforth be able to select it in the Displays panel. End of story.

I'll have more to say on the Mac mini connection in my next installment.

Sunday, November 12, 2006

Media Center Mac Mini for My Bedroom? (Part 1)

I'm pretty sure I'll be getting a flat-panel LCD for my bedroom soon, probably the highly-thought-of Sharp AQUOS LC-37D90U, a 37" 1080p TV. My original intent was to feed it with one of the new TiVo Series 3 high-def digital video recorders, suitably equipped with one or two CableCards for digital cable reception. But it occurs to me it would be more fun to use some sort of Media Center PC instead.

Media Center PCs are big in the world of Windows-based machines, but I'd rather use a Mac as my media center hub. The ideal Mac for the job would seem to be an ultra-compact Mac Mini, a midget computer-in-a-box to which you BYODKM — bring your own display, keyboard, and mouse.

"How to turn your Mac Mini into a media center" at engadget.com tells one way to do this. It hooks the Mac Mini to two products from Elgato Systems, EyeHome and EyeTV. The article is unclear about which EyeTV model is best. It recommends EyeTV 200 but says it was unobtainable at press time. It also mentions EyeTV 500. Both those models now seem to be obsolete. The one to use seems to be EyeTV Hybrid (see picture at left).

EyeTV Hybrid hooks into a USB port on a Mac and accepts a cable-TV cable connection as it's input source. Using software supplied with it, it tunes into cable channels and allows them to be watched on the Mac's monitor or screen and/or recorded to the Mac's disk drive. The Mac in effect becomes a TiVo. In the picture to the right, the Mac is a portable, but it could equally be a Mini. In that case, the flat-panel TV would hook to the Mini's DVI output via a DVI-to-HDMI cable, and it would serve as the Mini's monitor.

That's how cable-TV video can delivered to the Mac Mini to be recorded, and how it can be watched on the LCD flat panel. But media centers are about more than video; they involve other sorts of content too, such as photos, home movies, music files, etc. Here's where the EyeHome comes in.

Instead of (or in addition to) running a DVI/HDMI hookup from the Mac direct to the flat panel, I can run an Ethernet connection from Mac to EyeHome, and hook the EyeHome to the TV. Using the EyeHome software, I can stream every kind of computer media to the TV and its sound system.

The EyeHome has a menu interface that shows up on the TV screen and is controlled by the EyeHome remote control. From those menus I can select the media files I want to watch and hear. The EyeHome fetches them from the Mac and feeds them to the TV and sound gear.

EyeHome can also do its stuff wirelessly. Instead of an Ethernet cable, it can communicate with the Mac by means of Airport Express. The AE unit is simply set up to extend a network provided by one of Apple's Airport Extreme base stations. I have such a base station already, and I also have a couple of AEs in use.

The December 2004 issue of Home Theater had a review of a similar setup to the one I'm contemplating. Theirs was an EyeTV 200, not an EyeTV Hybrid. They liked the EyeHome, with few reservations. The EyeTV 200 had some drawbacks.

First of all, the EyeTV 200 is (or was) a standalone box connected to the Mac via Firewire, not a "stick" plugged into a USB port. Fair enough — I might go instead with a box-like EyeTV 610. Be that as it may, one hitch with EyeTV is that its program guide is limited to that at the TitanTV website. It's not clear to me how ergonomic that would be — especially since the only way to feed EyeTV with digital and/or encrypted cable channels requires that you hook it to a cable box via an RF connection and let the cable box do the channel selection. So how would I get EyeTV to consult the program guide and to administer the box accordingly?

It would be nice to find an EyeTV model that can accept a CableCard. So far, I'm not sure any of them do.

Nor am I sure whether EyeTV can handle high-definition digital cable channels as such. Unlikely, in view of the RF-only input connection.

More later.

Sunday, September 03, 2006

Samsung's BD-P1000 Blu-ray Disc Player Disappoints

The reviews are in on the first Blu-ray disc player, Samsung's BD-P1000, and they are decidedly mixed. This review published in the September 2006 issue of Sound & Vision magazine is one of the more favorable. Rob Sabin, who was the lead reviewer, and Senior Reviews Editor Al Griffin were disappointed to find that the first BD-P1000 sample they looked at gave "soft" images at 1080i resolution over an HDMI connection, along with some odd video noise they called "the crawlies."

Samsung engineers, it turned out, had forced an internal video noise-reduction circuit to a full-on setting in the first BD-P1000 units to hit the market. Not only did that soften the picture, it also gave the inherent grain in film images "a somewhat mottled look," accounting for the observed "crawlies."

But a second sample BD-P1000 with the noise-reduction circuit disabled by Samsung engineers produced a picture with "no obvious distinction," at first, from the original sample's not-all-that-impressive picture. Hours of further testing revealed that the second sample did offer a number of very subtle picture improvements, however: more detail, more "pop." Many of the remaining picture-quality issues may have been inherent to the first crop of Blu-ray titles to become available, since, often, picture flaws came and went on a scene-by-scene basis.

At any rate, Samsung has promised that BD-P1000s made starting in August 2006 would either disable the noise-reduction circuit outright or allow the user to opt to turn it off or on. Owners of earlier units will be provided with updated firmware to accomplish the same thing. It will have to be provided on a disc, since the BD-P1000 has no Ethernet port.


Another disappointment: the BD-P1000 outputs 1080p, but only after converting the 1080p/24 images on the disc, first to 1080i/60, and then to 1080p/60. A review in The Perfect Vision issue for September 2006 — which is not available online, except as a download of the entire issue here — says:
Movies are stored on the disc at 1080p/24 (24 frames per second); when the disc is played, it is converted to 1080i/60 (60 fields per second) using 3:2 pulldown. Then, it is deinterlaced to 1080p/60 for the HDMI output. This process introduces all the familiar 3:2 artifacts that must be compensated for. To be fair, HD DVD’s 1080i/60 output has the same problem when deinterlaced by the display.

These artifacts could be completely avoided by simply sending 1080p/24 (or, better yet, 1080p/48 by sending each frame twice) to the display. Unfortunately, there are very few displays that can accept 1080p/24 or 48. All of this leads me to implore manufacturers of displays and high-def disc players to implement 1080p/48 or 72 to avoid all the headaches associated with 3:2 pulldown.
3:2 pulldown is the method used to change the 24 frames per second encoded on a Blu-ray disc — the frame rate of motion picture film — to 1080i/60's sixty interlaced fields per second. Each 1080i frame is composed of two fields, with one field containing the odd-numbered pixel rows of the two-field frame, the other with the even-numbered lines.

So the BD-P1000 converts 24 progressive frames on the disc to 60 interlaced fields per second and then deinterlaces those fields to make 60 progressive frames per second, which it sends to the TV in digital form over HDMI. On the other hand, if the BD-P1000 is told just to send the 60 interlaced fields to the TV in digital form, the TV itself will deinterlace them, giving what the Sound & Vision reviewer says is an identical result.


Any time deinterlacing of 3:2-pulldown material is done, visible artifacts can mar the picture. For instance, vertical or diagonal edges of moving objects can develop vibrating, serrated/jagged edges; this is called "flagging." Flagging can happen if the de-interlacer doesn't catch on to, or loses track of, the 3:2 cadence of film-based material.

The root of the problem is that two of every five interlaced video frames have mismatched fields, one from a particular film frame and the other from the next film frame. Static objects in the picture are unaffected, but two different versions of moving objects will be picked up in a single video frame. If the deinterlacer doesn't properly compensate for this, you'll see flagging.

There is thus no real advantage to using the 1080p/60 output which the BD-P1000 player can provide — and the first HD DVD players from Toshiba cannot — unless, of course, your TV does a poorer job at "reverse 3:2 pulldown" than the BD-P1000 does.

We are accordingly never going to get the best possible picture from Blu-ray discs until (a) the players can output 1080p at 48 or 72 frames per second, by simply doubling or tripling the 24-fps frame rate on the disc, with no interlacing or 3:2 pulldown, and (b) 1080p TVs can accept digital inputs at those rates.


Yet another disappointment with the BD-P1000 is that it cannot utilize any of the advanced audio compression modes which can optionally be included on Blu-ray discs: Dolby Digital Plus, Dolby Digital TrueHD, DTS HD, or DTS HD Master Audio. It can utilize the uncompressed 6-channel linear PCM audio tracks found on most of the Blu-ray discs released to date and send it out over analog connections to a suitably equipped A/V receiver. (It can also decode the familiar Dolby Digital 5.1 tracks also found on many of the first Blu-ray releases.)

One reason why the advanced audio compression modes have been short-shrifted is that they can't be output in digital form on HDMI, to be decoded by a receiver. That won't even be an option until HDMI version 1.3 arrives sometime in 2007. When receivers start becoming HDMI 1.3-capable, presumably future Blu-ray player models will be designed to read and output the advanced-compression-mode tracks — and/or decode them internally.


Finally, the BD-P1000 disappoints because it doesn't implement BD Java, the computer language which is supposed to allow Blu-ray players of the future to marry disc play with interactive Internet content. Perhaps this is why Samsung omitted the Ethernet networking capability so nicely (but as yet uselessly) built into the first HD DVD players from Toshiba.

When you combine all the disappointments of the first Samsung Blu-ray player with the failure of the Blu-ray camp to utilize the two advanced, highly efficient video compression methods that have been promised for the future, AVC and VC-1, or to be able to manufacture dual-layer discs as yet — the two delays together possibly explain the dodgy video quality of the first Blu-ray releases — you get the impression of a home entertainment format that has been rushed too soon to market, and is not yet ready for prime time.


The Blu-ray camp has long said its format beats rival HD DVD because it holds more data. More recently, Blu-ray has boasted of its true 1080p output, where HD DVD currently maxes out at 1080i. And the extra Blu-ray data space has been touted as perfect for fostering interactive applications, with possible Internet ties.

So what do we get with the first Blu-ray player and Blu-ray discs to be released?
  • We get less room for data than on present dual-layer HD DVD media, where what room there is on Blu-ray is taken up by inefficient MPEG-2 video encoding and uncompressed linear PCM audio encoding, the latter being of exceptionally high quality but possibly indistinguishably better than, say, losslessly compressed Dolby Digital TrueHD or DTS HD Master Audio.
  • We get 1080p output, yes, but it has been compromised by passing it through intermediate 3:2 pulldown/deinterlacing stages in the player. 1080p/48 and /72 output, which are what is really needed, await TVs that can take advantage of them.
  • We get digital audio output over HDMI, yes, but not of any of the missing advanced audio codecs, and not of uncompressed linear PCM, which can only be output in 6-channel analog form. Later Blu-ray players will mate with compatible audio/video receivers over HDMI 1.3 to rectify this oversight, it is true, but that won't be a reality until 2007.
  • We get a player that can't connect to a network over Ethernet, can't go online, and can't use BD Java (which isn't implemented on any of the first disc releases anyway.)
  • We get discs that don't, from beginning to end, have the eye-popping video quality uniformly found on initial HD DVD releases — discs whose insufficiencies are possibly aggravated by a player that may or may not be doing unwanted video noise reduction.
Not at all an auspicious start for Blu-ray. What a shame.

Thursday, July 20, 2006

HD DVD vs. Blu-ray (Pt. VIII)

In previous posts in this series such as HD DVD vs. Blu-ray (Pt. VII), I stuck to facts in an attempt to psych out the HD DVD vs. Blu-ray format war as it gets under way. Now I'd like to indulge in a bit of rank speculation.

Will either or both of these new hi-def disc formats become hits? If so, what will put it or them over the top?

The answer just may be a whole new way to build a video collection. Imagine that you have an HD DVD or Blu-ray recorder, not just a player. Like the first HD DVD players and Blu-ray players soon to come, it has an Ethernet port and can directly access a broadband Internet connection, just like a computer. In fact, on the inside it is a computer.

Imagine also that there is an online store like iTunes, except it sells movies. High-definition 1080p video, multichannel-PCM audio movies — the same exact bitstreams as are sold on prerecorded HD DVD and Blu-ray discs, in fact. Call this store iFlicks.

You can log onto iFlicks and buy, say, Pirates of the Caribbean: Dead Man's Chest for legal download to, say, a Blu-ray disc. You authorize the $10 charge to your credit card, and the download begins. Even with a broadband connection, it takes several hours, but you're setting this up to happen at night while you're asleep, so who cares? In the morning, you'll have your own BD of the hottest movie going.

There is nothing to say this scenario couldn't become a reality. All the technical hurdles have been overcome, or soon will be. Both HD DVD and Blu-ray promise recordable media akin to DVD-R and DVD-RW. These new recordable disks will hold a minimum of 15 gigabytes for a single-layer HD DVD, 20GB for BD. I imagine dual-layer recordable disks will double those figures.

Of course, it can't happen if copyright owners — studios — balk. They would need to feel secure that they weren't giving away the keys to their (magic) kingdom. These recordings would have to be copy-protected out the proverbial ying-yang. Probably they would be copyable to/playable on at most (say) three machines authorized by the purchaser, just as are iTunes downloads today. The three authorized machines would have to be connected to the Internet each time the movie is played, to confirm the authorization — or even to gain access to small-but-crucial pieces of the movies' bitstreams that are otherwise not part of the download. Use of the bitstreams beyond those three machines would be impossible.


It doesn't take a rocket scientist to know that the studios would make sure iFlicks movies are compatible with HD DVD or Blu-ray, but not both — just as iTunes songs work only with iTunes software or on iPods. The format war could be won or lost based on which format iFlicks supports. Of course, there might be competition. A Blu-ray iFlicks store might have to contend with an HD DVD myFlicks store. But chances are that one or the other would dominate, just as the Apple iTunes Music Store leads all the rest.

The advantages to you and me would include lower prices for flicks which do not have to be distributed physically in bricks-and-mortar stores or shipped via UPS. We wouldn't have to pay for extras we don't want, like alternate-language soundtracks. We wouldn't have to pay for packaging. We could reuse the media at will, if rewritable. We could pair two movies on one dual-layer disc. Et cetera.

iFlicks or myFlicks could even offer us special bonus material not available on prerecorded discs: ways to turn action flicks into video games, user-selectable endings, alternate camera angles, and so forth.

There would be must-have stuff of this sort at iFlicks, but not at myFlicks — and, of course, vice versa — and whichever online store had the best exclusive stuff could well determine the winner of the HD DVD vs. Blu-ray format war.

That's my bit of rank speculation, anyway. Now I'll just sit back and see if anything like it actually comes true.

Tuesday, July 18, 2006

HD DVD vs. Blu-ray (Pt. VII)

In HD DVD vs. Blu-ray (Pt. VI) I commented on this article on the early HD DVD/Blu-ray experience at the Forbes.com website. Now comes this review of the first Blu-ray player, the $1,000 Samsung BD-P1000, by Melissa J. Perenson of PC World. The review is accessible at Ecoustics.com.

Ms. Perenson states, "[Blu-ray] players from Pioneer and Sony that were originally due out around the same time [as the BD-P1000] have slipped off schedule to September and October, respectively." Those would be the Pioneer Elite BDP-HD1 and the Sony BDP-S1, the latter of which I erroneously assumed, in my earlier posts, had already shipped. So the Samsung player is the only Blu-ray machine in town, just now.

(I should also mention that another HD DVD player has joined the Toshiba HD-A1 and HD-XA1 players on the early market: the $499 RCA HDV5000, which is among those players reviewed in the Forbes.com review. The reviewer, Stephen Manes, didn't say much about it that didn't apply equally to the Toshibas, except to mention that "RCA's remote looked cheap but worked fine." Ms. Perenson notes that the RCA shipped in June.)


Ms. Perenson's review of the Samsung BD-P1000 Blu-ray player is not done in great depth, unfortunately. Pluses were the player's styling, ergonomics, and low fan noise. She liked the "circular, pressure-based front navigation panel; ... comfortable, lightweight remote control; ... clearly readable front LCD screen; and ... ten-in-two card reader for loading photos or MP3s."

"Inside," she says, "the [Samsung] player uses a proprietary Samsung processor and what the company describes as 64MB of system memory." She goes on to give her mostly favorable impressions of the two Toshiba HD DVD players, as well. She then says that the Samsung player operates and accesses hi-def discs and chapters somewhat faster than the Toshibas (hers admittedly lacked the most recent firmware update) but still not all that swiftly — though no such slowness problem occurred with standard DVDs.

The acid test, though, is how well these players render hi-def video, about which Ms. Perenson says:

Among the Sony and Lionsgate Blu-ray movies I watched, I observed a distinct trend toward images with more noise than I might have expected from a high-definition image; however, other titles, such as Ultraviolet, were sharp and eye-catching. (My experience with HD DVD was similarly mixed, with an opposite tilt.) Nonetheless, compared with their standard-definition versions, these high-def films generally showed a marked improvement.

I'd say the jury is still out here. After all, as her review states:

Both formats use the same video codecs (MPEG-2, VC1, and MPEG-4 AVC), and both are capable of producing stunning images. However, a slew of variables that have nothing to do with the format per se can affect how a movie displays in high definition, including the condition of the original film negative, the codec used to encode the video, the quality of the encoding process, the bit rate of the encoding, and, on the player itself, what chip set is being used to decode the video. Another critical factor: What were the intentions of the director and cinematographer? Some films are purposely shot soft, others are shot dark and grainy, and still more are shot oversharp and vibrant.

As I mentioned in a previous post in this series, the Blu-ray camp has ill-advisedly limited its first disc releases to old-fashioned, inefficient MPEG-2 video compressions on single-layer discs. I'd say the "distinct trend toward images with more noise" which Ms. Perenson laments might well be the expected result ... and it could go away with future disc releases.

Ms. Perenson also complains that the Samsung BD-P1000 Blu-ray player lacks the USB ports (for future gaming use) and Ethernet port (for downloading additional content and firmware fixes) that the Toshiba HD DVD players have. Thus, this player "will not support many of the advanced interactive features that supporters of the Blu-ray disc format plan to incorporate in movie discs over the next few years." Well noted.

Ms. Perenson observes that, looking to the future, Blu-ray has a seeming edge over HD DVD because it will at some point be able to fit more content on one dual-layer disc. But the format war with standard DVDs will be won not as much on that score as on (per the Blu-ray Disc Association's Andy Parsons) "how many new titles are coming out on a regular basis, and how much we can convince people that this stuff is better than standard DVD."


To that I would add: most people won't buy either new format until one of them issues a "killer app." It could come in the form of a make-all-your-friends-jealous movie such as Pirates of the Caribbean: Dead Man's Chest, whose Curse of the Black Pearl predecessor has already been named by Buena Vista (Disney) as an upcoming Blu-ray-only title.

Or it could come in the form of a dynamite convergence of home theater, Internet, and video gaming. Both camps, HD DVD and Blu-ray, tout the possibilities here. The first Toshiba HD DVD players have the requisite Ethernet port for Internet connectivity and even allow the user to configure an IP (Internet Protocol) connection, just as with a computer. In the future, hi-def content from a disc could be dovetailed with content from the Web for a highly interactive, movie-plus gaming experience.

Microsoft is backing HD DVD (see this article) and "plans to deliver a new Xbox 360 external HD DVD drive [this year]. The new drive will offer millions of Xbox 360 owners the ability to easily enjoy HD DVD movies and will provide consumers with even more choices for experiencing high-definition content, in either physical or digital form." Xbox 360 is, for those who don't know, a gaming console that will compete head on with Sony's Blu-ray-capable PlayStation 3 when the latter arrives in fall 2006.

But as noted, the Samsung BD-P1000 Blu-ray player lacks network connectivity. Until more Blu-ray machines get here, it is HD DVD players that are in the better position to converge disc content, gaming, and Internet access into one bodacious killer app.

Monday, July 17, 2006

HD DVD vs. Blu-ray (Pt. VI)

After I wrote HD DVD vs. Blu-ray (Pt. V), in which I discussed the audio capabilities of Blu-ray discs and players, I discovered this snippet at the Digital Bits website which suggests that the first Blu-ray disc titles have linear PCM 5.1 audio tracks (!):

Okay... a little bit of follow-up on my experience with Blu-ray disc and [the] Samsung BD-P1000 player. ... Let me just say that the PCM 5.1 uncompressed audio on these Blu-ray discs is absolutely spectacular. Smooth, rich, enveloping... these audio tracks are just really impressive. It's a lovely experience listening to these discs.

It doesn't say what other audio tracks, if any, there are on the first BDs. But linear PCM 5.1 is the gold standard of multichannel audio ... barring LPCM 7.1, that is. LPCM is uncompressed, so the entire soundtrack can be recovered by the player, with no compromises.

If LPCM 5.1 is in fact the standard audio format that most or all Blu-ray discs are going to be blessed with, that puts them one up on HD DVDs, which focus on lossily compressed Dolby Digital Plus encodings.

And let me emphasize again that the LPCM tracks on Blu-ray discs will play back at their very best over HDMI, with "PCM" selected in the player instead of "bitstream" — that is, if you also have an outboard HDMI receiver that accepts multichannel LPCM that way — or via the player's six analog-output RCA jacks.


I'd go so far as to speculate that uncompressed, multichannel, so-called linear PCM audio is actually the dark-horse form of audio in the incipient hi-def disc format wars. We've heard a fair amount about Dolby Digital Plus and DTS HD, two lossily compressed multichannel audio codecs these discs either use now or may incorporate in the future. And Dolby TrueHD and DTS HD Master codecs are set to afford us losslessly compressed multichannel sound.

But HD DVD players have to decode those and also standard Dolby Digital and DTS to linear PCM in order to deal with "advanced content" audio. All HD DVD discs available in this country so far feature that: a way, also called iHD, to allow interactive video and audio materials from the disc — mainly menus and their associated sounds — to function while a movie is playing.

Once multichannel audio from the disc is translated into LPCM and its various constituents are mixed together as needed, it has to be — by the first Toshiba HD DVD players to arrive on the market, the HD-XA1 and HD-A1, at least — re-encoded into standard DTS if it is to be shipped to an external receiver or processor in the form of a "bitstream." Re-encoding to standard DTS recompresses the signal. This is so whether the bitstream is sent out on HDMI or on the S/PDIF coaxial or optical digital outputs.

A better option is to send 5.1-channel analog audio from the player out to the receiver or processor — if it can accept it, that is. That involves no recompression.

Another equally good option is to send 5.1-channel linear PCM audio — i.e., uncompressed digital audio — from the player to the receiver or processor. This has to be done over HDMI. S/PDIF doesn't have enough bandwidth to handle it. That digital form of retransmission again involves no recompression.

But few receivers/processors today support it. Future receivers almost certainly will — particularly if they implement HDMI 1.3. The current HDMI standard, 1.1, is supposed to allow for multichannel PCM, but few of the HDMI-capable receivers now in existence actually support it.

Meanwhile, Blu-ray players and discs already support straight-through multichannel LPCM on input, internally, and on output — with no compression during disc authoring, no decoding by the player, no re-encoding in another format, no recompression. LPCM in fact looks to be the default audio format for Blu-ray discs and players ... which gives Blu-ray a small but possibly significant advantage over HD DVD.

***


After I wrote my prior post I also discovered this excellent article on the early HD DVD/Blu-ray experience at the Forbes.com website. You'll have to register (for free) to read it. It's author, Stephen Manes, likes the new formats' "video with six times the resolution [of standard DVD] improved audio and interactive features like pop-up menus, video commentary that can play along with the movie and the ability to bookmark favorite scenes. ... Watching the best [of the new discs] after viewing an old-fashioned DVD is like coming home with a new eyeglass prescription."

Yet he finds "
plenty of reasons to wait" to buy into either of the new formats. For one thing, "to see and hear every last bit of the newly revealed detail takes video and sound systems that most people don't have." Also: "For now, there are fewer than 200 hi-def discs available. And, as commentators enjoy ranting about, those discs are arriving in two utterly incompatible formats."

Manes says the broader intial support by movie studios and consumer electronics manufacturers for Blu-ray over HD DVD won't necessarily decide this format war. Why not? Sony's "
PlayStation 3, initially thought to be the Trojan horse that would bring Blu-ray into the home, turns out to be later and pricier than expected. And in the early going, HD-DVD has had some surprising short-term wins."

"For example," Manes says, "HD-DVD movies are coming out on 30-gigabyte dual-layer discs, while Blu-ray titles have been limited to 25-gigabyte single-layer platters with dual-layer versions dimly on the horizon. And early Blu-ray titles use old-fashioned [MPEG-2] compression that eats up disc space. HD-DVDs typically use newer, more efficient methods [VC-1, AVC] that cram far more stuff into the same space, with similar quality. Blu-ray discs can use those methods, but at the moment they don't."

So if Blu-ray has a slight advantage over HD DVD in terms of audio quality, the Blu-ray camp clearly goofed in not putting out its debut discs using two layers and efficient modern compression methods. It has thus for the moment squandered Blu-ray's nominal capacity advantage over HD DVD, which is why there are complaints that the first BDs boast few extras.

Those extras which are there are retreads from standard DVDs. Says Manes: "
But extras recorded in standard definition tend to look lousy. When the bonuses start getting shot in hi-def, the advantage should go to Blu-ray, with its potential for more room."

Manes also chafes at the fact that, unlike with HD DVD players, with
today's Blu-ray players the bookmarks you set "disappear the instant you open the tray."

Manes notes that HD DVD players can output only interlaced 1080i video, not progressive 1080p, as Blu-ray players can. "Though 1080i introduces some real but generally unnoticeable 'artifacts' that can slightly distort motion onscreen," he says, "1080p creates a different set of motion artifacts all its own."

I would differ with that last statement, as it applies to movies. If 1080p is output at 24 frames per second — the frame rate of film — or a multiple thereof it creates no motion artifacts. But if it's output from the player at 30 or 60 fps, it does. It then develops an irregular, stuttering cadence, due to the fact that the output frame rate is not a multiple of 24.

This is why 1080p TVs of the future will need to handle input frame rates of 24 and its multiples: 48 fps, 72 fps ... and even up to 120 fps, since that is the lowest common multiple of 24 and 30 or 60 (used for material shot directly to video).


To continue with Mr. Manes' discussion, though:

Another short-term Blu-ray advantage: better sound. Its uncompressed [linear PCM] audio tracks are said to sound much like high-end DVD-Audio or SACD discs — in other words, significantly better than what you currently get on DVD. I don't have the proper equipment to test that claim, but it's safe to say that to hear the difference, you'll need a system better than the typical home-theater-in-a-box. And HD-DVD discs with uncompressed audio are supposedly on the way.

That bolsters my own ideas, stated above and in earlier posts.

Manes lists various complaints about the first HD DVD and Blu-ray players — they're
fairly minor, but for some potential early adopters they could be deal breakers — then goes on to suggest that the new formats (and standard DVDs upconverted to 1,080 lines for playback) look best on TVs that handle 1080p input. Hi-def discs from the two formats, he says, do look "slightly better than hi-def movies I'd recorded on my cable DVR." They look especially good, he notes, using "Sony's astounding SXRD front-projector, aimed at a 100-inch Stewart Firehawk screen":

... if you want to keep your friends, invite them over to see this [he writes]. Watching movies by reflected light, the way they were intended to be seen, on a big screen that brings the theater experience to your home--only without dirty prints, smudges on the screen, uncomfortable seats or people in the row behind you on their cell phones--takes movies back to the way they were meant to be.

As with the audio capabilities, you clearly need the latest and greatest video gear to really appreciate HD DVD and Blu-ray.

There's also the worry, Manes says, that both camps might start including the dreaded Image Constraint Token on future discs. It would force players to stop outputting 1,080 lines of video resolution on any output but copy-protected HDMI. The video from disc would be down-rezzed to 540 lines or 480 lines on component video, so hi-def analog copies, re-digitized and then re-recorded, would become impossible.

Manes winds up by concluding:

... what might happen while nobody's looking is that downloads, not discs, become the winning format in hi-def. The Internet is getting faster. Cable and satellite companies are offering more high-capacity video recorders to let you capture their hi-def channels and over-the-air HD broadcasts that won't cost you an extra cent.

So if you really want to participate in the hi-def future, hold off on the disc player for now. Put the money into the kind of big 1920x1080 display that will showcase true HD.

Excellent advice, I'd say.