Interviewed by Dale Cripps in 2001.
Mark Shubin ranks among the best of the best television engineers today. He brings more than 20 years experience to every production along with a wealth of television history and lore. A consultant now to many large communications companies both here and abroad he took time out from his busy schedule to talk to us about the production of an opera produced in 720p with the Panasonic production truck, the same one used for many of the ABC produced Monday Night Football games. Mark talks about some of the characteristics of HDTV which differ from the older standard.
We recently shot an opera in Washington. The first Opera I shot in HDTV, which was not the first show I did in HDTV, was Semiramide at the met. We did that completely differently from the way that we would do other operas that we shoot at the met, because the HDTV technology was so restrictive.
The cameras were not placed where the director wanted them; the cameras were placed where the camera cables would allow them to go. We didn't record as many cameras as we would like, because there weren't that many cameras available for HD.
We didn't get the shots that we wanted, because the lenses were very restricted.
We couldn't get very many lenses. The cameras were tremendously insensitive, so we were very restricted in what we could do with lighting, and even then, if somebody moved, and was wearing some jewelry, the jewelry would stay on the screen after the person moved, the cameras were so sticky!
It was an era when everybody not in HD was using solid-state cameras, and in HD you had to use tube cameras. The tape machines that we used were open reel machines, and they recorded wonderful pictures, if you could get them to work, but to get them to work, you had to do something called "burnishing the tape", which meant that you had to run the tape through the machine without recording on it, and then take the reel off, and clean the heads afterwards.
It was a very difficult period to do anything in HD. That period, for the most part, is over.
HDTV NEWS: When did that give way, completely?
It's been a gradual process, but now there is very little that you can do in NTSC
It's been a gradual process, but now there is very little that you can do in NTSC, that you can't also do in HD. The truck that I shot in in Washington is a real TV truck. It's got distribution amplifiers and routing switchers (when we did Semiramide we had to patch with three wire patch cords; that's all done; we just route signals around now). The cameras went exactly where the director wanted them, and there was no problem running camera cable. There's plenty of camera cable available. It's fiber optic camera cable. In fact, because we were using ABC's Monday Night Football truck, and they needed lots of camera cable, and we needed lots of camera cable, we actually got some camera cable from a different source, and the camera cables are all standardized now, so that's pretty easy to look like [??].
The lenses that we used are basically the lenses that the director wanted. We had six very long telephoto zoom lenses, because they are now available for HD. All of that has improved tremendously. It is now possible to do almost anything that you can do in NTSC. There digital effects and there are significant switchers available for HD. There are camcorders available for HD now--two different ones. It's no longer this really, really strange thing that you can't shoot in, and the sensitivity has been improved tremendously.
The one area that still seems to be lacking significantly, is monitoring, but it's not so lacking that you can't do a show. You can certainly do a show in HD.
HDTV NEWS: What do they need to improve in monitoring?
The one area that still seems to be lacking significantly, is monitoring
We need to get affordable, relatively light weight, high quality monitors for HD, and that doesn't exist. There are heavy, gigantic guys from Sony and Panasonic, which make lovely pictures, but it's very difficult to position them, and if you were going to make a monitor wall, as they're doing, say, in the ABC Monday Night Football for Panasonic, the wall (of monitors) would just weigh so much the truck would probably fall over on it's side. So instead, they went with plasma panels, and LCD displays. Those are severely lacking in quality. Even in the video area, this being a 720P truck--somewhat more restricted--they were using Barco computer monitors, rather than video monitors.
Monitors are good--the pictures were fine--but they lack a lot of the facilities that one would normally expect to have in a video monitor.
So, it was a small shortfall--not critical--we were certainly able to do a show. There's down conversion (for) all of that. That works. As I wrote, it's not impossible to do HD shows any more. The big problem is when you're doing an HD show in the NTSC universe.
HDTV NEWS: Is there a kind of a mis-match there? What should the future user of this equipment look for? What do they need to protect themselves against?
That's a very difficult question to answer, but I can give you lots of the problems that we run into. For example, we shot opening night at Carnegie Hall in 1998 in HDTV, and we had previously been shooting opening night at Carnegie Hall every year in NTSC.
Again, the facilities were fine--we had an NHK truck that we were using for that. The cameras were terrific; cables, lenses, everything was fine. We had to do some interesting out-boarding because it was an HDTV truck, but we were going to be editing off-line, so we needed tapes to be able to feed the off line editor. That was NTSC, so we actually had to pull over a second truck, just to deal with the NTSC stuff, but that's sort of an operational difficulty, that's not an insoluble problem.
The insoluble problem came about in this regard: The director, who was in the HDTV truck, was looking at a very good HDTV monitor, and he was seeing very good HDTV pictures. He decided on a shot that had the two featured singers, who were Brian Stokes Mitchell, and Audrey Ann McDonald, and had them in full figure--the conductor on the left side of the frame, and members of the orchestra behind. It was an absolutely glorious shot. You could see the two singers interacting with each other; you could see their faces, and the look in their eyes, and the conductor appreciating them, and the orchestra appreciating them, and it was an absolutely magnificent shot. Everyone who's seen the show in HD says "wow, what a terrific shot, what a great show. This is terrific".
But then we have to air the thing. There is not a great deal of HDTV airing available yet, so we have to convert the show to NTSC. We chose to use letter-box to deal with the aspect ratio problem. That meant that people watching the show on NTSC got to see only 360 lines of television. We started with 1080, so they now have one third of the vertical resolution that we started with.
In horizontal terms, we started with 1920 pixels per line, and a typical NTSC television station can, at best, transmit 440 pixels per line. So we've gone to something like a fifth of the resolution horizontally, a third of the resolution vertically. So now this wonderful, beautiful shot that the director had gotten, and it was such a good shot that he lingered on it, having no reason to change it, in NTSC becomes an establishing shot, and the NTSC viewers are looking at this, and going . . . "hello . . . when are we going to be able to see their faces?"
They could not see any of this interaction. Instead of it being a beautiful shot, it was a boring shot, and one that was lasting for a very long time. So that's one enormous problem. It's an esthetic problem, and the question is, what do you do? Do you shoot in HD . . . go for the HD shot? Unquestionably, it was a glorious HD shot; it was a beautiful HD show. Whether you do that, and say "ok, well, I'm shooting for the best stuff, or do you instead, give the director an NTSC monitor, and say make me a nice NTSC show, and then the HD people get sort of a boring show--maybe a little better looking than NTSC does--or do you try to do some compromise in between, and dissatisfy both sides?
What has been happening in places like when CBS did their coverage of the US That meant that people watching the show on NTSC got to see only 360 lines of television.
That's great if you can do that. We don't have the facilities in the kinds of shows that we do to do that, and so we've been suffering.
HDTV NEWS: So there will be a suffering period as we make this transition over the years. Unless people are willing to do dual productions, we're going to have a compromise that is a little bit distracting to both sides.
Does that suggest to you that, as David Niles, and others have been saying since the beginning, that HDTV is entirely a different and separate business from the NTSC business, even though it looks an awful lot the same?
I'm not sure which of the David Niles quotes you are referring to. He has said on a number of occasions, and a bunch of other people have said, that HDTV is not film, it is not video, it is something completely different. That, I don't think, is relevant to this discussion, but you used the term "business", and if he has been saying that it's a different business, meaning that you need to deal with it separately; yes, I'd go along with that.
HDTV NEWS: Latency versus quality?
Ok, this is something that we ran into in Washington. This is a different side of the HDTV and NSTC universe. The stuff that I just mentioned is the problem of broadcasting to a NTSC audience. The other problem you run into is if you are going out, and you are shooting some single camera stuff, like the "Over America," "Over Canada," all those series, or you're shooting a studio show, or something like that, you're pretty much self-contained in HD, until you go into editing and have to down-convert for NTSC airing. But what if you're doing a real NTSC live show on the order of, let's say Monday Night Football, and what if you're doing it as the only truck, not with two trucks?
Well, now you have a bunch of situations. You've got an announcer some place, and the announcer needs to see the show, so he needs a monitor to look at. In NTSC, that's a hundred dollar monitor that you stick in front of the him, and run a line up to it. In HDTV that's maybe a $4,000 monitor, and I'm talking about something inexpensive like a consumer-type monitor. It's big, and it's heavy, and the line that you run up there...let's say that you're using the high definition serial digital interface, HDSDI, that's one and a half gigabits of information. You can't run that very far. We ran into that problem in Washington. The lighting director normally sits in an area at the opera house at the Kennedy Center called the translation booth. That's about 700 feet of cable run from the truck. You can't run HDSDI over 700 feet on a piece of coaxial. You could maybe do it with fiber, and if we have time to rig that up, and have the equipment, we could maybe do that. So that's a problem.
We had a separate sound truck in Washington. The sound people are looking at a monitor to see where the singers are, and what's going on, and we fed them something called the low-latency down-converter. It's actually part of the distribution amplifier, and it essentially down-converts at the same timing that the real signal is going out. That meant that they were seeing pretty lousy down-conversion. Well, we had good down-converters available; we had the Panasonic Universal down-converter, which is terrific, and even the down-converters built into the HTD 5 machines are terrific, but they take time to do their work, which meant that if we fed that to the sound-truck, which we ultimately did do, they're looking at something that's out of sync with the audio that we're hearing.
Ok, you can take care of that. The Universal down-converter, and the HTD 5 have separate audio outputs that match the down-conversion, but now you're asking the audio people to be listening to something which is not what they're mixing. So you run into all these complications.
Here's another situation we have...again, there's sort of a paper edit that gets made before an off-line edit on a standard computer non-linear system before the on-line edit. Well, for the paper edit, we prepare a vhs tape that has a quad split in it. The quad split is the four main recordings that we're making. It's an NTSC show; you're degrading the quality already of the NTSC by making the quad split, and then you're putting it on vhs, which degrades stuff still further, so HD, if we did that with letter-box output, would be such tiny pictures , and so degraded, that the editor couldn't really tell anything.
He wanted us to make anamorphic outputs for the quad split. So, ok, fine, no problem, the Panasonic machines will deal with that. But meanwhile, the lighting director wanted to have a VHS of the program feed, which was not anamorphic. He wanted to see that in letter-box, so that he could see what the actual show looked like. So now we have a different mood, and we need a different down-converter. If we were feeding the press, as we've done, say, at Carnegie Hall, then we need to down-convert to something that is neither letter-box nor anamorphic, because the press doesn't want to have letter-box on their news shows, they want to have full-screen, so now we have to come up with a center cut or a pan-and-scan type of thing.
Now we're talking three different kinds of down-conversion...not counting the fact that we have different latencies; not counting the fact that there are different qualities that are associated with latencies, so it just becomes a bit complicated.
HDTV NEWS: It's a bit complicated, but these are problems that are not likely to ever go away, are they?
Not while we are dealing with two different forms of television. As long as we're dealing with both HD and NTSC, these problems are not going to go away.
HDTV NEWS: You mentioned focus being a big issue. How does that trouble you, or not trouble you?
Well, it's troubling! In dealing with focus, we refer to something called the circle of confusion. The circle of confusion is a small circle, anywhere within which you cannot tell whether something is in focus, or out of focus, so you can think of it as being a pixel. If something fits within one pixel, it's in focus, if it doesn't fit within one pixel, it's out of focus. That's a little over-simplified, but it's ok to think of it that way.
An HDTV pixel is much smaller than a NTSC pixel, and so if you work out the formulas for depth of field, and so on, that are all based on this circle of confusion, you find that things are much more difficult to focus on in HDTV than they are in NTSC. That's just straight-forward. That's assuming all else is equal, but all else is not equal, because the cameras are also a little less sensitive. So if you're dealing with a lot of light; if you are in a studio or something like that, then you just have to deal with the circle of confusion issue. If you're dealing with low light, then you also have to face the problem that the lenses for an HD camera are going to be opened up a little wider than the lenses for an NTSC camera.
Then you have a third problem, which is, if you're shooting with an inch and a half viewfinder, you have this little teeny tiny picture tube that you're looking at, and you need to focus in HD on something that may not be able to present you with a true HD picture.
C. R. Caluette gave a really terrific paper about that at the ITS Technology Retreat last year. He said you really need the largest monitor that you can take around with you on your show, because you're not going to be able to tell focus in your tiny viewfinder.
What's interesting is, in the previous generation of cameras, the Sony HDC500, there was a remote focus control, so that the video operator could help out and do fine focus. The latest cameras don't have that. Also, the latest cameras using two thirds inch imaging devices don't have lenses for them that match the quality of the lenses that were available for the one inch cameras. So, in a way, we've come an additional generation forward...there are now HD camcorders, for example, which there weren't before, but we've taken a step backward in terms of picture quality, I think. The latest cameras are not up to the snuff of what the previous possibility of camera and lens were. I'm not saying it's just the camera. It's the camera/lens combination.
HDTV NEWS: As an engineer, are there any serious shortcomings today that you just wish the camera designers would have addressed? Can you help give them a little engineering feedback?
I would like monitoring to be addressed, more than cameras. On the camera issue, I think that the bigger problem is the lens. I think that the cameras are pretty good. There are some minor things that need to be worked out. There were some problems that we had in Washington, but those were prototype cameras of the 720p mode. I think the cameras are pretty good, but having gone through the two thirds inch chip, there is a big problem in terms of detail resolution. It is not as good as the previous generation of cameras was.
HDTV NEWS: Are these lenses that are being used the same lenses that were used for NTSC?
Some people do that. I wouldn't. I think that's a bad idea, but I'm told that that's one of the reasons that the shift in the cameras to two thirds inch was done; so that people could use their NTSC lenses. There's a big difference between an HD lens and an NTSC lens, but again, it depends on what you're looking at it on. A lot of people go out in the field, and will shoot something, and will look at it on some monitor that doesn't really have true HD resolution, and they'll say "oh...I can't see any difference with this lens at all...this looks fine", and then they will air it, or show it someplace where there is a really high quality HD projector, and you're looking at it, and you go "boy, this looks awfully soft, compared to the other stuff you shot", so I think that's a big problem. I don't think that was properly done.
HDTV NEWS: Getting back to the monitor story, some of the producers have said "you know, you really need to produce this on a monitor that offers a 30 degree field of view that you expect the end-viewer to be experiencing. That would suggest a larger monitor.Is that called for?
I have mixed feelings about that. If you look at human vision, and where it pops out in resolution, you find that you actually can't see HD resolution without having a large monitor, or being closer to it. If you were to scale up...In an NTSC truck, the director typically looks at a 20 inch monitor...in an HD facility you'd probably want something on the order of a 50 inch monitor, and nobody's really doing that yet.
What I found, in sitting in the truck at the Washington Opera, was that the little 17 inch STI LTD panels looked noticeably sharper to me than did the 42 inch platinum panels. Even from considerably farther away, (too far, in my opinion, to see the HD resolution), one of two things was happening. Either the platinum panels were so awful, in the resolution that they were providing, that I would notice it from the STI's, or there was some contribution sharpness being made. So, I'm not prepared to give an absolute answer to your question, at this point, but I think that there are certainly reasons to believe that what you said might be true--that you may have to go for larger monitoring.
HDTV NEWS: In the different cameras on the market today...are they functionally about the same? In other words, a man trained on one could easily move to the other?
Yes, sure. There are slight differences, but nothing special.
Posted by Dale Cripps, June 18, 2005 11:36 AM
No Category Assigned