From: sbharris@ix.netcom.com(Steven B. Harris) Newsgroups: sci.med,sci.med.cardiology,alt.activism,talk.politics.medicine Subject: Re: Backlash against HMOs: a declaration of war (was Doctor-bashing) Date: 17 Apr 1999 11:49:59 GMT In <371778B5.1C2EFFD0@cs.uoregon.edu> Bret Wood <bretwood@cs.uoregon.edu> writes: >"Steven B. Harris" wrote: >> >> I don't know if anyone used the phrase "program in." I know I used >> the phrase "data entry." > >Well, the data entry for the appropriate variables wouldn't be as >difficult as the extreme example you used. It would if it was honest. The problem with use of expert systems in medicine is that it's all theoretical, and relies on assistance of physicians with a few more variables beyond the great many they acount for consciously or subconsiously when they actually are in the presence of a real patient with a real problem. You can find me studies where a computer does better at managing a "paper patient" (made up case, or a selected historical case, presented as already digested data) than a doctor does. But that's not how the real world works. Real problems in medicine don't present as a paragraph of problems in text. They present in the form of a real person who has real complaints. Which may or may not be relevent to the problem. It takes a human mind to sort that out. From: sbharris@ix.netcom.com(Steven B. Harris) Newsgroups: sci.med,alt.activism,talk.politics.medicine Subject: Re: Backlash against HMOs: a declaration of war (was Doctor-bashing) Date: 17 Apr 1999 19:23:21 GMT In <37187FD4.70AE831F@cs.uoregon.edu> Bret Wood <bretwood@cs.uoregon.edu> writes: >"Steven B. Harris" wrote: >> >> If you are talking about virtual Hopfield networks (which I assume >> you are), then, yes, I do. > >Most expert systems have nothing to do with neural networks. So I >guess you don't. I know very well that they don't. However, those were not the ones I was talking about. I was talking about systems in the future capable of observing (which in practice means learning on their own-- since observation is so difficult), so that all that data didn't have to get entered by hand. Expert systems of the type we have now do not work in medicine, except as aids in very narrow areas (antibiotic prescribing, for example, where the system keeps abreast of culture sensitivity reports from the lab at your hospital, and gives you advice based on a simple (but unchanging) algorithm based on those). Or programs like INTERNIST, which require physical exam and patholgy report data (which means a lot of preprocessing by brains). Even with the first kind of system, data entry is onerous, and is made up for only by the fact that the system automatically generates hospital antibiotic orders to sign off on, and monitors further culture developments and antibiotic level values (though this is probably going to be less important as levels of aminogylcocides become less important). In the future, we may see some valuable programs in the ICU, where sensors for continuous and rapidly changing things like vital signs and blood gasses can be tracked by computer and used to deliver better and faster recommendations for fluid managment and ventilator setting changes. Or even to control ventilators directly, by direct feedback without a human directly interupting the loop (the FDA will have a fit at that, of course. This has actually been possible for years, ever since computer controlled servo ventilators and in-line blood gas systems, but has yet to be implemented. Mainly for political reasons). As for expert systems that learn, they won't get through the FDA in medicine until they start saving a lot of lives and money somewhere else. From: sbharris@ix.netcom.com(Steven B. Harris) Newsgroups: sci.med,sci.med.cardiology,alt.activism,talk.politics.medicine Subject: Re: Backlash against HMOs: a declaration of war (was Doctor-bashing) Date: 17 Apr 1999 19:47:15 GMT In <37187F9C.F79E7AF5@cs.uoregon.edu> Bret Wood <bretwood@cs.uoregon.edu> writes: >In specialized disciplines, I can find examples of expert systems >which outperformed real physicians with REAL patients. Not by themselves, you can't. There's always a medically trained person hidden in the "expert system" somewhere. Such combinations are sometimes able to beat a specialist, just as with a computer I can figure out some problems faster and more accurately than a mathematician (not just arithmetic and statistics, but even some symbolic math, as with MATHEMATICA). But that's not too impressive. I certainly could not use a calculator to beat a mathematician if I didn't know any math at all. And with some math problems, a computer is no help at all. We had computer *assisted* chess 20 years ago, which could significantly improve play for all but advanced players-- and sometimes even for them, if they were having a bad day and were tending to make dumb mistakes. Computers have not even needed observational assistance though much of that time, if special boards are used. Still, it was not until very recently that the computer became able to play as well or better as the best players without *judgemental* assistance. Medicine is far more complicated than chess, and it's likely to be much longer before computers make many inroads without judgemental assistance there. >Obviously this isn't _always_ the case, or else expert systems would >be replacing specialists in certain fields. It isn't even more likely the case, or else expert systems would be replacing specialists in certain fields. > But it does tend to show >that the number of variables a physican deals with aren't as vast as >previously thought. No. At best, it illustrates that the number of extra variables which the specialist deals with, over and above that of the average doctor, is less in some disease states than the SPECIALSTS believed. But that's not the same thing at all. The nonspecialists have long suspected it, in fact, for a few things. After you get three specialist consults for the same sort of thing which all say the same thing, you begin to get the message. That's one of the ways teaching happens informally in medicine. Steve Harris, M.D. From: sbharris@ix.netcom.com(Steven B. Harris) Newsgroups: sci.med,alt.activism,talk.politics.medicine Subject: Re: Backlash against HMOs: a declaration of war (was Doctor-bashing) Date: 20 Apr 1999 06:22:03 GMT In <37192425.2A6A4C61@cs.uoregon.edu> Bret Wood <bretwood@cs.uoregon.edu> writes: >A traditional expert system can be linked into a neural network based >visual system. Personally, I wouldn't trust a self-learning neural >network to make any critical decisions until we have a much better >understanding of _why_ they work. The general principles are fairly >well understood at this point, but we really don't have a clue about >how any individual network does its decision making. So trusting >a neural network means you essentially need to trust a "black box", >without any way of validating its decision making process. Just as with any individual human (or, rather, no more and no less). A computer that learns via neural net will certainly start with big set of plain ordinary algorithms, which it will then refine under experience (too time consuming to do it any other way). If you ask why it is doing what it is doing, it will give you the relevent borad algorithm. If you push it, or ask it why it is not applying the algorithm in quite the same way to two patients who would appear to fit it equally, it won't be able to tell you. But then, a human doctor won't either. He or she will just end up saying: "I dunno. It just smells like an MI to me. And I'm not talking about odor." >I would suspect that considering the relatively primitive state >of safety critical sofware systems, it will be a LONG time before >anyone can convince people that a neural network is safe enough >to rely on for critical judgements. On the other hand, a more >traditional expert system, augmented by neural networks for >perceptual information processing would present a system which >has a more "transparent" mode of operation, and could be more >easily verified. Also, explicit sanity checks could be built into >the system, and a failure of the perceptual networks would be >much less likely to result in a catastrophic action being taken >by the whole system. Yes, I suspect you are right, Whether or not this is really the safest or fastest way to do it, is not clear. Part of this lies in what looks to be "transparent" and what doesn't. A helicopter crashes into a mountain at night in fog, and it appears that partly to blame is the practice of flying with night vision optics, which use IR to see through fog, but screw up depth perception. But it looks like you're just using a really complicated set of glasses or goggles with snouts. If the thing was more computerized, and the pilots sat below deck somewhere with a set of VR glasses, or in a "holodeck" cubicle with computer-generated images (which might actually cause less depth perception problem), there'd be a lot more questions. But there's really not much difference between a person sitting in the right place with something opague over his eyes, seeing an electronic image, and somebody sitting where they "shouldn't" be, seeing an electronic image. The only difference is that one is scarier to look at for the passengers. And won't get approved as soon. Even if it is safer. >> In the future, we may see some valuable programs in the ICU, where >> sensors for continuous and rapidly changing things like vital signs and >> blood gasses can be tracked by computer and used to deliver better and >> faster recommendations for fluid managment and ventilator setting >> changes. Or even to control ventilators directly, by direct feedback >> without a human directly interupting the loop (the FDA will have a fit >> at that, of course. This has actually been possible for years, ever >> since computer controlled servo ventilators and in-line blood gas >> systems, but has yet to be implemented. Mainly for political reasons). > >More than just political reasons. I don't recall the name of the >software right now, but there was an X-Ray system a while ago which >had a flaw in the software which ended up massively overexposing >patients. Yes, a couple of people died. After which the FDA decided that now they control and approve all medical software. But you cannot run an industry like this. Imagine two people dying in an airplane accident in the early days of aviation. The Feds now decide they have compete control over the airplane development, and you have to get new designs approved before you can build them. Can you imagine where we'd be? The first guy to die in a powered airplane was about the second passenger in one, a guy named Selfridge who died in a crash with Wilbur Wright himself in 1908. And it gets sillier from there. I saw on a postage stamp the other day a young woman in a violet flight suit and goggles: "Women in Aviation" was the series. Except that this particular woman (though it doesn't say so on the stamp) is famous for advancing aviation by doing a loop in an airshow during which her passenger, not belted in, fell out. After which the woman herself proceeded to do the same and fall out herself. So she and her passenger are dead, and this helped put seatbelts in biplanes. Duh. Had FAA investigations stopped all plane manufacture for such accidents, we'd STILL be in biplanes. We used test pilots and non-test pilots and even passengers up at a rapid rate instead, and went from horse and carriage to the moon in one human lifetime. Just about all the men who delivered airmail with Lindebergh didn't make it though the early years alive. But eventually, modern aviation arrived. Just in time for the country to make rapid progress after sputnik, then chicken out, decided that every dead astronaut should shut down the entire space program for months (Apollo 1) then years (the shuttle). That is the way not to make progress. No guts. There's no telling how many commerical passenger lives and just plain lives (air, sea and land rescue, etc) have been saved by having reliable air transport. Just consider the lives saved by keeping people from traveling those distances in automobiles. And then there are the wars we might have lost, that really couldn't afford to be lost. We're losing a war now-- the war against disease and death. Death by disease and aging is far nastier than the German armies ever were, and it kills far more people every year than Auschwitz ever did, and that just in this country alone. The careful and prudent track is not an option against such an array of horror. But it's what we've decided we'll do. In a democracy, everybody gets what only the majority deserve. Too bad. Perhaps the majority does deserve what it is getting, due to its cowardice. But not everybody does. > The problem with relying on computers for more than the >most basic safety-critical systems is that software engineering has >not progressed to the point where it is really possible to guarentee >the reliabilty of any significantly complex program. Hello? When you're dying of cancer, you don't wait until somebody can absolutely guarantee the safety of the radiotherapy machine software (or anything else about it). First, that's not the way you live the rest of your life, very likely, even when you're well. Second, you're far from well. If you don't do something drastic, you're going to be dead. The FDA will not take responsibility for your safety, then. >> As for expert systems that learn, they won't get through the FDA in >> medicine until they start saving a lot of lives and money somewhere >> else. > >Personally, I think that this is reasonable. If we can have a learning >system make decisions usually left to a doctor, wouldn't it make sense >to field test it in an environment where there aren't enough doctors >in the first place. Yes, but that is often considered unethical. As when they tested several anti-AIDS drugs against placebo in African populations which couldn't afford them anyway. And even if you give everyone active treatment, there is always the question of why you're using poor people as guinnea pigs. Instead of testing a computer on them, why not fly them home to Boston for the best medical care at Mass General, instead? No answer to that. There's really never any answer to the people who feel everyone should have the cheap and reliable medical care, but who don't dare do the experiments it takes to get everyone cheap and reliable medical care. Today, when poor people must travel, on many routes they travel by commercial jet, at 85% of the speed of sound. That's because it's far cheaper per mile than doing it by bus. A lot of people fell out of airplanes to make that possible. Alas, nobody learned a damn thing from it (in general). They have a postage stamp for this dead aviatrix I mentioned, whose name I've forgotten, but it's not for the right reason. There really ought to be one for her passenger. And another for the government officials who just shrugged their shoulders and hoped the flying machines would improve. Steve Harris, M.D. From: sbharris@ix.netcom.com(Steven B. Harris) Newsgroups: sci.med,alt.activism,talk.politics.medicine Subject: Re: The Patients' Bill of Rights (was Backlash against HMOs: a declaration of war) Date: 20 Apr 1999 07:20:13 GMT In <7ff0ud$mco$1@nina.pagesz.net> henryj@nina.pagesz.net (George Conklin) writes: > You raise an interesting point. The medical business >seems to be the only business in the world which wants >government to pay for 100% of the research costs. Drug >companies pay for their own, mostly, but for the rest of it, >doctors don't bother. It's not a matter of whether or not doctors "bother." Research costs money. Drug companies (and industry and other patent-and copyright protected folks) can fund it because they have a mechanism for payoff from new knowledge and novel ideas. Figure out a way for other people in the information industry to profit by results of research, and you'll see a lot more research. As it is, we have information-socialism in many areas, and that's like having agricultural-socialism. Lousy farming results. Allow people to keep some of the fruits of their labors and you'll see something quite different. Even statisticians will be driving BMWs. I've previously suggested that the reason so many academics are socialists is that they envy people in other industries who actually profit from having new ideas. After you yourself have been stolen from a while, as a poor academic, you start to get the idea that maybe EVERYBODY should have to share. Bill Gates, too. Every Man A King... Steve Harris, M.D. |
|