Simulation: Fact or Fantasy?
Appears in Print As: Orr on Engineering: Simulation: Fact or Fantasy?
Years ago, I wrote about the nature of engineering design in my then CAE Magazine column. A NASA engineer took great umbrage at my calling the process “trial and error.” He sent me angry e-mails and copied much of NASA, saying I was undermining the credibility of engineers by using a term that includes the word “error.” He said this implies that mistakes are part of the engineering process, which, in fact, is thought-out, methodical, and reason-based.
Of course, “trial and error” is not about mistakes — it’s about our inability to predict the behavior of complex systems. We create a design that we think addresses the design challenge. Then we build a prototype and test it.
The difference between desired and actual behavior is the “error.” We use this valuable information to modify the design, and hope that the next iteration yields behavior closer to what we wanted.
I emphasize “hope” because, in many designs, we don’t know what changes will, in fact, bring us closer to our goal. We have experience, intuition, and educated guessing as guides. But seldom do we have hard science or math to back up our iteration decisions. There are few iterative design processes that are guaranteed to produce the desired behavior.
In general, this is not a problem. Experience, skill, and intuition combine in the engineering process to produce great results as documented in Machine Design and other publications and seen throughout the world.
Creating computer-based models that include behavior is where CAD is going and its ultimate purpose: It provides a frame in which the trial-and-error process can take place far more quickly, safely, and inexpensively than in the building of physical prototypes.
This trend helps engineers be more innovative and create new designs more quickly and reliably than ever before. But to say that simulation works, and is a good thing, is not to imply that we have learned how to best optimize. Can we always ensure that the iterative process converges on the best possible solution for the design conditions? That’s math, physics, and other science we haven’t mastered yet.
So when I read a recent white paper published by an engineering-automation software firm that I know and respect, I felt they were giving a false impression by saying: “The goal of simulation-driven design is to converge on optimal solutions as rapidly as possible. By exploring diverse concepts early in the process, engineers can quickly understand the design approach that will best meet performance objectives and use that concept to specify detailed design.”
Yes, that’s the goal. And exploring diverse concepts early in a digital environment, where the exploration is cheap, safe, and fast, is wonderful. What I object to is the claim that by doing so, “engineers can quickly understand the design approach that will best meet performance objectives...” That is too much to promise.
Simulation-based design is the best we can do right now, and the firm that produced the white paper is on the leading edge of all that is good in this field. But it would be a mistake to think that the process now yields optimal results. By all means, simulate and strive to optimize. But do not think for a moment that the current tools do it all.
— Joel Orr
Stuck for business ideas?
Drop me a line: joel@joelorrcoaching.com
Edited by Leslie Gordon
© 2012 Penton Media Inc.
Delicious
Digg
StumbleUpon
Reddit
Magnoliacom
Newsvine
Furl
Facebook
Google
Yahoo
Comments
My statement you quoted
Joel, Thanks for your commentary and your compliments. I am the author of that paper, so please allow me to clarify. (The paper is available here, registration required: http://www2.spaceclaim.com/LearnMoreNow/WhitePapers/CAE-White-Paper-Down...)
My writing treats "simulation" as an equivalent term for "computer-aided-engineering" (CAE). Although that simplification holds for the context of the paper, it is not entirely true. CAE is a subset of simulation. Instead of saying, "engineers can quickly understand the design approach that will best meet performance objectives...," I could have said "...are likely to best meet performance objectives...." Your feedback is appropriate.
However, the spirit of the paper is not limited to computer-based simulation. For example, we learn dimensional analysis so we can build and test scale models that simulate how full-scale models will perform. We create mockups so we can test usability before committing to a product concept. From aircraft to toys, early-phase optimization is critical to product success. But the idea of simulation goes even further than that. For many products, the cost of modeling a detailed design in CAD exceeds the cost of making prototypes for destructive testing. In these cases, CAE may only offer incremental benefits over physical testing. Even physical testing of prototypes, however, cane be considered a form of simulation. Prototypes can be machined or 3D-printed, giving them different physical properties than cast or molded prodcution parts. And even production parts vary. In a sense, every test is a form of simulation.
In summary, test early, test often, and test any way you can. Test with CAE, test in the lab, and test in the field. Use whatever tools you have at your disposal to make sure your design ideas are going to work. Once you're confident in the basic idea, optimize the model. Then, detailed design can commence with a well-specified and highly-engineered concept.
-Blake
Simulation and Engineering Fundementals
A generation of engineers is being trained to rely heavily on computational aids. For all it's apparent benefits, computer-driven design changes the focus from actual hands-on research, testing, and fabrication to troubleshooting computer software. This is moving a whole generation of mechanical engineers away from developing the intuition needed to understand engineering problems. The intuition that Joel mentions comes from actually building and testing machines, not from watching computer animations.
Mistakes are integral to the engineering process...
Joel, I've heard a couple great comments about the value of mistakes in engineering. The first was John Muskivitch who said mistakes are how we learn our limits. He'd rather drive across a bridge designed by someone who'd made a few mistakes and learned from them than a bridge designed by someone who'd never made a mistake because this person's luck may run out at the wrong time.
The other comment on a similar vein was at a PDMA conference by a professor from Stanford (can't recall his name) that said if you aren't making mistakes, you aren't trying to innovate. The true measure of an engineering organization isn't how many mistakes made but how quickly the mistakes are identified and the lessons put into practice.
A Mistake is What You Make of It
Along the lines of Vince Adams' comments, I once heard that someone asked Thomas Edison how he felt about all of his failed experiments toward inventing the light bulb. His response was something to the effect of "at least I know that many ways NOT to make a light bulb." A mistake is only bad if you know about it, don't learn from it and don't do anything to correct it.
My preferred bridge designer (hopefully) knew enough about the behavior and design of bridges to identify and correct problems using an appropriate balance of all available tools (tests, simulations, building codes, judgment, etc.). While possibly being the designer of Tacoma Narrows Bridge in the spirit of innovation, knew enough not to repeat the design mistake and learned about aerodynamic effects in the process.
Simulation opens many doors to investigation and innovation, but too much dependence on any one approach is a mistake in itself.
"Optimization" and accidental discoveries
A Gedankenexperiment--a thought experiment. Imagine you had the perfect simulation tool, that modeled the physics of your problem 'perfectly'. Set up your problem, the iteration algorithm is optimized, you arrive at the perfect solution. Do you think you might unintentionally miss any of the thousands of accidental discoveries that are due to nonoptimal solutions to your particular problem, but instead lead to an optimal solution to a problem you weren't even trying to solve? I believe you would. For instance, say you had the perfect chemical reaction simulator. You're trying to discover the chemical formula of a new refrigerant. You plug your initial conditions, boundary conditions, etc. into the perfect simulator, and crunch away. You found a new refrigerant, which MAY OR MAY NOT be better than current refrigerant. What you did NOT discover, if you were Roy Plunkett of Kinetic Chemicals, and you had this magical tool in 1938, is Teflon, which, like many chemicals, has bad and good qualities, but in the main, is one of the 20th centuries greatest discoveries in chemistry.
Leave a comment