JEFFREY M. VOAS

j.voas@ieee.org

PROFESSIONAL SUMMARY

Jeffrey Voas is Director of Systems Assurance at SAIC and is an SAIC Technical Fellow. Before joining SAIC, Voas was the Chief Scientist and Co-founder of Cigital.  Voas has been highly active in the software engineering research community for over 18 years.  He was the IEEE Reliability Society President for 2003, 2004, and 2005, and serves on the IEEE Computer Society’s Board of Governors for 2008-2010. He co-authored two John Wiley books and is currently an Associate Editor-In-Chief of IEEE’s IT Professional magazine and on the editorial board of IEEE Computer Magazine.  He was the IEEE Reliability Engineer of the Year in 2000 and is a senior member of IEEE.  He has given numerous keynote lectures, and has performed many program chair, general chair, and program committee roles for IEEE and other non-profit professional societies.  He holds two U.S. patents (#6,862,696 and #7,024,592), and has published over 190 publications. Voas’s interests are in various aspects of trust, including software testing, reliability, safety, standards, fault tolerance and certification.  Finally, he has spent much of the last 18 years in business development and mentoring. Voas received his undergraduate degree in computer engineering from Tulane University in 1985, and received his M.S. and Ph.D. in computer science from the College of William and Mary in 1990.  Voas went on and performed a two-year post-doc for the National Research Council between 1990 and 1992 at NASA’s Langley Research Center.

CLEARANCE

TS/SCI granted by AFCAF on 4/29/2008

Based of a SSBI by DSS that closed 12/13/2004

Next PR due before Dec/2009

 

PROFESSIONAL EXPERIENCE

02/05 - Present:  Director of Systems Assurance Technologies, Science Applications International Corporation. 

Dr. Voas currently serves as the Director of Systems Assurance Technologies for the Integrated System Technology Operation. Voas is also a SAIC Technical Fellow.

09/92 - 11/04: Co-founder and Chief Scientist Emeritus, Cigital Incorporated [www.cigital.com] (originally named Reliable Software Technologies), Dulles, VA

Dr. Voas was responsible for general corporate management responsibilities as well as for building the company’s research laboratory.  The research laboratory, at its peak, reached a staffing of around 30 FTEs with a $7M backlog in funded basic software engineering research.  Customers included DARPA, NSF, NIST, NASA, and various DoD agencies.  Other roles included mentoring fresh-out PhDs, writing proposals, publishing, and large amounts of public speaking.

09/90 – 09/92: National Research Council Resident Research Associate (post-doc), National Academy of Sciences at NASA Langley Research Center, Hampton, VA

Dr. Voas was responsible for continuing the research that came out of his dissertation as well as publishing.  The number of papers published during these two years numbered around 30.

01/88 – 05/90: Graduate Research Assistant, College of William & Mary, Williamsburg, VA

Dr. Voas was responsible for helping advisor on a NASA project that was geared toward creating a new family of white-box software reliability models that at that time did not exist.  The project, which resulted in his dissertation, was based on the concept of watching corrupted states propagate though source-code.

RESEARCH CONTRACTS, GRANTS, AND COOPERATIVE AGREEMENTS

1993-1996       NASA Contracts NAS1-19896 ($50,000), NAS1-20207 ($450,000): Quantifying Confidence in the Correctness of Parallel/Distributed Software, contract mod ($30,000) for fault-tolerance research.

1994                NASA Contract: NAS1-20175 ($70,000) A Practical ADA Mutation Testing Tool 

1994                NASA Contract: NAS1-20174 ($70,000) A Design-for-Testability Advisor for Automated Code Generation Systems 

1994                NASA Contract: NAS1-20231 ($130,000) Fortran Testability Analysis for HSCT Flight Simulations 

1994-1997       NIST Contract: 50-DKNA-4-00119 ($50,000), 50-DKNB-5-00185 ($200,000) Testability of Object-Oriented Systems 

1995                NASA Contract: NAS1-20388 ($70,000) A Dynamic Software Safety Tool for Catastrophic Event Prediction of Ada Systems 

1995                NSF Grant: DMI-9461928 ($75,000) A Plausible Software Reliability Framework

1995                US Air Force Contract F30602-95-C-0158 ($76,000): A Software Quality Methodology that Assesses the Fault-tolerance of Un-tested Inputs

1995-1998       ARPA Contract F30602-95-C-0282 ($1,331,409) Quantifying Minimum-Time-to-Intrusion Based on Dynamic Software Safety Assessment

1995-1998       NIST Advanced Technology Program Cooperative Agreement No. 70NANB5H1160 ($2,000,000) A Plausible Software Dependability Model for Component-based Software

1997-1998       US Army Contract DAAL01-98-C-0014 ($100,000); 972-0334 ($650,000) A Tool for Re-verifying Reusable Software Components

1998                NASA-Ames Contract NAS2-98052 ($70,000) An Artificial Intelligence/Fault Injection-based Approach to Software Recovery 

1998                NIST Contract 43NANB811936 ($25,000) Using Fault Injection to Simulate Human Errors 

1999                NIST Contract ($25,000) Taxonomy of OO Fault Classes 

EDUCATION

National Research Council Resident Research Associate (post-doc), NASA-Langley, 1990 – 92

College of William and Mary, Ph.D. in computer science (1990), 1987 – 90

College of William and Mary, M.S. in computer science (1986), 1985 – 86

Tulane University, B.S.E. in computer engineering and minor in mathematics (1985), 1982 – 85

Mississippi Gulf Coast Community College (no degree received), 1980 – 82

Biloxi High School, Biloxi, MS, 1978 – 80

Dissertation

“A Dynamic Failure Model for Performing Propagation and Infection Analysis on Computer Programs”, College of William and Mary, March 1990.

PROFESSIONAL LICENSES, AWARDS, AND CERTIFICATIONS

1999       District of Columbia Council of Engineering and Architectural Societies Young Engineer of the Year

1999       Best Paper Award at the System Safety Society Conference

2000       IEEE Reliability Society’s Reliability Engineer of the Year

2000       IEEE Third Millennium Medal

2000       Meritorious Service Award from the IEEE Computer Society

1999       Inc. 500 listing of the fastest growing privately held firms in the U.S. for Reliable Software Technologies

2000       Inc. 500 listing of the fastest growing privately held firms in the U.S. for Reliable Software Technologies

2009       IEEE Computer Society Golden Core Award

PROFESSIONAL SERVICE

Professional Memberships and Offices

1996 - 1998           Member of the IEEE’s Computer Assurance Conference Board of Directors

1998 - 2000           Secretary, IEEE Reliability Society

1998 - present       Member of the IEEE-USA Technical Policy Council on R&D

1998 - present       Adjunct Professor of Computer Science, West Virginia University

1998 - present       Member of the Board of Governors for the Center for National Software Studies (CNSS)

1998 - 2000           Chairman of the IEEE Computer Society Task Force on Software Assurance

1998 - 2000           Member of the Airlie Software Council (part of DoD’s Software Program Manager’s Network)

1998                      Senior Member of IEEE

1999 - 2004           Council of Technology Advisors for the Gerson Lehrman Group

2000 - 2002           Vice-President, IEEE Reliability Society

2001 - 2004           United States voting member, NATO Task Force on Validation, Verification, and Certification of Embedded Software Systems (RTG-009)

2001 - 2004           Member of the Advisory Board for Underwriter's Laboratory's Standard UL1998

2002                      Secretary, IEEE Reliability Society

2003 - 2005           President, IEEE Reliability Society

2002 - 2004           Member of the University of Florida’s National Institute of Software Test and Productivity Research Coordinating Committee

2004 - 2007           Member of IEEE Software Magazine’s Advisory Board

2004 - 2006           United States voting member, NATO Task Force on Dual Use of High Assurance Technologies (RTG-020)

2004                      Member of the Navy WEAVER team on Software Safety Certification

2004                      Member of the IEEE-USA Technical Policy Council on Medicine

2003-2005             Member of the IEEE Technical Activities Board

2005-2006             Co-Chair of the National Software Strategy Steering Group (NSG)

2006-2012             Past President of the IEEE Reliability Society

2006-2007             NIST Software Assurance Metrics and Tool Evaluation (SAMATE) Reviewer 

2006                      NDIA System Assurance Committee

2007                      IEEE Strategic Planning Committee, TAB

2007                      IEEE Products and Services Committee, TAB

2007                      IEEE Computer Society’s Conference Operations Publication Committee

2007                      IEEE Computer Society Electronic Products and Services Board

2008-2010             Board of Governors, IEEE Computer Society

2008                      TAB representative to the IEEE Information Technology Strategy Committee

2008                      Review Committee of the TAB Management Committee (TMC)

2009                      Chair of the IEEE TAB Conference Platform Committee

2009                      IEEE Computer Society Strategic Planning Committee

2009                      IEEE Computer Society Audit Committee

 

Journal/Magazine Editorial Positions

2001 - 2008           Editorial Board of Software Quality Professional

2000 - 2005           Editorial Board of Software Quality Journal

1999 - 2009           Associate Editor-in-Chief of IEEE IT Professional Magazine

1999 - 2003           Editorial Board of IEEE Software, Column Editor for “Quality Time”

1998 - 2004           Editor of the Quality Time Column in IEEE Software

1999 - 2003           Associate Editor-in-Chief of IEEE Software

2002 - 2006           Editorial Board of Information and Software Technology Journal (Elsevier)

2003 - 2006           Editorial Board for Journal of Information Systems and Technology

2005 - 2007           Journal of Empirical Software Engineering

2005 - 2007           Advisory Board for IEEE Software

2007                      ACM Computing Reviews, Editor

2007                      Editorial board for the new Encyclopedia of Software Engineering, Software Testing, Taylor and Francis

2009                      IEEE Computer Magazine Security Column, Editor

 

Reviewed Scientific Merit

National Science Foundation

National Academy of Sciences

National Research Council

Netherlands Computer Science Research Foundation

Austrian Research Foundation

Chinese Research Foundation

ACM TOSEM

IEEE Computer

IEEE Transactions on Software Engineering

IEEE Parallel and Distributed Technology

The Journal of Systems & Software

Journal of Computer & Software Engineering

Software Practice & Experience

Journal of Software Testing, Verification, & Reliability

Software Quality Journal

Empirical Software

Software Quality Professional

Licentiate Thesis Opponent at Linkoping University, Sweden

South Carolina Space Grant Consortium Research and Education Award Program

Invited/Other Talks

1992    IEEE COMPASS Conference

1992    Nuclear Regulatory Agency, August

1992    Food & Drug Administration, September

1993    Naval Research Laboratory, September

1994    Boeing Computer Services, August

1995    Microsoft Educational Series Videos, May

1996    OECD/NEA Workshop on Nuclear Digital Safety, Munich

1996    Microsoft Educational Series Videos, May

1996    NASA IV&V Lecturer Series, Fairmont, WV

1996    Howard University Colloquium

1996    College of William and Mary Colloquium

1996    Office of Device Evaluation, IEEE/FDA Seminar

1996    Northern Virginia IEEE Computer Society, November

1997    Florida Atlantic University, April

1997    NASA-Ames Research Center, May

1997    Linköping Sweden, June

1998    NASA-Ames Research Center, April

1998    International Function Point Users Group

1998    NASA Workshop on Risk Assessment

1998    Keynote: International Conference on Software Maintenance

1999    The Madrid Polytechnic University

1999    3rd Annual Ground System Architecture Workshop

1999    Fraunhofer Research Institute, Germany

1999    Keynote: NASA Ames Symposium on Software IV&V

1999    SOFT21 Seminar, Linköping Sweden

1999    IEEE Computer Society of Quebec City

1999    Federal EC Coalition Software Quality and Interoperability Working Group

2000    Northern Virginia Chapter of the IEEE Computer Society

2000    NASA Goddard Colloquium Series

2000    Keynote: ICSTEST, Bonn, Germany

2000    Keynote: NATO, Brussels

2000    ASQ, Baltimore Chapter

2000    ASQ, Washington Chapter

2000    NATO, Instanbul

2000    Keynote: ISACC

2000    Baltimore IEEE Reliability Society

2001    Denver IEEE Reliability Society

2000    Keynote:  Malardalen Real-Time Research Centre Industrial Day Seminar in Vasteras, Sweden

2001    American Institute of Chemical Engineers Spring National Meeting

2001    NATO, Quebec

2002    Keynote: HASE

2002    University of Kentucky

2002    Keynote: Malardalen Real-Time Research Centre ABB Seminar in Vasteras Sweden

2002    IEEE Computer Society Information Survivability Workshop

2002    AQC Annual Meeting, Denver

2002    International Conference on COTS-Based Software Systems (ICCBSS)

2003    Clemson University Computer Science Department

2003    IEEE Reliability Society (Philadelphia Section) Banquet speaker

2003    Motorola Annual Software Engineering Conference

2003    Keynote: Euromicro in Antalya, Turkey

2003    Keynote: ASQ 2003 Forum, Baltimore MD

2004    Naval Post Graduate Workshop on Software Fuzes

2004    DoD’s Conference on the Acquisition of Software Intensive Systems, Arlington, VA

2004    Keynote at ICSE 2004 workshop entitled "Models and Processes for the Evaluation of COTS Components", MPEC'04

2004    Malardalen Real-Time Research Centre, March in Vasteras, Sweden

2004    Penn State University, Computer Science Department, Malvern, PA

2004    Philadelphia Chapter of the IEEE Reliability Society

2005    Minneapolis Chapter of the IEEE Reliability Society

2005    FBI Headquarters, Washington, D.C.

2005    Institute of Information Security, University of Tokyo (3 talks)

2005    University of Kentucky

2006    DHS Software Assurance Forum

2006    University of Maryland, Fraunhofer Institute

2006    Keynote, A-MOST, ISSRE

2007    Invited talk: IEEE International Workshop on Safety of Systems

2007    Invited talk: Penn State University at Great Valley

2007    Banquet Speaker, IEEE International Conference on Web Services

2007    Stony Brook University, Long Island NY

2007    Colloquium: U. of Texas at Dallas, Department of Computer Science

2007    Invited talk: IEEE High Assurance Systems Engineering Conference, Dallas, TX

2008    Invited talk: Stevens Institute of Technology, NJ

2008    Invited talk: DHS Annual Software Assurance Forum

2008    Invited Key Note:  Oak Ridge National Laboratory, Knoxville, TN

2008    Invited: Shenzhen University, China

2008    Invited: Chulalongkorn University, Thailand

2008    Invited: Ho Chi Minh City University of Natural Sciences (HCMUNS)

2008    Invited: IEEE/Boeing Technology Conference, Seal Beach, CA

2008    Invited: ICSI, Braslia, Brazil

 

Program Conference Committees and Program Chairs

Program Committee                Annual Oregon Workshop on Software Metrics, 1992

Advisory Board                      11^th International Conference on Testing Computer Software

Advisory Board                      12^th International Conference on Testing Computer Software

Program Committee                International Symposium on Software Reliability Engineering, 1995

Vice Chair                               IEEE Computer Assurance, 1996

Advisory Board                      13^th International Conference on Testing Computer Software

 

Program Committee                2^nd ICECCS, 1996

Program Committee                3^rd IEEE International Software Engineering Standards Symposium, 1997

Program Committee                ENCRESS 1997, Athens, Greece.

Program Committee                Software Testing, 1997, Paris.

General Chair                          IEEE Computer Assurance, 1997

Advisory Board                      14^th International Conference on Testing Computer Software

Program Committee                IEEE International Conference on Software Maintenance, 1998

Industry Track Chair               IEEE International Conference on Software Maintenance, 1998

Program Committee                IEEE International Symposium on Software Reliability, 1998

Program Committee                IEEE High Assurance Systems Engineering, 1998

Industry Track Chair               IEEE High Assurance Systems Engineering, 1998

Program Committee                IEEE Workshop on Applications-Specific Software Engineering and Technology, 1998

Program Committee                ICECCS 1998

Advisory Board                      15^th International Conference on Testing Computer Software

Workshop Chair                      SES 1998

Program Chair                         IEEE International Symposium on Software Reliability, 1999

Program Chair                         “Advanced Track” at 16^th ICTCS

Program Committee                IEEE Workshop on Applications-Specific Software Engineering and Technology, 1999

Program Committee                IEEE International Conference on Software Maintenance, 1999

Program Committee                European Symposium on V&V of Knowledge Based Systems, 1999

Vice Chair                               COMPSAC 1999

Program Committee                ICECCS 1999

Program Committee                IEEE Engineering Component Based Systems, 1999

Program Committee                TOOLS-USA 1999

Program Co-Chair                   IEEE International Conference on Software Maintenance, 2000

Program Committee                IEEE Workshop on Applications-Specific Software Engineering and Technology, 2000

Publicity Chair                        IEEE International Conference on Software Maintenance,  2000

Publicity Chair                        IEEE International Symposium on Software Reliability, 2000

Program Chair                         IEEE Engineering Component Based Systems, 2001

Program Committee                Euromicro 2000

Program Committee                Second Asia-Pacific Conference on Quality Software

Program Committee                COMPSAC 2001

Program Committee                Component-based Software Engineering Workshop at ICSE, 2001

Program Committee                First International Conference on COTS Based Software Systems, 2002

Program Committee                IEEE International Symposium on Software Reliability, 2002

Industry Practices Chair         IEEE International Symposium on Software Reliability, 2002

Program Co-Chair                   COMPSAC, 2003

Program Committee                Euromicro conference, Component-based software engineering track, 2003

Program Committee                Second International Conference on COTS Based Software Systems, 2003

Program Co-Chair                   IEEE International Symposium on Software Reliability, 2004

Program Committee                IEEE High Assurance Systems Engineering, 2004

Program Committee                Third International Conference on COTS Based Software Systems, 2004

Program Committee                Euromicro conference, Component-based software engineering track, 2004

Program Co-Chair                   CNSS Second National Software Summit, 2004

Program Co-Chair                   CNSS Trustworthy Software Workshop, 2004

Program Committee                IEEE International Symposium on Software Reliability, 2005

Program Co-Chair                   IEEE Workshop on Software Assessment, 2005

Publicity Chair                        IEEE International Symposium on Software Reliability, 2006

Program Committee                IEEE International Symposium on Software Reliability, 2007

Publicity Co-Chair                  IEEE International Conference on Web Services, 2006

Program Committee                IEEE International Conference on Web Services, 2006

Program Committee                ICSE06 Workshop on Technology Transfer in Software Engineering, 2006

Program Co-Chair                   IEEE Workshop on Software Assessment, 2006

Program Committee                First Annual IEEE Systems Conference, 2007

Steering Committee                IEEE Rapid Prototyping Systems Conference, 2008

Program Committee                IEEE International Symposium on Software Reliability, 2008

Program Committee                IEEE Rapid Prototyping Systems Conference, 2009

Conference Tutorials and Seminars

1994    Software Test and Evaluation Conference, Washington, DC

1995    Quality Week, San Francisco, CA

1996    International Conference on Software Maintenance, Monterey, CA

1998    Swiss Federal Institute of Technology, (ETH) October

1999    Institutionen for Datavetenskap Linkopings Universitet, Sweden, September

2004    Quality Assurance Institute, May

2005    University of Tokyo, November

BOOKS, PAPERS, AND PUBLICATIONS

Books

1.            M. Friedman and J. Voas.  Software Assessment: Reliability, Safety, Testability, New York: John Wiley & Sons, ISBN 0-471-01009-X, 1995.

2.            J. Voas and G. McGraw.  Software Fault Injection: Inoculating Programs Against Errors, New York: John Wiley & Sons, ISBN 0-471-18381-4, 1998.

Book Chapters

1.            J. Voas.  “Predicting System Trustworthiness,” in Building Reliable Component-based Software Systems, pp. 193-203, Artech House, London, 2003.

2.            J. Voas and C. Vossler, “Defective Software: An Overview of Legal Remedies and Technical Measures Available to Consumers,” in Advances in Computers, Volume 53, pp. 451-497, Academic Press, NY, 2001.

Magazine Guest Editor Experience

1.            June 1998, IEEE Computer, “The Challenges of Using COTS Software in Component-Based Development” 31(6): 44-45.

2.            July/August 1999, IEEE Software, “Certification: Reducing the Hidden Costs of Poor Quality,” 16(4): 22-25.

3.            September 2000, IEEE Software, “Malicious Information Technology,” 17(5): 23-25.

4.            February 2001, Cutter IT Journal, “Information Insecurity?”

5.            September 2001, IEEE Software, “Software Fault Tolerance: Making Software Behave,” 18(4): 18-19.

6.            May 2003, IEEE Software “Assuring Software Quality Assurance,” 20(3):48-49.

7.            July 2004, IEEE Software “Persistent Software Attributes”

8.            November 2004, IT Professional Magazine, “IT Management”

9.            May 2008, IT Professional Magazine, “Information Assurance and Quality Assurance”

10.        November 2008, IT Professional Magazine, “IT as a Profession”

11.        March 2009, IT Professional Magazine, “Cloud Computing”

Technical Videos

1.            “Developing Software for Safety Critical Systems,” June 1998, IEEE Reliability Society and IEEE Educational Activities, NTSC ISBN 0-7803-4573-8.

2.            “Software Testing: Building Infrastructure, Due Diligence, and OO Software,” May 1999, IEEE Reliability Society and IEEE Educational Activities, NTSC ISBN 0-7803-5312-9.

3.            “Developing Fault Tolerant Software,” 2002, 3 CD-ROM set, IEEE Product No. EC145, ISBN 0-7803-6843-6.

Technical Journal/Magazine Articles

1.            J. Voas, L. Morell, & K. Miller. “Predicting Where Faults Can Hide From Testing,” IEEE Software, 8(2): 41-47, March 1991.

2.            K. Miller, L. Morell, R. Noonan, S. Park, D. Nicol, B. Murrill, & J. Voas. “Estimating the Probability of Failure when Testing Reveals No Failures,” IEEE Transactions On Software Engineering, 18(1):33-44, Jan. 1992.

3.            J. Voas. “PIE: A Dynamic Failure-Based Technique,” IEEE Transactions On Software Engineering, 18(8): 717-727, August 1992.

4.            J. Voas & K. Miller. “The Revealing Power of a Test Case,” Journal of Software Testing, Verification, and Reliability, John Wiley & Sons, 2(1): 25-42, May 1992.

5.            J. Voas & K. Miller. “Applying A Dynamic Testability Technique To Debugging Certain Classes of Software Faults,” Software Quality Journal, Chapman & Hall, March 1993, p. 61-75.

6.            J. Voas, K. Miller, & J. Payne. “Designing Programs That are Less Likely to Hide Faults,”' The Journal of Systems and Software, Elsevier Science Publishers Ltd. 20:93-100, January 1993.

7.            J. Voas & K. Miller. “Semantic Metrics for Software Testability,” The Journal of Systems and Software, Elsevier Science Publishers Ltd. 20:207-216, March 1993.

8.            J. Voas. “Dynamic Testing Complexity Metric,” Software Quality Journal, 1(2):101-114, Chapman & Hall, June 1992.

9.            L. Morell & J. Voas. “A Framework for Defining Semantic Metrics,” The Journal of Systems and Software, Elsevier Science Publishers Ltd. 20:245-251, March 1993.

10.        J. Voas, J. Payne, & F. Cohen. “A Model for Detecting the Existence of Software Corruption in Real Time,” Computers and Security Journal, 11(8), Elsevier Science Publishers Ltd. 1993.

11.        J. Voas, C. Michael, & K. Miller. “Confidently Assessing a Zero Probability of Software Failure,” High Integrity Systems Journal, 1(3): 269-275, 1995.

12.        J. Voas, & K. Miller. “Dynamic Testability Analysis for Assessing Fault Tolerance,” High Integrity Systems Journal. 1(2): 171-178, 1994.

13.        J. Voas & K. Miller. “Software Testability: The New Verification,” IEEE Software. 12(3): 17-28, May 1995.

14.        J. Voas, G. McGraw, L. Kassab, & L. Voas. “A Crystal Ball for Software Liability,” IEEE Computer, 30(6): 29-36, June 1997.

15.        J. Voas, F. Charron, G. McGraw, K. Miller, & M. Friedman. “Predicting How Badly ‘Good’ Software can Behave,” IEEE Software, 14(4):73-83, July 1997.

16.        C. C. Michael & J. Voas. “The ability of directed tests to predict software quality,” Annals of Software Engineering, Vol. 4., pp.31-64, 1997.

17.        J. Voas, “Software Testability Measurement for Intelligent Assertion Placement,” Software Quality Journal, 6(4): 327-335, December 1997.

18.        J. Voas. “Error Propagation Analysis for COTS Systems,” IEEE Computing and Control Engineering Journal, 8(6):269-272, December 1997.

19.        J. Voas. “Certifying Off-the-Shelf Software Components,” IEEE Computer, 31(6): 53-59, June 1998. (Translated into Japanese and reprinted in Nikkei Computer magazine)

20.        J. Voas. “Maintaining Component-based Systems,” IEEE Software, 15(4): 22-27, July 1998. (Reprinted in the Moscow Open Systems Journal, Volume 6, 1998)

21.        J. Voas. “Disposable Information Systems: The Future of Software Maintenance,” Journal of Software Maintenance, 11(2):143-150, March 1999.

22.        J. Voas. “Analyzing Software Sensitivity to Human Error,” Failure and Lessons Learned in Information Technology Management – An International Journal, 2(4): 201-206, 1998.

23.        Ghosh & J. Voas. “Inoculating Software for Survivability,” Communications of the ACM, 42(7): 38-44, July 1999.

24.        J. Voas. “Certifying Software for High Assurance Environments,” IEEE Software, 16(4):48-54, July 1999.

25.        J. Voas & L. Kassab. “Using Assertions to Make Untestable Software More Testable,” Software Quality Professional, 1(4): 31-40, September 1999.

26.        J. Voas and J. Payne. “Dependability Certification of Software Components,” Journal of Systems and Software, Volume 52, pp. 165-172, 2000.

27.        J. Voas. “Toward a Usage-Based Software Certification Process,” IEEE Computer, 33(8):32-37, August 2000.

28.        J. Whittacker and J. Voas. “Towards a More Reliable Theory of Software Reliability,” IEEE Computer, 33(12): 36-42, December 2000.

29.        J. Voas. “A Method for Discovering Unforeseen Software Output Modes and Missing System Hazards,” The Annals of Software Engineering, Publisher: Kluwer, Volume 11, pp: 79-88, November 2001.

30.        J. Voas. “Trusted Software’s Holy Grail,” Software Quality Journal, 11(1): 9-17, Publisher: Kluwer, May 2003.

31.        S. Roberts, B. Michael, T. Wingfield, and J. Voas, “The Role of Policy in Managing the Effect of Outsourcing Software Development on Homeland Security”, Journal of Accounting and Public Policy, Elsevier, 2004.

32.        K. Miller and J. Voas.  Software Test Cases: Is One Ever Enough? IEEE Software, January, 2006, pp: 44-48.

33.        J. Voas.  A Baker’s Dozen.  Journal of the Institute of Electrical, Information, and Communication Engineers of Japan, 89(12): 1040-1043, December, 2006.

34.        Tom Baldwin, Mike Hinchey, Phil Laplante,  Paolo Montuschi, Jon Rokne, Linda Schaefer, Jeff Voas, and Wenping Wang. “Quality in Conference Publishing”. IEEE Transactions on Professional Communications, June, 2009.

Refereed Conference Proceeding Articles

1.            J. Voas & L. Morell. “Propagation and Infection Analysis (PIA) for Debugging Software,” Proceedings of the 1990 IEEE Southeastcon, p. 379-383, Vol. 2, April 1990, New Orleans, LA.

2.            J. Voas & L. Morell. “Applying Sensitivity Analysis Estimates to a Minimum Failure Probability for Software Testing,” Proceedings of the 8^th Pacific Northwest Software Quality Conference, p. 261-371, October 1990, Portland, OR.

3.            J. Voas. “A Metric On The Ability of a Program to Hide Faults During Random Black Box Testing,” Proceedings Of the 3^rd Oregon Workshop on Software Metrics. March 1991, Silverton, OR.

4.            J. Voas & K. Miller. “Improving Software Reliability by Estimating the Fault Hiding Ability of a Program Before It Is Written,” Proceedings of the 9^th Software Reliability Symposium, May 1991, Colorado Springs, CO.

5.            J. Voas. “Sensitivity Analysis,” Proceedings of the 8^th International Testing Computer Software, p. 165-174, June 1991, Washington, D.C.

6.            J. Voas. “Factors that Affect Software Testability,” Proceedings of the 9^th Pacific Northwest Software Quality Conference, p. 235-247, October 1991, Portland, OR.

7.            J. Voas, K. Miller, & J. Payne. “Designing Programs That are Less Likely to Hide Faults,” Proceedings of the 1^st International Conference On Software Quality, p. 44-49, October 1991, Dayton, OH.

8.            J. Voas, J. Payne, & K. Miller. “A Future Direction for Software Certification Testing Using Sensitivity Analysis,” Proceedings of the 1^st International Conference On Software Quality, p. 202-207, October 1991, Dayton, OH.

9.            J. Voas. “A Dynamic Failure Model for Predicting the Impact that a Program Location has on the Program,” Lecture Notes in Computer Science Series, Vol. 550: Proceedings Of the 3^rd European Software Engineering Conference, p. 308-331, October 1991, Italy, Springer-Verlag, A. Van Lamsweerde and A. Fugetta (Eds.).

10.        J. Voas & J. Payne. “A Model for Detecting the Existence of Unknown Computer Viruses in Real-time,” Proceedings of the 5^th International Computer Virus and Security Conference, p. 772-782, March 1992, New York.

11.        J. Voas & K. Miller. “A Tool that Estimates Software Quality by Predicting Data State Error Propagation,” Proceedings of the 1^st International Software Quality Exchange Conference, Section 7B, p. 25-40, March 1992, San Francisco, CA.

12.        J. Voas & K. Miller. “A Design Phase Semantic Metric for Software Testability,” Proceedings of the 4^th Oregon Workshop on Software Metrics.  March 1992 Silver Falls, OR.

13.        L. Morell & J. Voas. “A Framework for Defining Semantic Metrics,” Proceedings of the 4^th Oregon Workshop on Software Metrics.  March 1992, Silver Falls, OR.

14.        J. Voas. “A Technique and Tool for Predicting Semantic Software Testability,” Proceedings of the 5^th International Software Quality Week ’92 May 1992, San Francisco, CA.

15.        J. Voas, K. Miller, & J. Payne. “PISCES: A Tool for Predicting Software Testability,” Proceedings of the Symposium on Assessment of Quality Software Development Tools, May 1992, p. 297-309, New Orleans, LA.

16.        J. Voas, K. Miller, & J. Payne. “Transforming A Software Testability Analysis Model (PIE) Into A Software Testing Tool (PISCES),” Proceedings of the 9^th International Conference On Testing Computer Software, June 1992, Washington, D.C.

17.        J. Voas, K. Miller & J. Payne, “Assessing the Ultra-Reliability of Software Via Software Testing,” In Proceedings of the Test Technology Symposium V, July 1992, John Hopkins University.

18.        J. Voas, K. Miller, & R. Noonan. “Designing Programs that do not Hide Data State Errors During Random Black-Box Testing,” Proceedings of the 5^th International Conference on Putting Methods and Tools for Information System Design, September 1992, Nantes, France.

19.        J. Voas & K. Miller. “Improving the Software Development Process Using Testability Research,” Proceedings of the 3^rd International Symposium on Software Reliability Engineering, p. 114-121, October 1992, Research Triangle, NC.

20.        J. Voas, K. Miller, & J. Payne. “Software Testability and Reliability Estimation,” Proceedings of the 2^nd Workshop on Issues in Software Reliability Estimation, October 1992, Livingston, N.J.

21.        J. Voas & K. Miller. “A Model For Improving the Testing of Reusable Software Components,” Proceedings of the 10^th Pacific Northwest Software Quality Conference, p. 353-360, October, 1992, Portland, OR.

22.        J. Voas, L. Voas, & K. Miller. “A Model for Assessing the Liability of Seemingly Correct Software,” Proceedings of the LASTED International Conference on Reliability, Quality Control and Risk Assessment, p. 32-35, November 1992, Washington, D.C.

23.        J. Voas & K. Miller. “A Reverse Flow Graph Model for Statically Predicting Data State Error Propagation,” Proceedings of the 1992 Software Engineering Research Forum, p. 81-88, November 1992, Melbourne, FL.

24.        J. Voas, J. Payne, C. Michael, & K. Miller. “Data State Capture,” Proceedings of the 5^th Oregon Workshop on Software Metrics, March 1993, Silverton, OR.

25.        J. Voas, K. Miller, & J. Payne, “A Software Analysis Technique for Quantifying Reliability in High-Risk Medical Devices,” Proceedings of the 6^th IEEE Symposium on Computer-Based Medical Systems, June 1993, Ann Arbor, MI.

26.        J. Voas, J. Payne, C. Michael & K. Miller. “Experimental Evidence of Sensitivity Analysis Predicting Minimum Failure Probabilities,” Proceedings of 8^th Annual Conference on Computer Assurance (COMPASS ’93), June 1993, p. 123-133, Gaithersburg, MD.

27.        R. Hamlet & J. Voas. “Faults on Its Sleeve: Amplifying Software Reliability Testing,” Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis, June 1993, Cambridge, MA.

28.        J. Voas, K. Miller, & J. Payne. “Dynamic Testability Analysis for Software Safety,” Proceedings of the 2^nd LASTED International Conference on Reliability, Quality Control and Risk Assessment, October 1993, Cambridge, MA.

29.        J. Voas, K. Miller, & J. Payne. “Automating Test Case Generation for Coverages Required by FAA Standard DO-178B,” Proceedings of Computers in Aerospace 9, October 1993, San Diego, CA.

30.        J. Voas, K. Miller, & J. Payne. “Software Testability and Its Application to Avionic Software,” Proceedings of Computers in Aerospace IX, October 1993, San Diego, CA.

31.        J. Voas, C. Michael, & K. Miller. “Confidently Assessing a Zero Probability of Software Failure,’ Proceedings of the 12^th International Conference on Computer Safety, Reliability, and Security, October 1993, p. 197-206, Poznan, Poland.

32.        J. Voas, K. Miller, & J. Payne. “An Empirical Comparison of a Dynamic Software Testability Metric to Static Cyclomatic Complexity,” Proceedings of the 18^th Annual Software Engineering Workshop, December 1993, NASA-Goddard.

33.        J. Voas & K. Miller. “Enhanced Software Testing, Testability, and Fault-Tolerance Through Output Space Redefinition,” Proceedings of 11^th International Conference on Testing Computer Software, June 1994, Washington, D.C.

34.        K. Miller & J. Voas. “Classifying Methods to Assess Software Quality,” Proceedings of 11^th International Conference on Testing Computer Software, June 1994, Washington, D.C.

35.        J. Voas, K. Miller, & J. Payne. “A Comparison of a Dynamic Software Testability Metric to Static Cyclomatic Complexity,” Proceedings of 2^nd International Conference on Software Quality Management, July 1994, Edinburgh, Scotland.

36.        J. Voas & K. Miller. “Putting Assertions in Their Place,” Proceedings of the International Symposium on Software Reliability Engineering, November 1994, Monterey, CA.

37.        J. Voas, J. Payne, R. Mills, & J. McManus. “Software Testability: An Experiment in Measuring Simulation Reusability,” ACM SIGSOFT Symposium on Software Reusability, April 1995, Seattle, WA.

38.        J. Voas. “Software Testability Measurement for Assertion Injection and Fault Localization,” Proceedings of 2^nd International Workshop on Automated and Algorithmic Debugging (AADEBUG ’95), May 1995, St. Malo, France.

39.        J. Voas. “Testability-Guided Assertion Placement,” Proceedings of the 8^th International Software Quality Week ’95 June 1995, San Francisco, CA.

40.        J. Offutt J. Pen, & J. Voas. “Procedures for Reducing the Size of Coverage-based Test Sets,” Proceedings of International Conference on Testing Computer Software, June 1995.

41.        J. Voas & K. Miller. “Examining Software Quality (Fault-Tolerance) Using Unlikely Inputs: Turning the Test Distribution Up-Side Down,” Proceedings of the 10^th Annual Conference on Computer Assurance (COMPASS ’95), p. 3-11, June 1995.

42.        J. Voas & K. Miller. “Using Fault Injection to Assess Software Engineering Standards,” Proceedings of International Symposium on Software Engineering Standards, p. 139-145, August 1995, Montreal.

43.        J. Voas & K. Miller. “A Statistical and Automated C++ Code-Based Fault-Tree Mitigation Framework,” Proceedings 12^th Annual CSR Workshop & 1^st Annual ENCRESS Conference September 1995, Brugge, Belgium.

44.        J. Voas, C. Michael & K. Miller. “Using Fault Injection to Assess Software Engineering Standards,” Proceedings of Pacific Northwest Software Quality Conference, p. 318-336, September 1995.

45.        T.M. Khoshgoftaar, R.M. Szabo, & J.M. Voas. “Detecting Program Modules with Low Testability,” Proceedings of International Conference on Software Maintenance, Nice, France, p. 242-250, October 1995.

46.        J. Voas & K. Miller. “An Automated Code-Based Fault-Tree Mitigation Technique,” Proceedings of the 14^th International Conference on Computer Safety, Reliability, and Security (SAFECOMP ’95), Springer-Verlag p.59-72, October 1995, Italy.

47.        J. Voas & K. Miller. “Predicting Software Minimum-time-to-hazard and Mean-time-to-hazard for Rare Input Events,” Proceedings of the International Symposium on Software Reliability Engineering, October 1995, Toulouse, France.

48.        J. Voas, A. Binns, R. Mills, & J. Payne. “An Experiment Applying a Fault Injection-based Fault-tolerance Measure to a Software Automobile Control System,” Proceedings of the 2^nd IFAC Workshop on Safety and Reliability in Emerging Control Technologies, T. Hilburn, G. Suski, J. Zalewski (editors) Pergamon/Elsevier Science, Oxford, 1996, p. 193-198, ISBN 0-08-042610-7.

49.        J. Voas & K. Miller. “Dynamic Fault-Injection for Software Fault-Tolerance Prediction,” Proceedings of the Pacific Rim International Symposium on Fault-Tolerant Systems, December 1995, Newport Beach, CA.

50.        J. Voas. “Testability of Object-Oriented Systems,” Proceedings of Third International Conference on Achieving Quality in Software, January 1996, Florence, Italy.

51.        J. Voas & K. Miller. “The Avalanche Paradigm: An Experimental Software Programming Technique for Improving Fault-tolerance,” Proceedings of the IEEE International Symposium and Workshop on Engineering of Computed-based Systems, March 1996, Germany.

52.        J. Voas & K. Miller. “Substituting Voas' Testability Measure for Musa's Fault Exposure Ratio,” Proceedings of the International Communication Conference, p. 230-234, June 1996 Dallas, TX.

53.        J. Voas. “Testing for Characteristics Other than Correctness: Safety, Failure-tolerance, and Security,” Proceedings of the International Conference on Testing Computer Software, June 1996.

54.        J. Voas, G. McGraw, A. Ghosh, F. Charron, & K. Miller. “Defining an Adaptive Software Security Metric from a Dynamic Software Failure-tolerance Measure,” Proceedings of the 11^th Annual Conference on Computer Assurance (COMPASS ’96), pp. 250-263, June 1996.

55.        J. Voas & K. Miller. “Software Testability Measurement for Intelligent Assertion Placement,” Proceedings IEE Software Testing 96, Paris, June 1996.

56.        J. Voas, A. Ghosh, G. McGraw, & K. Miller. “Gluing Together Software Components: How Good is Your Glue?,” Proceedings of Pacific Northwest Software Quality Conference, p. 338-349, Portland, OR, October 1996.

57.        J. Voas, F. Charron & K. Miller. “Tolerant Software Interfaces: Can COTS-based Systems be Trusted Without Them?,” Proceedings of the 15^th International Conference on Computer Safety, Reliability and Security (SAFECOMP’96), Springer-Verlag, p. 126-135, October 1996, Vienna, Austria.

58.        J. Voas, F. Charron, & K. Miller. “Investigating Rare-Event Failure Tolerance: Reductions in Future Uncertainty,” Proceedings of IEEE High-Assurance Systems Engineering Workshop (HASE’96), in conjunction with the 15^th Symposium on Reliable Distributed Systems, October 1996, Niagara-on-the-Lake, Canada.

59.        J. Voas & K. Miller. “Software Testability: Investing in Testing,” Proceedings of EuroStar’96, December 1996, Amsterdam.

60.        J. Voas. “Software Fault-injection: Growing ‘Safer’ Systems,” In Proceedings of 1997 IEEE Aerospace Conference, February 1997.

61.        J. Voas “ Guarding COTS Components From Each Other,” IEEE Colloquium on COTS and Safety Critical Systems January 1997, London.

62.        J. Voas, G. McGraw, and A. Ghosh. “Reducing Uncertainty About Survivability,” Proceedings of the Information Survivability Workshop February 1997, San Diego, IEEE Computer Society.

63.        J. Voas. “Testing for Correctness: Is this REALLY what we want?,” Proceedings of Software testing analysis and review ‘97. May 1997.

64.        C. C. Michael & J. Voas. “Problems of Accuracy in the Prediction of Software Quality from Directed Tests,” Proceedings of 1997 International Conference on Testing Computer Software, June 1997.

65.        J. Voas. “Building Software Recovery Assertions from a Fault Injection-based Propagation Analysis,” Proceedings of 1997 COMPSAC. pp. 505-510, August 1997

66.        J. Voas & L. Kassab. “Simulating Specification Errors and Ambiguities in Systems Employing Diversity,” Proceedings of 1997 Pacific Northwest Software Quality Conference, pp. 223-234, October 1997.

67.        J. Voas, A. Ghosh, F. Charron, and & L. Kassab. “Reducing Uncertainty About Common-Mode Failures,” Proceedings of ISSRE’97, pp. 308-319, November 1997.

68.        J. Voas, F. Charron, and L. Beltracchi. “Error Propagation Analysis Studies in a Nuclear Research Code,” Proceedings of the 1998 IEEE Aerospace Conference, March 1998, Snowmass, CO.

69.        J. Voas. “Defensive Approaches to Testing Systems that Contain COTS and Third-Party Functionality,” Proceedings of 15^th International Conference and Exposition on Testing Computer Software, pp. 107-114, June 1998.

70.        D. Wallace, J. Voas, M. Schatz, & M. Schmid.  “Implementing Assertions for Object-Oriented Systems,” Proceedings of 15^th International Conference and Exposition on Testing Computer Software, pp. 115-125, June 1998.

71.        J. Voas. “Independent Software Measurement's Role In The Liability Puzzle,” European Software Measurement Conference ‘98, pp. 347-354, May 1998, Belgium.

72.        J. Voas. “A Defensive Approach to Testing Systems that Contain COTS and Third-Party Functionality,” In Proceedings AQUIS’98, pp. 49-60, Venice, Italy, April 1998.

73.        J. Voas. “A Defensive Approach to Testing Systems that Contain COTS and Third-Party Functionality,” Proceedings Fourth ISSAT International Conference on Reliability and Quality in Design, August 1998.

74.        J. Voas and J. Payne. “COTS Software Failures: Can Anything be Done?,” First IEEE Workshop on Application Specific Software Engineering and Technology (ASSET’98), March 1998.

75.        F. Charron and J. Voas. “Maintaining Software for 'Safety' in an Ever-Changing World,” Proceedings of the 16^th International System Safety Conference, September 1998.

76.        J. Voas. “A Recipe for Certifying High Assurance Software,” COMPSAC’98, pp. 99-104, August 1998, Vienna, Austria.

77.        L. Kassab and J. Voas. “Towards Fault-Tolerant Mobile Agents,” Workshop on Distributed Computing on the Web, June 1998, Rostock, Germany.

78.        L. Kassab and J. Voas. “Agent Trustworthiness,” 4^th Workshop on Mobile Object Systems: Secure Internet Mobile Computations, July 1998, Brussels, Belgium.

79.        S. Keene, J. Bernhard, and J. Voas. “Assuring COTS Products for Reliability and Safety Critical Systems,” Reliability and Maintainability Symposium, January 1999.

80.        J. Voas. “Will Software and Information Technology Risks Halt the Availability of Business Insurance,” 11^th International Conference on Software Engineering and its Applications, December 1998, Paris, France.

81.        J. Voas and J. Payne. “Dependability Certification of Software Components,” The 1999 Conference on Empirical Assessment in Software Engineering (EASE’99), Keele University.

82.        J. Voas. “Software Hazard Mining,” Proceedings of the IEEE Symposium on Application-Specific Systems and Software Engineering Technology (ASSET’99), pp. 180-184, March 1999

83.        T. Khoshgoftaar, E. Allen, W. H. Tang, C. C. Michael, and J. Voas. “Identifying Modules Which do not Propagate Errors,” Proceedings of the IEEE Symposium on Application-Specific Systems and Software Engineering Technology (ASSET’99), pp. 185-193, March 1999.

84.        J. Voas. “User Participation-Based Software Certification,” Proceedings of the European Verification and Validation Workshop (EUROVAV’99), Oslo, Norway, June 1999.

85.        J. Voas and F. Charron. “Predicting When to Reboot ‘Continuously Operating’ Systems,” Proceedings of the 17^th International System Safety Conference, pp. 580-586, August 1999. (Best Paper Award)

86.        J. Voas and F. Charron. “Predicting When to Reboot ‘Continuously Operating’ Systems,” Proceedings of the Conference on Quality Engineering in Software Technology, September 1999, Nuremberg, Germany.

87.        J. Voas. “Protecting against what? The Achilles heel of information assurance,” Proceedings of the 2^nd European Software Measurement Conference, October 1999, Amsterdam, Netherlands.

88.        J. Voas. “Software Malleability: We're Losing it!,” Proceedings of the 2^nd Annual Systems Engineering and Supportability Conference, September 1999.

89.        J. Voas and A. Ghosh. “Software Fault Injection for Survivability,” Proceedings of the DARPA Information Survivability Conference and Exposition, January 2000.

90.        J. Voas. “Disposable Information Systems,” Proceedings of the 4^th European Conference on Software Maintenance and Reengineering, February 2000, Zurich, Switzerland.

91.        J. Voas. “Limited Software Warranties,” Proceedings of the IEEE Conference and Workshop on Engineering of Computer-based Systems, p. 56-61, April 2000, Edinburgh, Scotland.

92.        J. Voas. “Limited Software Warranties,” Proceedings of the European Software Test Congress 2000, May 2000, London.

93.        J. Voas, “Software Certification,” Encyclopedia of Software Engineering, John Wiley & Sons, 2001.

94.        J. Voas, “Formal Testability Analysis,” Encyclopedia of Software Engineering, John Wiley & Sons, pp.517-518, 2001

95.        J. Voas, “Software Assurance,” Encyclopedia of Software Engineering, John Wiley & Sons, 2001.

96.        J. Voas. “Deriving Accurate Operational Profiles for Mass-Marketed Software,” ICSE Workshop on Continuing Collaborations for Successful COTS Development, June 2000, Limerick, Ireland.

97.        J. Voas. “A Method for Discovering Unanticipated Software Output Modes and Missing System Hazards,” Proceedings of the System Safety Conference, September 2000, Dallas Ft. Worth, TX.

98.        J. Voas. “A Method for Discovering Unanticipated Software Output Modes and Overlooked System Hazards,” Proceedings of the 5^th Australian Workshop on Industrial Experience with Safety Critical Systems and Software, November 2000.

99.        J. Voas. “Software Quality Tradeoffs, Return on Investment, and Software Safety,” Proceedings of the 20^th International System Safety Conference, August 2002, Denver, CO.

100.    J. Voas. “The Holy Grail of Trusted Computing,” 15^th International Conference on Software Engineering and its Applications, December 2002, Paris, France.

101.    J. Voas. “The Holy Grail of Trust,” Proceedings of 2003 Hawaii International Conference on System Sciences (HICSS), January 2003, Hawaii.

102.    S. Roberts, B. Michael, T. Wingfield, and J. Voas, “The Role of Policy in Managing the Effect of Outsourcing Software Development on Homeland Security”, 2004 Conference on Financial Systems and Cyber Security: A Public Policy Forum of the Robert H. Smith School of Business at the University of Maryland, 2004.

103.    J. Zhang, C. Chang, and J. Voas. “A Uniform Meta-Model for Mediating Formal Electronic Conferences”, Proceedings of 2004 COMPSAC, Hong Kong.

104.    J. Zhang and J. Voas. “Automatic Test Case Generation towards Web Services Reliability Testing”, Fast Abstract at ISSRE 2005.

105.    J. Voas, “Software Product Certification,” Encyclopedia of Computer Science and Engineering, John Wiley & Sons, January, 2009, ISBN: 978-0-471-38393-2, Ed. Benjamin W. Wah, Hoboken, NJ.

106.    J. Voas and K. Miller, “One in a Baker’s Dozen: Debugging Debugging” Proc. of the IEEE High Assurance Systems Engineering Symposium, November, 2007.

Short Magazine Articles

1.            J. Voas. “How Assertions Can Increase Test Effectiveness,” Quality Time Column, In IEEE Software, 14(2): 118- 119, March 1997.

2.            J. Voas. “Can Clean Pipes Produce Dirty Water?” Quality Time Column, In IEEE Software, 14(4): 93-95, July 1997.

3.            J. Voas. “Fault Injection for the Masses,” Software Realities Column, In IEEE Computer, 30(12): 129-130, December 1997.

4.            J. Voas. “Certifying Y2K Fixes,” Crosstalk, 11(12): 19-20, January 1998.

5.            J. Voas. “COTS Software: The Economical Choice?,” Manager Column, In IEEE Software, 15(2): 16-19, March 1998.

6.            J. Voas. “Software Certification Laboratories?,” Crosstalk, 11(4): 21-23, April 1998.

7.            J. Voas. “Studying Behavior to Unlock the Truth About Quality,” Cutter Consortium IT Journal, 11(9): 7-11, September 1998.

8.            J. Voas. “The Software Quality Certification Triangle,” Crosstalk, 11(11): 12-14, November 1998.

9.            L. Kassab and J. Voas. “Trusting Mobile Software Agents,” Cutter Consortium IT Journal, 11(12): 40-46, December 1998.

10.        J. Voas. “Protecting Against What?: The Achilles Heel of Information Assurance,” Quality Time Column, In IEEE Software, 16(1):26-27, January 1999.

11.        J. Voas. “The Future of Computer Assurance,” Technical Activities Forum, In IEEE Computer, 32(1): 76-77, January 1999.

12.        J. Voas. “The Cold Realities of Software Insurance,” In IEEE IT Pro, 1(1): 71-72, January 1999.

13.        J. Voas. “Untested Software Threatens Infrastructures,” Quality Time Column, In IEEE Software, 16(2): 89-90, March 1999.

14.        D. Hassett and J. Voas. “How to Select a Technology Lawyer,” In IEEE IT Pro, 1(2): 70-72, March 1999.

15.        J. Voas. “A Government-Controlled United States Software/IT Industry?,” Quality Time Column, In IEEE Software, 16(3): 94-95. May 1999.

16.        J. Voas. “Advice for those bitten by the startup bug,” In IT Pro, 1(3): 42-48 May/June 1999.

17.        K. Liu, D. Hassett, and J. Voas. “What's at stake in DOJ vs. Microsoft,” In IEEE IT Pro, 1(4): 73-76, July 1999.

18.        J. Voas. “This Decade's Eight Greatest Myths About Software Quality,” Quality Time Column, In IEEE Software, 16(5): 118-120. September 1999.

19.        K. Miller and J. Voas. “An Ethical Can of Worms for Software Certifiers,” In IEEE IT Pro, September, 1(5): 18-20, 1999.

20.        J. Voas. “UCITA: Take the Deal and Run,” In IEEE IT Pro, January, 2(1): 18-20, 2000.

21.        J. Voas. “A New Generation of Software Quality Conferences,” Quality Time Column, In IEEE Software, 17(1): 22-23, January 2000.

22.        J. Voas. “Would the Real Operational Profile Please Stand Up?,” Quality Time Column, In IEEE Software, 17(2):87-89, March 2000.

23.        J. Voas. “Can Chaotic Methods Improve Software Quality Predictions?,” Quality Time Column, In IEEE Software, 17(5):20-22, September 2000.

24.        J. Viega and J. Voas. “The Pros and Cons of Unix and Windows Security Policies,” In IEEE IT Pro, 2(5): 40-45, September 2000.

25.        J. Viega and J. Voas. “Can Aspect Oriented Programming Lead to More Reliable Software?,” Quality Time Column, In IEEE Software, 17(6): 19-21, November 2000.

26.        J. Voas. “The Pitfalls of Managing Superstars,” In IEEE IT Pro, 3(2): 65-67, March 2001.

27.        J. Voas. “Faster, Better, and Cheaper,” Quality Time Column, In IEEE Software, 18(3): 96-97, May 2001.

28.        J. Voas. “Composing Software Component `ilities,” Quality Time Column, In IEEE Software, 18(4): 16-17, July 2001.

29.        J. Voas. “Fault Tolerance,” In IEEE Software, 18(4): 54-57, July 2001.

30.        J. Voas. “Why Testing Software Under Expected Operational Profiles is not Sufficient,” In Software Focus, 2(1): 13-14, John Wiley and Sons, 2001.

31.        J. Voas. “Corporate Rumors and Conspiracy Theories,” In IEEE IT Pro, 4(2): 62-64, March 2002.

32.        J. Whittacker and J. Voas, “Fifty Years at Software: Key Principles for Quality”,  In IEEE IT Pro, 4(6): 28-35, November, 2002.

33.        J. Voas. “Tough Times, Tough Money: Understanding Investor Speak,” In IEEE IT Pro, 5(1): 61-64, January 2003.

34.        B. Malloy and J. Voas, “Programming with Assertions: A Prospectus”, In IEEE IT Pro, 2004.

35.        J. Voas, “Software’s Secret Sauce: the `ilities,” Quality Time Column, In IEEE Software, 21(6): 2-3, November, 2004.

36.        J. Voas and B. Agresti, “Software Quality from a Behavioral Perspective”, In IEEE IT Pro, 21(4):38-42, 2004.

37.        J. Voas.  “Assessing Acquired Software via Software Fault Injection”, The DoD Software Tech News, October, 2003, 6(2):12-14, (Also reprinted in The Journal of the Quality Assurance Institute, October, 2004).

38.        J. Voas. “Software Component Interoperability”, Crosstalk, November, 2005.

39.        S. Roberts, B. Michael, T. Wingfield, and J. Voas, “The Role of Policy in Balancing Outsourcing and Homeland Security”, IEEE IT Pro, July, 2005.

40.        K. Miller and J. Voas, “Software Test Cases: The Power or One”. IEEE IT Pro, January, 2006.

41.        B. Malloy, J. Hallstrom, and J. Voas, “Using Contracts to Improve Quality in Service-Oriented Architectures”, IEEE Software. March 2006.

42.        K. Miller and J. Voas, “Revisiting Software Certification Services: Encouraging Trust and Reasonable Expectations”, IEEE IT Pro, 2006.

43.        J. Voas, “A Baker’s Dozen:  Thirteen Grand Challenges in Software Engineering”, IEEE IT Pro, March, 2007.

44.        J. Voas and P. Laplante. “The Services Paradigm: Who Can You Trust?”  IEEE IT Pro, May, 2007.

45.        J. Voas and P. Laplante. “A Perspective on Standard Confusion and Harmonization”. IEEE Computer, July, 2007.

46.        P. Laplante, J. Zhang, and J. Voas. “SOA versus SaaS: What is in a Name?” IEEE IT Pro, May, 2008.

47.        J. Voas, “Software Quality Unpeeled”, Crosstalk, June, 2008.

48.        K. Miller and J. Voas, “Information Integrity and Information Technologies Professionals’ Integrity, Intertwined”, IEEE IT Pro, November, 2008.

49.        J. Voas and L. Wilbanks, “Information and Quality Assurance: An Unsolved, Perpetual Problem for Past and Future Generations,” IEEE IT Pro, May, 2008.

50.        K. Miller and J. Voas, “Information Integrity, and IT Professional’s Integrity, Intertwined”, IEEE IT Pro, November, 2008.

51.        J. Voas, “Software Trust”, IEEE Transactions on Reliability, 57(3): 409-411, September, 2008.

52.        K. Miller and J. Voas, “Information Integrity, and IT Professional’s Integrity, Intertwined”, IEEE Transactions on Reliability, 57(3): 401-414, September, 2008.

53.        P. Laplante, B. Michael, and J. Voas, “Cyber-pandemics: History, Inevitability, Response”, IEEE Security and Privacy Magazine, January, 2009. 

54.        J. Voas and Phil Laplante, “End Brake Retarder Prohibitions: Defining ‘Shall Not’ Requirements Effectively”, submitted to IEEE IT Pro, 2009.

55.        G. Hurlburt, K. Miller, and J. Voas. “An Ethical Analysis of Automation, Risk, and the Financial Crisis of 2008”, IEEE IT Pro Magazine, January, 2009.

56.        J. Harauz, J. Voas, and G. Hurlburt, “Trustworthiness in Software Environments”, to appear in IEEE IT Pro, August, 2009.

57.        G. Hurlburt, K. Miller, J. Voas, and J. Day, “Privacy and/or Security: Take Your Pick”, to appear in IEEE IT Pro, August, 2009.

Technical Reports

1.            NIST GCR 95-675 “Testability of Object-Oriented Systems,” June 1995.

2.            NIST GCR 98-735 “A Testability-based Assertion Placement Tool for Object-Oriented Software,” January 1998.

3.            Cutter Consortium “Security Considerations in Modern Distributed Computing Architectures,” September 1999.

4.            NATO “Final Report of the NATO Research Task Group IST-027/RTG-009 on the Validation, Verification, and Certification of Embedded Systems”, March, 2004  (other authors included Robin Bloomfield, Jacques Cazin, Dan Craigen, Natalia Juristo, and Ernst Kesseler) Report is numbered: TR-IST-027.