Gary North's Y2K Links and Forums - Mirror

Category: Testing

(feel free to mail this page)



(Links to documents appear after the summary.)

Estimates vary as to what percentage of a y2k repair project must be devoted to testing. The low estimate is 40%. The high estimate is 70%. It doesn't matter. The testing won't be done by more than a handful of organizations. Here's why.

First, hardly any organization will ever finish the actual code repair. They will not have anything to test by the time the deadline for testing arrives. In his widely respected report, Capers Jones says that any organization that had not begun its code repair by October, 1997, will not complete its project. By October, 1997, well under 20% of the Fortune 500 corporations had begun repairing their code. The rest of the world was even further behind.

Second, parallel testing is mandatory for large systems (10 million lines or more). Data must be fed into the noncompliant machine and the compliant machine simultaneously in order to make sure that the compliant machine handles the data properly. Such testing should go on for weeks or months. To run these parallel tests, an organization needs excess mainframe computer capacity of at least 100%. This includes data storage. It also needs a second team of programmers. Yet modern mainframe computers are operated on a 7 x 24 basis: seven days a week, 24 hours a day. The only time a mainframe computer is not running is when it is down for maintenance.

Third, there will be coding mistakes. These will crash the repaired system or else disrupt it. These buggy systems must then be checked, the errors repaired, and the system re-tested. The system may fail again. Time runs out.

Fourth, almost every organization has promised to be at the testing stage by December, 1998. Again and again, we see this deadline mentioned in public relations hand-outs and PR letters to clients. Ask yourself: Are all computrer systems equal? Are all programming teams equal? Can they all complete the job in the same month, no matter when they got started? It's nonsense. This preliminary deadline date is the product of lawyers, who have warned managers and directors that if they do not officially aim at December, 1998, they may be accused retroactively of not doing "due diligence" after the repair task fails to meet the Year 2000 deadline. They will then be sued, possibly even personally. (They will be sued anyway, assuming the courts are still functining and the government has not extended immunity to y2k-afflicted organizations, especially government organizations, as Nevada did in July, 1997. There is too much money at stake.)

If you are told by some official that his firm will be at the testing stage in 1998, write back and ask him the name of the mainframe time-leasing firm with which it has a contract, beginning the day after the first stage of the repair is completed. If the firm has no such written contract today, then either management must be planning to have available in-house an extra 100% of today's computing capacity or else management has no idea what the company will be facing in 1999.

It's Catch-22. If all organizations that say they will be ready to run the tests in early 1999 actually meet this deadline, then (1) there will be no excess computer capacity available to run them, or (2) there will be excess capacity only because hardly any firm has met the deadline for testing. I'm betting on the latter.

Updated - Subject

05-Feb-97   What Happens When the Repaired Code Fails the Test?
20-Mar-97   De Jager: Thorough Testing Will Not Be Done
27-Jun-97   Why We Know the Necessary Testing Will Not Be Done
21-Jul-97   Testing Takes About 70% of a Project's Time
17-Sep-97   Software Tools Do Little to Help in This Area
30-Sep-97   The SEC Warns the Investment Industry: You Must Test Fully
06-Oct-97   Industry-wide Testing: Securities and Credit Cards Only
10-Oct-97   Testing May Be Impossible in Some Systems
23-Oct-97   Inevitable Errors, Inevitable Shortage of Capacity
28-Oct-97   The Number of Errors Per Lines of Repaired Code
13-Nov-97   No PC Standards
17-Nov-97   FAA Computer Crash: Why Testing Has to Be Done
22-Nov-97   Testing All Possible Combinations of Interactions
01-Dec-97   Los Alamos National Lab's Standards for Testing
04-Dec-97   Parallel Testing Is Mandatory: Two Separate Systems
31-Dec-97   Excess Capacity for 1999 Testing; Hence, No Parallel Testing
05-Jan-98   The Limits of Parallel Testing
20-Jan-98   U.S. Government: Contingency Plans Needed; Tests May Fail
04-Feb-98   Four Stages of Every Test
11-Feb-98   Pre-2000 Tests Cannot Prove Success in 2000, Programmer Says
25-Feb-98   How Vendors Can Bankrupt Their Clients
10-Mar-98   Two-Thirds of US Firms Have No Testing Plans
16-Apr-98   Phone Testing: Mid-1999. Phone-Dependent Companies: Jan. 1998
24-Apr-98   Asia Is Far Behind
01-May-98   Gaps in Testing Threaten Retailing, Expert Warns
19-May-98   Southern Company: 18 Months of Testing
20-May-98   VENDORS: Panic Among Dependent Managers
27-May-98   There Are No Standards for Testing


Return to Main Categories

Return to Home Page