- Details regarding problems with the Obamacare website, which were ignored or simply allowed to pass through to meet the Oct. 1 deadline, are emerging.
- Testing of the complete system from beginning to end had not yet happened less than a week before launch.
- During a simulation of a few hundred users logging on at the same time, the system reportedly crashed.
- Some blame the federal agency managing the project's 55 contractors for failing to ensure all parts functioned well together before launch.
In this Friday, Oct. 11, 2013 computer frame grab, the HealthCare.gov website is displayed. (AP/HealthCare.gov)
WASHINGTON (TheBlaze/AP) — Crammed into conference rooms with pizza for dinner, some programmers building the Obama administration's showcase health insurance website were growing increasingly stressed. Some worked past 10 p.m., energy drinks in hand. Others rewrote computer code over and over to meet what they considered last-minute requests for changes from the government or other contractors.
As questions mount over the website's failure, insider interviews and a review of technical specifications by The Associated Press and others have found a mind-numbingly complex system put together by harried programmers who pushed out a final product that congressional investigators said was tested by the government and not private developers with more expertise.
Project developers who spoke to the AP on condition of anonymity — because they feared they would otherwise be fired — said they raised doubts among themselves whether the website could be ready in time. They complained openly to each other about what they considered tight and unrealistic deadlines. One was nearly brought to tears over the stress of finishing on time, one developer said. Website builders saw red flags for months.
The federal healthcare exchange website was allowed to be launched to the public despite red flags brought up by contractors. (AP/HealthCare.gov)
The Washington Post also spoke to several people close to the website's development, shedding light on the issues that were ignored or allowed to remain in order to meet the deadline dubbed "the tyranny of the October 1 date."
[sharequote align="center"]"We named it the tyranny of the October 1 date."[/sharequote]
One of these issues included the website crashing during a simulation of a few hundred people attempting to log in.
Here's just a snippet from the Post's article highlighting the development problems (emphasis added):
About a month before the exchange opened, this testing group urged agency officials not to launch it nationwide because it was still riddled with problems, according to an insurance IT executive who was close to the rollout.
“We discussed . . . is there a way to do a pilot — by state, by geographic region?” the executive said.
It was clear at the time, the executive said, that the CMS was still dealing with the way the exchange handled enrollment, federal subsidies and the security of consumers’ personal information, such as income.
One key problem, according to a person close to the project, was that the agency assumed the role of managing the 55 contractors involved and had not ensured that all the pieces were working together.
Some key testing of the system did not take place until the week before launch, according to this person. As late as Sept. 26, there had been no tests to determine whether a consumer could complete the process from beginning to end: create an account, determine eligibility for federal subsidies and sign up for a health insurance plan, according to two sources familiar with the project.
A review of internal architectural diagrams obtained by the AP revealed the system's complexity. Insurance applicants have a host of personal information verified, including income and immigration status. The system connects to other federal computer networks, including ones at the Social Security Administration, IRS, Veterans Administration, Office of Personnel Management and the Peace Corps.
President Barack Obama on Monday acknowledged technical problems that he described as "kinks in the system." He also promised a "tech surge" by leading technology talent to repair the painfully slow and often unresponsive website that has frustrated Americans trying to enroll online for insurance plans at the center of Obama's health care law.
US President Barack Obama speaks about the Affordable Care Act, the new healthcare laws, alongside healthcare professionals and people affected by the new legislation, in the Rose Garden of the White House in Washington on October 21, 2013. (SAUL LOEB/AFP/Getty Images)
But in remarks at a Rose Garden event, Obama offered no explanation for the failure except to note that high traffic to the website caused some of the slowdowns. He said it had been visited nearly 20 million times — fewer monthly visits so far than many commercial websites, such as PayPal, AOL, Wikipedia or Pinterest.
"The problem has been that the website that's supposed to make it easy to apply for and purchase the insurance is not working the way it should for everybody," Obama said. "There's no sugarcoating it. The website has been too slow. People have been getting stuck during the application process. And I think it's fair to say that nobody is more frustrated by that than I am."
The online system was envisioned as a simple way for people without health insurance to comparison-shop among competing plans offered in their state, pick their preferred level of coverage and cost and sign up. For many, it's not worked out that way so far.
Just weeks before the launch of HealthCare.gov on Oct. 1, one programmer said, colleagues huddled in conference rooms trying to patch "bugs," or deficiencies in computer code. Unresolved problems led to visitors experiencing cryptic error messages or enduring long waits trying to sign up.
Official numbers for how many people have actually enrolled have not been released by the government. (AP/HealthCare.gov)
Congressional investigators have concluded that the government's Centers for Medicare and Medicaid Services, not private software developers, tested the exchange's computer systems during the final weeks. That task, known as integration testing, is usually handled by software companies because it ferrets out problems before the public sees the final product.
The government spent at least $394 million in contracts to build the federal health care exchange and the data hub. Those contracts included major awards to Virginia-based CGI Federal Inc., Maryland-based Quality Software Services Inc. and Booz Allen Hamilton Inc.
CGI Federal said in a statement Monday it was working with the government and other contractors "around the clock" to improve the system, which it called "complex, ambitious and unprecedented."
The schematics from late 2012 show how officials designated a "data services hub" — a traffic cop for managing information — in lieu of a design that would have allowed state exchanges to connect directly to government servers when verifying an applicant's information. On Sunday, the Health and Human Services Department said the data hub was working but not meeting public expectations: "We are committed to doing better."
Administration officials so far have refused to say how many people actually have managed to enroll in insurance during the three weeks since the new marketplaces became available. Without enrollment numbers, it's impossible to know whether the program is on track to reach projections from the Congressional Budget Office that 7 million people would gain coverage during the first year the exchanges were available.
Instead, officials have selectively cited figures that put the insurance exchanges in a positive light. They say more than 19 million people have logged on to the federal website and nearly 500,000 have filled out applications for insurance through both the federal and state-run sites.
The flood of computer problems since the website went online has been deeply embarrassing for the White House. The snags have called into question whether the administration is capable of implementing the complex policy and why senior administration officials — including the president — appear to have been unaware of the scope of the problems when the exchange sites opened.
Even as the president spoke at the Rose Garden, more problems were coming to light. The administration acknowledged that a planned upgrade to the website had been postponed indefinitely and that online Spanish-language signups would remain unavailable, despite a promise to Hispanic groups that the capability would start this week. And the government tweaked the website's home page so visitors can now view phone numbers to apply the old-fashioned way or window-shop for insurance rates without registering first.
The House Energy and Commerce Committee was expected to conduct an oversight hearing Thursday, probably without Health and Human Services Secretary Kathleen Sebelius testifying. She could testify on Capitol Hill on the subject as early as next week.
Uninsured Americans have until about mid-February to sign up for coverage if they are to meet the law's requirement that they be insured by the end of March. If they don't, they will face a penalty.
On Monday, the White House advised people frustrated by the online tangle that they can enroll by calling 1-800-318-2596 in a process that should take 25 minutes for an individual or 45 minutes for a family. Assistance is also available in communities from helpers who can be found at LocalHelp.HealthCare.gov.
Associated Press writer Ricardo Alonso-Zaldivar contributed to this report.