STS-122 MCC Status Report #02

STS-122
Report #02
5 a.m. CST Friday, Feb. 8, 2008
Mission Control Center, Houston, Texas

The seven member crew of Space Shuttle Atlantis has begun its first full day in space on an 11-day mission that delivers the newest research module, the European Space Agency’s Columbus laboratory, to the International Space Station.

Installing the laboratory, named for Christopher Columbus, is the primary goal of this 121st space shuttle mission. It will add 2,648 cubic feet of pressurized volume, four science experiment racks and one storage rack to the space station.

This morning’s wakeup song, “The Book of Love,” performed by Peter Gabriel, was played for European Space Agency astronaut Leopold Eyharts at 3:45 a.m. CST. Eyharts will become a member of the Expedition 16 crew, replacing Flight Engineer Dan Tani, after Atlantis arrives at the space station Saturday.

Today Atlantis Commander Steve Frick and his crewmates, Pilot Alan Poindexter and Mission Specialists Leland Melvin, Rex Walheim, Stanley Love, Hans Schlegel and Eyharts will perform an inspection of Atlantis’ heat shield using the shuttle’s robotic arm and the Orbiter Boom Sensor System. They’ll also check out the tools they need for Saturday’s rendezvous and docking to the station and install a centerline camera in the shuttle’s orbiter docking system.

Spacewalkers Walheim, Schlegel and Love will prepare spacesuits that they will wear during the mission’s three spacewalks; two by Walheim and Schlegel and one by Walheim and Love.

The International Space Station’s Expedition 16 Commander Peggy Whitson and Flight Engineers Yuri Malenchenko and Tani started their day at 4 a.m. CST. Today they will conduct a leak check of the Pressurized Mating Adapter 2 where Atlantis will dock to the station Saturday morning at 11:25 a.m. CST.

The next STS-122 status report will be issued Friday evening or earlier if events warrant.

STS-122 MCC Status Report #01

STS-122
Report #01
Thursday, February 7, 2008 – 4:30 p.m. CST
Mission Control Center, Houston, Texas

HOUSTON — Seven years to the day after the first laboratory was launched to the International Space Station, the Space Shuttle Atlantis roared into space this afternoon with the second, the European Space Agency’s Columbus lab.

Atlantis lifted off from the Kennedy Space Center on mission STS-122 at 1:45 p.m. CST. Aboard the shuttle are Commander Steve Frick, Pilot Alan Poindexter and Mission Specialists Leland Melvin, Rex Walheim, Stanley Love, Hans Schlegel and Leopold Eyharts. Schlegel and Eyharts are European astronauts.

Atlantis is in excellent condition. The shuttle is scheduled to dock with the International Space Station on Saturday. On Friday, the crew will use the shuttle’s robotic arm to inspect Atlantis’ heat shield on the wing leading edges and nose. They also will check the spacesuits that will be used for three spacewalks during the mission.

After Atlantis arrives at the station, Eyharts will become a member of the Expedition 16 crew, joining Commander Peggy Whitson and Flight Engineer Yuri Malenchenko. Flight Engineer Dan Tani, who has been aboard the station since October 2007, will return to Earth on Atlantis.

The launch of Atlantis is the 121st space shuttle launch and the 29th flight of Atlantis. The Columbus module is Europe’s primary contribution to the space station. Columbus will host experiments in life, physical and earth sciences.

The shuttle crew will begin a sleep period at 7:45 p.m. CST and awaken at 3:45 a.m. CST Friday to begin their first full day in space.

Atlantis now set to launch February, 7th

NASA has announced that Atlantis launch date will be no earlier than February, 7th. Unfortunately, I am currently extremely busy with my rsyslog project and don’t have the usual time to report on launch progress. I hope to be able to resume the usual coverage soon. In the mean time, please let me quote NASA’s shuttle home page:

Technicians at NASA’s Kennedy Space Center in Florida have completed the installation of the replacement feed-through connector in the engine cutoff sensor system to the internal connector. The feed-through connector passes the wires from the inside of the tank to the outside.

The pins in the replacement connector have been skillfully soldered to create a connection that allows sensors inside the tank to send signals to the computers onboard Atlantis.

The work is being done on Launch Pad 39A in anticipation of a launch date for mission STS-122 now targeted for Feb. 7 at 2:47 p.m. EST.

Atlantis’ main objective during its STS-122 mission to the Internaltional Space Station is to install and activate the European Space Agency’s Columbus laboratory, which will provide scientists around the world the ability to conduct a variety of experiments in life, physical, and materials science, Earth observation and solar physics.

Shuttle Endeavour’s STS-123 mission will deliver Kibo, the first section of the Japan Aerospace Exploration Agency’s laboratory module, and Dextre, Canada’s new robotics system to the space station. The launch of Endeavour is targeted for mid-March.

NASA managers will meet in the coming weeks to address the schedule of remaining shuttle flights beyond STS-123.

STS-122 Launch in early February?

As it looks, Atlantis will launch no earlier than February, 2nd on its STS-122 mission to the international space station. Some new problems have popped up and also been fixed since my last blog post. Unfortunately, I am currently quite busy with some of my projects and so I could not follow as closely as I usually did. However, I checked the status today and all in all it seems to look quite OK.

Tomorrow is another NASA PRCB meeting (they are each week on Thursdays). I expect that we will see an official status update on potential launch dates. In the mean time, tests on the external feedthrough connector removed from Atlantis’ external tank are being conducted. This is not yet completed and it will be interesting to see the test results.

At the launch pad, the cables have been soldered to the connector, giving them a solid connection. This very same fix was applied to Atlas rockets with similar issues some years ago.

In short, there actually is currently not much to report. The wizards at NASA are working very hard to find the actual root cause and a good fix for the ECO sensor issue. There is not much definite know today because it all depends on the outcome of testing and analysis. So lets stay tuned for what’s going on…

Shuttle Feedthrough Connector Removal Pictures

As a new year’s gift, NASA has place twelve interesting pictures from the December, 29th removal of the feedthrough connector in the media gallery. The original format is quite a bit hard to read (at least in my opinion), so I thought I recompile them in this post.

The feedthrough connector was removed to be shipped to NASA’s Marshall Space Flight Center for further cryogenic testing. This is part of the ongoing space shuttle ECO sensor troubleshooting. If you doubt why further troubleshooting is needed, you may want to have a look at my “xmas decoration and space shuttle similarities” post ;)

Very interesting to see the technicians at work.

First, the external connector cable is cut:


Then, a pair of support brackets is removed:


Before disconnecting the connector assembly, it receives a cleaning, removing any residual foam insulation:


Then, the connector assembly, with its associated electrical harness, is pulled away from the tank:


Technicians set up equipment that will be used to take X-rays of the connector cable:


Then, the connector is disconnected before it is demated from the external tank:


And finally the demate occurs:


The technician then inspects the connector just removed from the external tank:


Technicians wrap the connector for transport to NASA’s Marshall Space Flight Center in Huntsville, Ala., for further cryogenic testing:


… and place the wrapped connector in a shipping container:


which is then finally carried away for transport to the Marshall Space Flight Center:

Nice work, guys! And now I am eager to hear about the testing results in MSFC! Stay tuned…

Image Credit for all pictures: NASA

Atlantis troubleshooting continues…

Space Shuttle Feedthrough Connector used for the ECO Sensors.The analysis of space shuttle Atlantis ECO-Sensor trouble continues. Everybody focuses now on the Feedthrough Connector.
I have been involved in some (heated ;)) forum discussion on why NASA takes the time to analyse the issue and not provide a quick fix now that the culprit is know (remember, the Feedthrough Connector has been identified as the trouble spot via the TDR data tanken on the last tanking test).

A quick wrap-up on the connector: it is used to feed several signals through from the tank’s interior to the Orbiter systems. Among them are the ECO sensors as well as the 5% sensor signal. The connection essentially consists of three parts. The schematic can be found in the small picture above (click to enlarge). I found a more detailed sketch in the STS-114 Flight Readiness Review (FRR) document:
As you can see, the system consists of an external connector, the actual feedthrough that goes through the tank and an internal connector. As far as I know, the sole purpose of that system is to feed the internal signals through to the external stack parts while ensuring that there is no leak in the tank.

The external part of the connector has yesterday been unmounted and sent over the Marshall Space Flight Center for analysis. As far as I know, analysis results will be available on January, 3rd and will be the basis for the discussion on how to continue.

But back to my forum discussions. Why at all is an analysis been made?

There are a lot of technical words that could describe it. I will take a different route. I’d like to use a real-world analogy that most of us would probably be able to follow ;)

Let’s assume you own a house and it is xmas time. Chances are good you like to decorate your front yard with some nice lights. These lights need power and you need to draw that power from an outlet somewhere in, let’s say, your garage. Of course, the light’s power cord is to short, so you use an extension cord to connect the in-garage power outlet to the decoration’s plug in your yard. Everthing works perfectly and you are really proud of your fine lights.

But then, out of the sudden, a fuse blows and your lights go off. You begin to analyze the problem. One thing you notice is that it started to rain. But everything worked well a couple of times when there was rain, too. You blame the fuse, after all it was a pretty old one. So initially, you just go away with the issue, use a new fuse and be happy again.

After a while, on another rainy day, the fuse blows again. This time, you know it is a real problem. You do another analysis. In that course, you know that it must somehow be related to the extension power cord (let me just assume you somehow magically know it is ;)).

This is where we are with the ECO sensor system currently. The extension power cord is my analogy of the feedthrough connector. Testing done during the tanking test pointed at that connector, just as you now know it is the extension cord. However, test data did not say exactly what is wrong with the connector. In my sample, we also do not know what’s wrong with the extension cord.

Back to the sample: so what to do? If do not want to do a more in-depth analysis, we could simply replace the extension cord (just like we replaced the fuse) and hope that all is well. This might work, especially if we had little trouble in the past. It is also a quick fix, which is useful a few days before xmas (aka “time is running out).

If we take a bit more time, however, we might want to analyze what the root cause is. If we do, we may find out that the extension cord indeed was faulty. Maybe its water protection was damaged. Then, we’ll end up with swapping the cord, but this time with a very good feeling and confidence that our lights will stay on.

But analysis may also show less favorable results: maybe we find out that the cord is perfectly OK. But we made a “design error”. Maybe we find out that we used a non-outdoor rated cord in our “yard light system”. Replacing that cord with a like part would bring no improvement at all. In this case, we would need to do some more change – using an outdoor rated cord would be appropriate. Again, we could modify our power supply and have a very good feeling about its future reliability.

Unfortunately, space hardware is a bit more complex than xmas decoration. So analysis takes a bit longer. But it still offers the same benefits: if you look at the root cause AND be able to find it, you can reliably fix the system. Of course, there are limits and constraints. Too large delays bear other risk. It is NASA management’s task to weigh benefit and risk and do the right thing.

Oh, and one more note: I’ve heard so often “NASA just needs to do fix and everything will be easy. Just throw out that feedthrough connector…”.

Let me use my xmas decoration analogy once again. What that means is that you get a big digger and get rid of the extension cord at all – by creating a permanent electrical circuit with its own fully-outdoor-proven outlet right at the decoration. Of course, this is doable. Of course, it’ll fix the problem. It is just a “simple redesign” of your system. If think, however, that it is not the real smart answer to the problem you faced.

And I think many of all those quick fixes now being proposed “just let’s redesign the shuttle…” are along the same lines. If, of course, they were technically sound… ;)

I hope my sample helps clarify why there is analysis on the ECO sensor problem and why this is a good thing to have. Even though it may push Atlantis launch date a bit further down the calendar.

Atlantis’ launch moves to February 2008

Space Shuttle Atlantis is likely to launch not earlier than February. The target launch date of January, 10th 2007 for Atlantis STS-122 mission has been pushed back to early February. This is the result of today’s mission management meeting.

The official NASA shuttle home page is even a bit more cautious:

NASA space shuttle managers met Thursday and decided to modify a fuel sensor system to correct false readings that postponed shuttle Atlantis’ planned launches on Dec. 6 and Dec. 9.

Testing and analysis indicate that false readings from the engine cutoff sensor system occur in a three part feed-through connector. The connector passes electric signals from sensors inside the external fuel tank to shuttle electronics outside the tank. Technicians will remove portions of the connector and redesign the interface by soldering the pins to sockets at the external-to-feed-through side of the connector prior to installing the replacement into the external tank.

It is unknown how long it will take to complete the modifications and reapply foam to the shuttle’s external tank. Managers will assess the progress of the work before determining a new target launch date for Atlantis.

The emphasis is mine. The repair is quite time consuming. I have currently no details, but it looks like there will be no full root cause analysis. That would probably have required a rollback to the VAB and a destack, and that process would make an early February launch date impossible. I hope to get more details soon and will post them when I have.

STS-122 Launch Date Decision Today?

Today is the mission management team meeting for space shuttle Atlantis STS-122 mission. The meeting reviews work progress, data gathered and plans drawn and will finally conclude with a recommendation for the next steps. It is assumed that the launch date is targeted.

While January, 10th is still given as an option, news have condensed that this date will most probably not see a launch. It looks like a launch late in January or mid-February is more realistic. In any case, we’ll know much more when the meeting has concluded later today. A press briefing is expected shortly after the meeting. As far as I know, it was set for 10:30am ET, which means the meeting must have started right now.

Let’s see how the day evolves…

NASA’s holiday break

At Launch Pad 39A, a United Space Alliance technician carefully cuts away the foam insulation surrounding the covers over the feed-through connector box on the external tank for space shuttle Atlantis' STS-122 mission, revealing the fastener holes on the covers.The folks at NASA enjoy a few well-deserved days off during the holiday season. They have worked very hard and finally gotten close to the root cause of the ECO sensor problem. Well done!

As nasaspaceflight.com reports, there are some new problem reports. However, I think this is nothing really unusual, problems appear every now and then. Right now, we are just more aware of them. I personally think we should not get to concerned about them, at least not until further facts are known.

The mission management team is set to meet again on December, 27th. Then, they will look at the work done so far. Besides some work at the orbiter, this most importantly includes plans drawn to address the ECO sensor problem.

From what I have read, the actual root cause is still unknown. It is know that the problem is inside the LH2 feedthrough connector, which is good and provides a lot of repair options. However, the question why the connector suffers problems is not answered yet. As of my understanding, NASA prefers to get hold of Atlantis’ feedthrough connector. That would enable detailed analysis with the actual failed part – and thus there is an excellent chance of finding the root cause. However, that is probably one of the more time consuming options. If that route is taken, launch would be further delayed, and January 10th would not be an option any more.

With just the little information I know, I think it would be useful to sacrifice the launch date in order to get access to the failing feedthrough connector. Remember: the external tank is the only part of the space shuttle stack that is not reusable. As such, analyzing the feedthrough connector after launch is not an option. I personally think it would make more sense to launch, let’s say, in February if that offers the choice to find the root cause. That would not only be good for the remaining shuttle flights, but could also provide valuable “lessons learned” for the Constellation program. Even if Ares will not fly ECO sensors (I don’t know…), the root cause may show something that we do not yet know, be it electrical engineering related, material sciences or whatever else. Getting that missing information can possible increase our understanding and help prevent other, not yet know, problems in future equipment.

But again, keep in mind I have very limited insight. Maybe NASA has even a way to find root cause and still maintain the January, 10th launch attempt. I don’t know for sure. But I know that after the December, 27th press briefing we’ll probably know more. And if you plan to travel to see Atlantis January launch, I wouldn’t book my tickets too early…

NASA website problems…

Unfortunately, there seem to be some problems with at least a number of NASA websites. Most importantly, the KSC media gallery is no longer accessible. I noticed that yesterday, when I tried to find a good picture to go with yesterday’s article. Unfortunately, the site seems to be defunct and the problem still persists.

Of course, I doubted a local problem first. However, other users (from all around the world) report similar problems. Also, being a network guy, I traced the NASA site both from Europe and the US and it didn’t work in either case. NASA currently has IP packages being bounced between two systems, until the packets expire. Looks like either a router has died or there is a configuration problem.

Unfortunately, the media gallery is not the only resource that is down. Essentially, a number of KSC sites are affected and so I guess there is a problem with the main public Firewall (or whatever…). The bad news is that this will limit my ability to post nice pictures along with the blog posts. Obviously, I hope the situation will be resolved soon. In the mean time, you know why there are so few pictures in the blog these days ;)