Troubleshooting

My friend Darla Hallmark sells buttons that say, “The problem with troubleshooting is that trouble often shoots back.” In my job operating telescopes at Kitt Peak National Observatory, I often get to see the truth of that statement. Here I am in my natural habitat at the control station of the WIYN telescope.

My actual title at Kitt Peak is “Senior Observing Associate” and my job is more than being a telescope driver. I see myself as the person whose job it is to make sure the astronomers who use the telescopes actually get the data they hope to obtain. At night, especially at the WIYN telescope, I’m often the only person in the building. It’s quite common for observers using the telescope to control the cameras over the internet and talk to me all night on a Skype connection.

The observatory has a daytime staff of engineers, electricians, mechanics and more. Most of them are tucked snug in their beds when I’m working through the night. So, if something goes wrong, I’m the guy who has to fix it, or find a workaround until the next day when the daytime staff returns to work. I think its a real testament to the design and maintenance of the telescopes at Kitt Peak that serious problems don’t crop up all that often, but when they do, they can be a challenge.

We had one such problem this week at WIYN. We were using the Hydra spectrograph. Instead of an eyepiece or a camera looking directly at the sky, there is a metal plate. Fiber optics in magnetized housings sit on that metal plate and face the sky. A robot within Hydra can move those around so they’re in a position to capture light from distant objects. This week, each fiber was placed to catch light from galaxies approximately 11 billion light years away. As you can imagine, you need to place that fiber in just the right place to catch that tiny bit of light. This is what the inside of the Hydra spectrograph looks like. You can see the fibers on the left-hand side. The robot that moves the fibers is on the right.

The problem we had was that some of these fibers were missing the light. To confuse matters, not all the fibers were missing the light. We saw light from some galaxies. We saw light from all the stars that let us do fine corrections to our pointing on the sky. My first thought was that there was a calculation error and not all the fibers were being placed correctly. The astronomer looking at these galaxies checked and eliminated that possibility. Next, we used a camera on the robot to watch the fibers as they were being moved to see if they were being placed where we put them. The robot did just what it was supposed to do.

The final step in this procedure is that the metal plate on the left gets warped, because the telescope’s focal plane isn’t actually flat. We watched the fibers as the plate was warped. The fibers in the center “jumped.” That’s not supposed to happen. As of this writing, I’m not sure why warping the plate made some fibers jump but not others, but the obvious workaround is not to warp the plate. What this means is that some galaxies will be better focused than others, when we take data, but since we’re taking spectra, that’s not a showstopper. We just care that the light makes it down the fiber. Once that happens, the astronomer can see what elements exist in that galaxy and get information about how far away it is and how fast its moving. As the weeks goes on, that team of engineers and technicians will take the information I learned about the problem and work to find a solution.

If you enjoyed this behind-the-scenes look at my job operating telescopes, you might enjoy my novel, The Astronomer’s Crypt. It tells the story of ghosts, gangsters, astronomers, and a dangerous Apache spirit colliding at a New Mexico observatory on a dark and stormy night. You can learn more about the novel and watch a cool trailer at: http://www.davidleesummers.com/Astronomers-Crypt.html.

If spooky stories aren’t your thing, but you’ll be in Phoenix, Arizona on Thursday, May 9, you can join me at the next meeting of the Phoenix Astronomical Society, where I’ll be talking about the DESI project on the Mayall 4-meter telescope and sharing some behind the scenes photos of the installation. You can get more details about the meeting at: http://www.pasaz.org/index.php?pageid=meetings

Reassembling the Mayall

Back in July, I discussed some of the different components that had come in for the DESI instrument being installed at Kitt Peak National Observatory’s Mayall 4-meter telescope. You can read about them in the post, Assembling the Puzzle. The corrector optics and hexapod alignment system have been installed into the telescope’s top end. Here I am, hard at work torquing the bolts that hold it all together.

If all goes according to schedule, the new top end will be lifted to the top of the telescope next week. At that point, the telescope will look more like itself again. Control cables and network boxes for the top end assembly will then be assembled so astronomers working in the control room can talk to the instrument. At that point, the work platforms that are visible in the older post will be disassembled. Here’s a look at the top end, almost ready to lift up to the top of the top of the telescope.

Once the top end is back on the telescope, the primary mirror, which is currently out of the telescope, will need to be re-aluminized. Telescope mirrors are finely polished, curved glass. Over the top surface is a very thin layer of aluminum which is applied in a vacuum chamber. The vacuum chamber for this process is the biggest one in the southwestern United States. I describe a scary scene involving such a chamber in my novel The Astronomer’s Crypt. Fortunately, care is taken to operate the chamber very safely in real life.

One thing to note about the top end in the photos above is that there is no actual instrument mounted yet. Astronomers rarely sit at an eyepiece actually looking through a telescope anymore. Most of the time, there’s a high precision digital camera looking through the telescope. Sometimes that high precision camera is designed to look at a specific wavelength region, such as optical light or infrared light. Sometimes that camera doesn’t look at the sky directly, but at light that’s been reflected off a grating. A grating is just a reflecting surface that breaks up light like a prism. The advantage to a grating is that you lose less light than you do when you shoot it through a chunk of glass. Breaking up light then allows you to see lines in spectra that tell you about the chemistry of the object you’re looking at.

In a nutshell, that’s the kind of instrument DESI is. Astronomers are interested in the chemistry of the objects they’re looking at. However, there’s one other feature you get by studying these spectral lines. When an object moves, the lines shift toward the blue end of the spectrum if the object is moving toward the observer or toward the red end of the spectrum if the object is moving away. That’s what we mean when we talk about blue shift and red shift. What’s more, how far the chemical lines have shifted is a measure of the object’s velocity through space. The goal of DESI is to measure the velocity of some 5000 objects every time the telescope points to a new target. That said, this data will be available to everyone and it contains all the fundamental chemical information about the objects the telescope is pointing at.

Before the final DESI instrument goes on, there will be a commissioning instrument. That will be more like a regular camera—more like looking through an eyepiece. The goal of the commissioning instrument will be to align the telescope on the sky after all this work has been done and assure that the telescope has good pointing so that we can get the best data when we’re using the spectrographs later.

Once the commissioning instrument goes on the telescope, I’ll return to my regular nighttime duties at the Mayall, shaking down the rebuilt telescope and getting it ready for its next five year mission. My novel, The Astronomer’s Crypt, which I mentioned in passing, is not just a horror novel, but it provides a look behind the scenes at an observatory. If you’re interested in seeing what goes on at night at a facility like Kitt Peak, or one of the other observatories where I’ve worked over the years, it’s a great place to start. Just be warned, not only will you encounter astronomers, engineers and technicians, but some ghosts, a monster from Apache lore, and a few other surprises as well. You can get more information about the novel at: http://www.davidleesummers.com/Astronomers-Crypt.html


Ten (plus) Years at Kitt Peak

David Lee Summers, Christian Soto, and Dick Joyce at the annual AURA service awards ceremony.

This month, I received my ten-year service award from the Association of Universities for Research in Astronomy for my work at Kitt Peak National Observatory. The awards were presented following an annual presentation on the state of the observatory. Other award recipients included my boss, Dick Joyce, whose been with Kitt Peak for 45 years and one of my fellow Observing Associates, Christian Soto, who is celebrating his five-year anniversary. The photo shows the three of us at the University of Arizona ballroom where the presentation was given.

As it turns out, I’ve actually worked at Kitt Peak for more than a decade. I was tempted away from graduate school in 1992 and worked at the observatory until 1995. During that time, I watched the WIYN 3.5-meter telescope’s construction and served as one of its first four operators. I left because my wife and I were expecting our first child and I wanted a job that allowed me to be home more of the time. So, I went to work helping to finish commissioning a 1-meter telescope run by New Mexico State University. In late 2007, a former co-worker from Kitt Peak called me up and said they needed experienced telescope operators and asked if I wanted to return. At that time, I was a full-time writer and editor and wasn’t sure I did want to, but I agreed to an interview. They offered me a job and after much soul-searching I decided to return. I started in February 2008. So, now that it’s October, that means I’ve actually worked at Kitt Peak for about fourteen years. Unfortunately, human resources said I was away too long for my previous seniority to count, but my boss has expressed an interest in rectifying that if possible. We’ll see if that happens.

I feel like I made a good decision in returning. One surprising fringe benefit was that I became a more productive writer even though I was working full time. I suspect there are a few reasons for that. First of all, it forced me to better organize my time. Also, it put me into a position where I was interacting with people face-to-face more regularly, which I think helped me to bring more depth and emotional realism to my writing. Of course, the story of my departure and my return directly inspired elements of my novel, The Astronomer’s Crypt.

In the book, Mike Teter leaves the observatory because of a frightening experience. As it turns out, his experience was based on something that happened to me in my first tenure at Kitt Peak. It was a windy, stormy morning and I had gone up to make sure I’d serviced the instrumentation for the morning. The wind rattled the dome and there was an energy in the air. I had an unshakable feeling that something didn’t want me there and some kind of force was coming to remove me from the mountain. That frightening feeling went away after I’d had some sleep and I didn’t leave because of that incident, but I asked myself what if there really had been an evil force? What if it had manifested? Would I have been able to stay if my fears had actually materialized? I channeled that experience into the novel’s prologue. I know prologues often get a bad rap, but I made it a prologue not because it was “optional” but because it was an inciting incident that happened a few years before the main action of the novel.

If you’re in the mood for a scary read this Halloween week, you can read the entire prologue for free at http://www.davidleesummers.com/Astronomers-Crypt-Preview.html. If you get to the end and find you’re hooked, I have information about how you can order a copy of the novel. Hope you have a spooktacular week!

The Circle of (a Writer’s) Life

On Friday, I typed “The End” at the bottom of the last page of my latest book, Firebrandt’s Legacy. The book collects previously published stories of a space pirate captain named Ellison Firebrandt and his crew and adds some new stories to create what amounts to a “fix-up novel.” Each chapter is a short story, but the whole thing forms a complete story arc.

Like typing “The End” on most books, this really represents the beginning of the road to publication for this book. In this case, I don’t expect editing to be quite as arduous as some books I’ve worked on. Many of the original stories have been edited by such people as Hugo-nominated editors Jennifer Brozek and Bryan Thomas Schmidt. Of course, the new stories will need a critical eye and care will need to be taken to make sure the stories all work together as a whole. For those who want an early look, chapters 1 and 12 are available for anyone to read at my Patreon site. Thirteen chapters are available to read for all patrons—and it only costs $1.00 per month to be a patron. You may cancel at any time. I plan to share the last two stories this month. The site is: https://www.patreon.com/davidleesummers

Now these chapters are likely to get tweaked as beta readers and my editor work their way through it, but your support will help me pay cover artist Laura Givens and help pay the costs of editing and typesetting the book. What’s more, to show my appreciation, I plan to share a gift code with my patrons that will allow them to download the complete book once finished. I’ve also adjusted my Patreon goals. One of those goals is that with sufficient support, I can make this blog ad free.

As it turns out, I finished this book the day after I received news that I had been promoted from “Observing Associate” at Kitt Peak National Observatory to “Senior Observing Associate.” In essence, the promotion recognizes my seniority at the observatory plus the work I’ve been doing with the on-line manuals for my fellow operations’ staff.

These moments coming together do cause me to reflect on where I’ve been and where I’m going. I worked in astronomy full time from 1990 until 2000. At which point, I decided to devote myself to writing and editing full time. I did that until 2008 when staff members at Kitt Peak asked me if I wanted to return. I agreed under the provision that writing was recognized as my primary career. So far, my supervisors have been very supportive of this. I also returned because I feel astronomy is a way that I contribute to the larger body of human knowledge. My position as an astronomer and a writer allows me to communicate some of what we learn to the public through appearances at conventions and through this blog. This broader support mission is not part of my job, though, it’s supported through sales of my books and Patreon supporters.

My schedule at the observatory is not all that flexible, it involves working long nights, and those nights often require full concentration. My pay is pretty good for living in the southwest, but even with the most recent raise, it’s still below the average salary in the US according the Census Bureau. I note this just to point out that despite my full-time job, I’m not a well-to-do hobbyist. I do need support from sources like book sales and Patreon to continue publishing and to afford travel to events.

So, looking ahead, I’ll spend this fall polishing Firebrandt’s Legacy for publication. I’m scheduled to appear at several events including Bubonicon in Albuquerque, CoKoCon in Phoenix, TusCon in Tucson plus I’ll be signing books next month at a local bookstore. More about each of those soon.

I’m also working on some projects that I can’t discuss yet and am not entirely sure when I’ll be able to announce them or whether they’ll bear fruit at all. I say this less to tease you and more to say I am working on things in the background. In the meantime, as I announced on July 21, after Firebrandt’s Legacy is complete, I do plan to turn my attention to a new edition of The Pirates of Sufiro, which was my very first novel. In a way, “The End” on Firebrandt’s Legacy has caused me to spiral back to the first book I wrote and I hope to take what I’ve learned on life’s journey so far and make it an even better book. Whether it’s through my books, appearances at conventions, Patreon, the web journal or some combination, I hope you’ll come along with me for this exciting journey.

The Cost of Opening the Crypt…

…just went down! Courtesy of my publisher, the ebook edition of The Astronomer’s Crypt is being offered for the special price of 99 cents for the rest of the month. The ebook normally runs $4.99, so this is a remarkable 80% discount, which means it’s a great time to pick up a copy for your ereader. If you’re already a fan, consider gifting one to a friend!

The Astronomer’s Crypt tells the story of astronomers, ghosts, drug dealers, and a monster from Apache legend colliding at a remote observatory during a violent thunderstorm. As followers of the web journal know, I’m an astronomer who operates telescopes at Kitt Peak National Observatory. The observatory is 56 miles southeast of Tucson, Arizona. The last ten miles of the drive up to the observatory are up a road that winds and twists its way up the mountain. Once you reach the summit, you find a virtual city consisting of twenty-two optical telescopes and two radio telescopes. Even so, after the sun goes down, many of the telescopes on the mountain are automated and some are only operated part time. It’s not unusual for there to be only a handful of people at the observatory at night. That all noted, Kitt Peak is both quite accessible and quite well staffed compared to some astronomical facilities where I’ve worked.

I have worked many nights in my career at observatories where I’ve been one of perhaps two or three people on a remote mountain site. It’s dark. The insides are the buildings are kept deliberately dim so your eyes can adjust if you need to go outside and evaluate sky conditions. In a wilderness situation, wild animals can and do make it inside the buildings. It’s so quiet, you hear every creak and groan of the building. You’re working late at night and you’re tired and not always thinking clearly. You’re trying to focus on the data you’re taking. It’s easy for a person in those conditions to imagine many scary things.

The Astronomer’s Crypt is a book made up of many of those dark imaginings, some of which are not far from the truth. Over the years, I’ve encountered unexpected people at observatories during the night. Fortunately, most have been cooperative and left when asked, but I have wondered what I’d do if I encountered truly bad people. I’ve been to observatories such as Lowell in Flagstaff, where there are real mausoleums on the site, where people who loved astronomy are interred. It’s not hard to imagine ghosts wandering around at those places. I’ve been through many terrible storms, sometimes with sheets of rain pushed by winds in excess of 70 miles per hour. On those nights, nature itself is terrifying. You can get a sense for how all of this combines in the novel by watching the trailer:

Two years before the events of this trailer, on a stormy night, in the dead of winter, Mike Teter experienced something that would change his life forever. Mike was a telescope operator at the world renowned Carson Peak Observatory in New Mexico. I won’t tell you what he saw that night on the mountain nor what happened afterward on a dark stretch of highway, because it would haunt you just as it has haunted Mike. But what I will tell you is that Mike is back at Carson Peak. And what he witnessed that night two years ago is about to become a reality…

You can pick up The Astronomer’s Crypt for just 99 cents at:

NEID – A New Way of Seeing Exoplanets

Last week, I talked a little about the work we’re doing refitting the Mayall 4-meter Telescope for the Dark Energy Spectrographic Instrument. However, it’s not the only construction going on at Kitt Peak. The WIYN 3.5-meter telescope, which I also work with, is getting a new spectrograph installed called NEID. Deploying NEID doesn’t require a full telescope refit like deploying DESI, but there’s still quite a bit of work happening in the building.

Most of the work right now is going into building a new bench spectrograph room. NEID is an acronym for “NN-explore Exoplanet Investigations with Dopler spectroscopy”. The word “neid” is also the Tohono O’Odham word meaning “to see.” An appropriate choice, given Kitt Peak’s location on the Tohono O’Odham Nation in Southern Arizona. The goal of NEID is to provide the astronomical community with a state-of-the-art Doppler spectrograph to investigate exoplanets around nearby stars.

The way this will work is that an optical fiber assembly will be mounted to the telescope itself at the port in the photo to the right with the sign on it. That optical fiber will carry the light from the star to the new bench spectrograph downstairs where it will be spread out, like a rainbow. The reason for doing this is not to see a pretty rainbow, but to see dark lines interspersed through the rainbow. Those dark lines are like the star’s chemical fingerprint.

Now, here’s the fun part. When a planet moves around the star, it drags the star just a tiny amount toward the Earth which causes that spectral fingerprint to shift a little bit toward the blue end of the spectrum. When the planet passes behind the star, it drags it away from the Earth and moves the spectral fingerprint toward the red end of the spectrum. Looking for this shift is the “Doppler” approach to finding planets that NEID will employ.

In addition to discovering new planets, NEID will be used to follow up observations by NASA’s Transiting Exoplanet Survey Satellite (TESS) and will help to determine masses and densities for planets TESS discovers. By the way, the NN-Explore that’s part of NEID’s acronym stands for NASA-NSF-EXoPLanet Observational REsearch. The current plan is to begin commissioning the instrument this fall and for regular observations to commence in 2019.

Being part of on-going research into planets around other stars is what inspired Dr. Steve Howell of NASA’s Ames Spaceflight Center and I to invite science fiction writers to imagine what these planets around other stars might be like. The results were our two anthologies, A Kepler’s Dozen and Kepler’s Cowboys. You can learn more about the anthologies by clicking on their titles.

Once NEID goes online and starts making discoveries, Steve and I may have to “see” into the future and collect a third anthology. This time, including stories about planets discovered by a telescope on a mountaintop in Arizona’s Tohono O’Odham Nation.

Refitting the Mayall: Teardown

I was in 8th grade when Star Trek: The Motion Picture came out. One of the things that fascinated me in that movie was the refit of the Starship Enterprise. I was captivated by how the ship looked at once much the same and yet completely different. It looked sleeker and more powerful and familiar space on the ship such as the bridge, sickbay, and the transporter room had all been updated. I’m getting to experience something much like the Enterprise refit in real life. In this case, I’m involved in refitting the Mayall 4-meter telescope at Kitt Peak National Observatory.

Like the Starship Enterprise, the Mayall has a forty-five year history of discovery. Originally built to use photographic plates, the telescope has played an important role in such discoveries as establishing the role of dark matter in the Universe from measurements of galaxy rotation, and determining the scale and structure of the Universe. Over the years, new instrumentation has been added to the telescope including advanced digital cameras and spectrographs.

The purpose of the refit is to install a new instrument called DESI, which stands for Dark Energy Spectroscopic Instrument. 5000 optical fibers will be installed at the telescope’s prime focus (the top end of the telescope) and run to cameras in another room. The goal is to observe tens of millions of galaxies and quasars, constructing a three-dimensional map spanning the nearby universe to 10 billion light years.

In order to achieve this goal, the entire top end of the telescope has to be replaced and much of the control software and electronics are being redone so that it’s truly state of the art. To achieve this goal, we literally have to gut the telescope and install new components from the inside out. During my most recent shifts at the telescope, I’ve been involved in just that. In the photo to the right, you can see that the bottom of the telescope is missing and replaced with scaffolding. That’s because the large 4-meter mirror is out for recoating. Also, all the optics are missing from the secondary mirror assembly at the top of the telescope. Ultimately, that will be removed completely and replaced with a new secondary ring. The men in the photo are removing a counterweight assembly used to precisely balance the telescope when instruments are added and removed. Electrical panels are open on the side of the telescope where control cabling going back to the photographic days will be removed and replaced with new control cabling. Modern electronics mean the telescope will have about 10% of the cables as it did when originally built!

The refit has also allowed me a rare opportunity to see parts of the telescope I’ve never been to before, even after operating it for some thirteen years. Earlier this week I got to help the electronics technicians work on some cabling in the “horseshoe.” That’s the big, blue horseshoe-shaped mount you see in the photos above. We actually ended up working down in the broad, blue, oval-shaped tube you see in the photo just above. I dubbed it the sinking submarine, because it’s a cramped space and we were standing at a 32-degree angle relative to the ground!

It’s going to be exciting to watch the telescope take shape again after the teardown process. New parts will be arriving in the coming months. A large crane will be deployed outside the 4-meter to lift out the old secondary ring and bring in the new one. The plan is to be back on sky to test components of the new instrument later this year. Once those tests are completed, other components will be finished, revised if needed and then installed. At that point, the Mayall’s new five-year mission to map the universe will begin.