As a senior storage engineer in our Customer-1 organization, I am responsible for storage lifecycle management including the installation, decommission, and capacity management of our clustered Data ONTAP (cDOT) and 7-Mode storage controllers. Our group is in the midst of moving all data hosted on 7-Mode storage controllers to cDOT clusters.
As part of our migration, we are installing additional cDOT clusters and nodes. The configuration of each high availability (HA) pair took about four hours, spread out over 2 to 3 days. The four hours did not include the time needed to configure the cluster inter-connect switches or initialize disks; this takes 2 to 12 hours depending on disk type. Plus typical office interruptions added more time as I had to figure out where I had left off. This sporadic schedule seemed to result in some configuration inconsistencies.
I challenged myself to see if I could automate the process to save time and reduce errors. Although I’m not a developer, I found it easy to write the script using the NetApp Software Development Kit (SDK). I run the script after the disks are initialized, cluster setup is complete, and the cluster inter-connect switches are properly configured. The script reads configuration information from a file, then applies the configuration to the cluster nodes. It does so by accessing the nodes via ZAPI calls, which is why it is fast.
The results have been amazing. The four-hour process now takes about five minutes to complete 99% of the configuration. It is now possible to install 24 nodes in two hours rather than 96 hours, a time savings of 94 hours or 2½ work weeks. Errors caused by interruptions have been eliminated. Automating this process has freed up my time to work on other projects.
If you are a storage admin, you can easily do this yourself with the SDK. I used an SDK tool called Z-Explorer that contains a complete list of all ZAPI calls for the cluster. With Z-Explorer most of the development work is done for you. It took me just three weeks to automate all the builds. This KnowledgeBase article is a good place to start.
It was a fun project because I could write the script without feeling like I had to be a developer. I wrote the scripts in PERL, but the SDK works with any language you are familiar with. I also used the SDK forum online to get advice from others. People were quick to answer my questions.
I’m now using the SDK to automate and streamline other storage tasks to save time and reduce errors. My next project is a quality assurance (QA) script that will login to a cluster and verify if nodes are properly configured per NetApp IT Standards and NetApp best practice guidelines. I plan to automate the cluster interconnect switch configuration in the same way as well as E-Series configuration.
UPDATE: The automation script is now available for download in the NetApp Storage Automation Store.
The NetApp-on-NetApp blog series features advice from subject matter experts from NetApp IT who share their real-world experiences using NetApp’s industry-leading storage solutions to support business goals. Want to view learn more about the program? Visit www.NetAppIT.com.by Ezra Tingler, Sr. Storage Engineer, NetApp IT