configure ; make install ; cd build to see the goodies
+you have. To understand what you have built and how to copy the files
+from the install directory to your BG/L, read on.
+
++parallel I/O, and performance monitoring tools. Most of the time, to +accomplish our Computer Science research goals we must replace IBM's +inflexible closed-source components with Open Source versions that we +have either written from scratch or from other Open Souce pieces. The +new components are faster, better, smaller, more flexible, more +reliable, and have tons more features that IBM's original +counterparts.
Running ZeptoOS components on BlueGene/L transforms your closed, slow, impossible to enhance or debug system into an Open Source platform that can be debugged, customized, and enhanced.
-
+
+ +IBM releases system software using some version numbering scheme +borrowed from an ancient Mayan calendar. This version of ZeptoOS has +been thouroughly tested with "Driver 202". Usually, it is a symlink +from /bgl/BlueLight/ppcfloor, and has a real name like +/bgl/BlueLight/DRV202_2005-050606. However, very few (if any) +significant enhancements are made to the ION kernel and run-time +between driver releases, so we suspect that ZeptoOS V1.1 could be +compatible with other BGL Drivers. If you have a different driver, and +would like us to test ZeptoOS on your platform, please let us know. +The Argonne National Laboratory BG/L system currently runs ZeptoOS +V1.1 and Driver 202 without any problems.
We are busy working on future versions of ZeptoOS that will replace the current limited-functionality and closed-source Compute Node @@ -107,65 +132,235 @@
+You can simply type the following command in this directory. + +
+# ./create-ramdisk.sh ++
+creates a default setting ramdisk which is size-optimized. +
+If you need to add extra tools, copy your stuffs to datatree and modifiy datatree/debugfs.cmd. + +
+This directory contains BG/L IONODE kernel patches and compile script. +Base Linux Kernel is not included here but it's automatically downloaded +when you start compile.sh. +
+To compile BG/L IONODE kernel, simple type compile script like +
+# ./compile.sh ++ +
+Requirement: + +
+------ +Note +- uncompressed ramdisk size is 16MB fixed. + If you need bigger size, please fix create-ramdisk.sh by hand + +See the top level COPYING file for license information + +
+Copyright (c) 2005 Argonne National Laboratory / University of Chicago. +All Rights Reserved. + + +
+If you have question about these tools,
+
+please e-mail to Kazutomo Yoshii
QUICK USAGE
+
When you need to submit a job with your IONODE kernel and ramdisk,
you need to copy your kernel image or ramdisk image to the following
location. BG/L IONODE kernel and ramdisk location is expected to be
-/bgl/argonne-utils/profiles/${YOUR_PROFILE}/INK for kernel
-/bgl/argonne-utils/profiles/${YOUR_PROFILE}/ramdisk for ramdisk
+/bgl/argonne-utils/profiles/${YOUR_PROFILE}/INK for kernel
+/bgl/argonne-utils/profiles/${YOUR_PROFILE}/ramdisk for ramdisk
-Then, submit a job with cqsub -k option.
+Then, submit a job with cqsub -k option.
+
+
-This directory contains BG/L IONODE kernel patches and compile script.
-Base Linux Kernel is not included here but it's automatically downloaded
-when you start compile.sh.
+
+
-- blrts gcc compiler
-( located in /bgl/BlueLight/ppcfloor/blrts-gnu/bin/powerpc-bgl-blrts-gnu-gcc )
+
+
+
-------
-Note
-- uncompressed ramdisk size is 16MB fixed.
- If you need bigger size, please fix create-ramdisk.sh by hand
+
-Copyright (c) 2005 Argonne National Laboratory / University of Chicago.
-All Rights Reserved.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
# cqsub -k ${YOUR_PROFILE} ....
+
[ How to create your own ramdisk ]
-You can simply type the following command in this directory.
-# ./create-ramdisk.sh
+
+The ZeptoOS-V1.1 Features
+
+The ZeptoOS I/O Node kernel and tool chain have many advanced features
+not available in the stock IBM kernel and tool set. A highlight of
+those features is provided below:
-creates a default setting ramdisk which is size-optimized.
+
-If you need to add extra tools, copy your stuffs to dataree and modifiy datatree/debugfs.cmd.
+
Whew!, you can now log into your I/O nodes and debug, load kernel
+modules, and make improvements to your system. ZeptoOS provides SSH
+and a micro-telnet application. The default configuration is simple:
+a partition owner may SSH into an I/O node
Need a way to get big data in and out of your BlueGene/L? You
+want parallel file access instead of slow NFS? Look no
+further - PVFS2 works on BG/L! ZeptoOS includes built-in support for
+parallel I/O via PVFS2. Just load up the latest ZeptoOS environment
+and point them at your PVFS2 servers for ultra-fast parallel I/O
With the IBM tool chain, it was very difficult to build kernels and
+tools for the I/O Node. The Kernel had to be compiled with a
+specially modified GCC 3.2, and the ramdisk tools needed to be
+compiled with GCC 3.3.3 from SuSE. Complicated and error prone. The
+ZeptoOS tool chain fixes all that with a default GCC 3.3.4 tool chain
+that can compile both the kernel and ramdisk tools and any other
+applications you may want to run on the I/O node.
BusyBox, "The Swiss Army Knife of Embedded Linux" has been rebuilt
+to use uClibc, the small libc optimized for embedded systems. Viola!
+your ramdisk is about 1/2 the size, giving your I/O buffers more
+memory and making your partitions boot faster.
It is not always convenient to build and compile large tools sets
+on PPC32 platforms (unless you have a bladeserver under your desk).
+ZeptoOS supports cross-compiling kernels and ramdisks from your x86 Linux
+laptop.
The source code for the ZeptoOS Kernel and all the utilities is
+included in the distribution. This includes the Linux kernel,
+BusyBox, the tool chain, the compiler, etc. If you need to tweak a
+compiler setting or adjust something in the kernel, the source code is
+waiting for you.
ZeptoOS includes a specially constructed, easy-to-use
+configuration utility. Borrowing from the Linux Kernel, the
+configuration utility allows you to change compile/build parameters
+with the menuconfig. Plus, making the ramdisk could not be
+easier. Want to add a special package or file to the ZeptoOS ramdisk?
+Simply drop in your code, configure, and build. The advanced tool
+chain does the rest.
The original IBM environment was tool-challanged. The new ZeptoOS
+kernel includes useful tools such as
lsof and a specially
+modified strace. Plus, it is easy to add your own.ZeptoOS supports passing arguments to the Linux kernel, a feature
+not available in IBM's kernel. A simple tool allows kernel parameters
+to be stored and fetched from the ramdisk. This innovation, only
+available on ZeptoOS, enables special run-time decisions and
+configurations.
When kernel boots, it can send messages to the Service Node.
+ZeptoOS has made this easier to manage and use. It is now possible to
+quickly send debugging and kernel logging messages early in the boot
+sequence, and throughout execution. It can be turned on and off via a
+kernel parameter, and programs can emit special logging messages
+simply by using
/proc/zepto/mbox. Tracking down problems
+is a snap.ZeptoOS includes a tool that maintains dynamic state information
+on BG/L I/O Nodes. The daemon,
zinfod, listens to
+special status information sent during booting and shutdown. This
+information is made available to external programs. The user program
+zinfo provides information on which IO nodes were
+allocated to your job, and can block on their successful boot so
+specific actions can be trigged once the BG/L nodes boot. Similarly,
+a process can wait for an I/O node to shutdown. Dynamic connections
+and interactions with running partitions are now possible. When I/O nodes boot, it is very convenient to run some
+initialization routines that can be maintained on the Service Node.
+ZeptoOS makes it easy to run NFS-mounted scripts from the Service Node
+on startup and shutdown.
The ZeptoOS Linux Kernel for BG/L I/O Nodes
+
+The ZeptoOS Linux kernel for BlueGene/L I/O nodes is based on the
+original 2.4.19 Linux supplied by IBM under the GPL. The original
+Linux distributed by IBM was jumble of kernel files, some deleted,
+some added, and some modified. To better manage those changes, they
+have been separated into three patch sets plus an additional set added
+by the ZeptoOS Team. The resulting kernel files are:
+
+
+
+
+
+patch-2.4.19-bgl-zepto-v1.1 contains the following updates or fixes.
+
+
+
+
+
+
+
+
+
+
+
+