Monthly Archives: March 2011

Epic Archlinux/Debian/Gentoo/Grml/OpenSUSE April Fools Joke is epic. The Canterbury Distribution indeed.

Posted on by pappp | Leave a comment

Cluster GPU Thermal Monitoring

The research group has been writing some simple monitoring scripts for handling the clusters. The focus is mostly on montitoring NAK (page in serious need of update), which has always had thermal irregularities with it’s GPUs. Some of the (poorly designed) GPU coolers have recently finished cooking their fans, and the “repair” has been to remove the cowling and mount an 80mm fan in the case to blow across the heatsink — this produces comparable temperatures to the vendor solution, whch is pathetic. This thermal instability requires that the system temperatures be periodically checked, and we have written variety of colorful scripts both for users and for the displays in the front of the machine room. The one I wrote for my own use is a simple combination of bash and AWK, which produces nice colorized one-line summaires for each machine when run with something like “mpirun –hostfile ~/nakhosts ./pstatc.sh | sort” where nakhosts is a standard MPI-friedly list of hosts, and ~/bin/ has nvidia-smi (a little tool for handling nivida GPUs from the command line) exported to the nodes. Script attached here for perusal (and so I can find it later). Possibly the best part is that it made me referesh my memory on using ANSI Color Escapes, which has been on my list of skills to touch up for a while – That foray also lead to souping up the script Hank was working on to use background colored spaces for ghetto bargraphs to keep the displays in the windows of the machine room interesting until we are set up to drive them with something else. One of these days I really should learn to use ncurses, or at least get better with one of the GUI libraries…

Posted in Computers, DIY, General, School | Tagged , , | Leave a comment

RIP N810

My N810 finally bit it yesterday – The touchscreen gave out earlier in the week, and after re-seating the ribbon connector (again), it rebooted with serious video artifacts/flicker/discoloration. When I opened it back up to try again, the connector literally fell off the end of the ribbon, taking out the display as well as touch. Ribbons are not solderable, and replacement screen modules are not available, so it has been rendered pretty much useless.

I was looking at replacement options as soon as the touchscreen went out again, and the field is grim. What I want is a modern handheld-size *nix (preferably Linux) box with a qwerty keyboard, a “reasonable” (800×480 or better) screen of around 4″, an audio out compatible with normal 3.5mm connections, WiFi, and enough battery to make it through the day. Apparently I am alone in this desire. Searching kept bringing me to the list at pocketables, which has the majority of potentially suitable devices.
Continue reading

Posted in Computers, General, Objects | Tagged , | 2 Comments

Package Manager Security

(The following is long, rather technical, and somewhat esoteric. Sorry, it’s what I do.)
I try to keep reasonably abreast of developments in Arch Linux, since it has been my favorite distribution for about seven years now, and the OS on my primary-use computer for five of them. Someone (almost entirely a single very loud someone as it turns out) has been making noise about package signing in pacman, the package manger used by and written for Arch, and said noise propagated up to an article on LWN, so I took some time out tonight to read up on the matter.

The short version is that the description of events on pacman developer Dan McGee’s blog seems to be essentially correct, and the “Arrogant and dismissive” accusations were the result of someone new showing up and making long-winded demands on the mailing list in regard to a topic which has been under (occasionally contentious) discussion for years. The Arch community can certainly be a little blunt, but it has never struck me as unfriendly or inappropriately autocratic (there is quite a bit of the “Those people actually doing things get to decide how they are done” mentality: as far as I am concerned this is exactly right for community projects).

The two primary things I learned in reading are that package manager security is indeed a hard problem, and that most of the possible attacks would be extremely difficult to carry out, regardless of package signing. The typical least concern matter of security: if production machines anywhere that matters are having their DNS (& etc.) spoofed on the required scale, there is a much bigger problem than trying to slip compromised packages into systems during updates. I’ve also discovered that generally, people don’t seem to care: for example, as best I can make out, gentoo has had discussions on package/repository signing since 2002, support since 2004… and it isn’t generally used today. The Arch Wiki has a nifty article about how various distributions handle package security in the context of designing a system for Arch – it is somewhat incomplete, but the only comparison of existing systems I found. Note that the page was started and largely populated in July of 2009.

One thing I don’t quite understand is why there isn’t a movement toward, at least optionally, performing updates over secured connections: simply using ssl (which has it’s own problems) for mirror-to-mirror and user-to-mirror communication would (aside from making the CPU load involved in running a mirror much higher and considerably slowing update downloads…) convey many of the befits of signed packages/repositories with less hassle. More importantly, it would close many of the holes in package management systems which do support signing for those individuals and organizations with sufficiently critical systems and/or paranoid administrators to be willing to swallow the overhead.

With all that in mind, I find myself agreeing with the pacman developer’s ambivalence on the issue – a security scheme for pacman is not so much a “critical feature” as a”nice to have”, largely for future proofing. Likewise, a broken scheme, or one so obtrusive it goes unused is probably worse than none at all. The obtrusive issue is honestly probably the most important to me – one of my favorite things about pacman is that the makepkg process is incredibly easy. I can often go from a source tarball or CMS checkout to a easily handled package as fast as I can (safely) build and install by hand. Contrast this with, say, Debian, where packaging and installing even simple software is often a painful multi-hour affair even with things like debhelper, and simple packages tend to (in my experience) do unhelpful things like fail to uninstall cleanly. I want making my own packages, and building or modifying packages with scripts written by others to remain easy and transparent much more than I want to be protected from improbable attacks.

Forcing the issue (it looks like security features will appear in the next few pacman release cycles as a result of the noise, mostly handled by existing developers) was probably not the right thing – the security scheme should have been done slowly, carefully, and correctly by someone who is actually interested in the matter – the last point both so that it really is done right, and because Arch and Pacman are community maintained projects, where everything should be done by someone who cares, as Linus himself puts it, just for fun.

Posted in Computers, DIY | Tagged , , | Leave a comment

Marksbury Movein


I’ve had a couple neat projects eating up my spring break, but one of the bigger ones has been helping move the KAOS group into UK’s new Marksbury Building. So far it seems nice and very attractive, albeit a little weird – we’re talking 40+% unsuable glassed-in hallways, cubicle farms, and almost no storage space. I have a little cube in the corner of a lab on the first floor to call my own (until it is dynamically reallocated away – everything in the building is wrongheadedly set up to prevent entrenched labs…), which is actually a reasonably nice workspace. On that note, the various bits of furniture in the building have ABSURD list prices; each of the 12 student desks in the lab have at least $2,155 of furniture in them, including a useless drawer-and-a-half wheeled filing cabinet with a $700 list price, and a table(labelled “desk”) with a $368 list price – which is nearly indistinguishable from this $54 number from IKEA. We also have several conference tables where each LEG has a list price in excess of $300, and the whole building is furnished this way. I have no doubt that the institutional discount was deep, but it is still startling to contemplate.

Machine Room

Hotlink from Live-Update Image


One of the cooler bits is getting the group’s new machine room up – total floor space wise it isn’t very large, but has enough power and airconditioning for a couple city blocks of normal residential buildings, and enough exposed glass to make working in it a little like being in a zoo. The airconditioning unit in the back of the room that feeds the raised floor is so loud it is uncomfortable to be in the room without hearing protection, which makes working in it sort of surreal, and gives the adjoining lab a nice “distant waterfall” level of white noise. We’re bringing up somewhere in the neighborhood of 200 machines in there initially, most of them with fairly straightforward single-link Ethernet networks and stateless node configurations – so far two of the smaller machines (cik and emcluster, made of Core2Duos and Opterons respectively) are up with caos NSA and Perceus, as has been our habit of late. Unfortunately, the administrative process still has nonroutable IPs on our drops in the server room, so we can’t SSH in to use the machines remotely yet.

Posted in Computers, DIY, General, School | Tagged , , | Leave a comment

White Family Rotary

My parents were travelling over UK’s spring break, and I was watching their cats. This meant I had some idle time waiting for the indoor/outdoor to do whatever it is he does outside, and generally keeping the cats company in their house, so I wanted a project to play with there.
What I settled on was poking at the old sewing machine my mother had in the attic, because old sewing machines are cool in every way.
White Family Rotary Sewing Machine
Continue reading

Posted in DIY, General, Objects | Tagged , , | 18 Comments

I quite like this article on UI design OSNews is running. It is a well written, well referenced summary of many of the things that have concerned me in recent UI trends. Also cool that the author another MS student … Continue reading

Posted on by pappp | Leave a comment

OS Graveyard

In my continuing adventures with computing oddities of the 1990s, I occasionally look around for copies of the various failed operating systems from the era, especially Apple’s, and have built myself a little archive of them. Some are easy enough to run under emulation, I have hardware which can be coaxed to run others, and a few (Such as A/UX) would require I pick up new machines or fix an emulator to run. Two of the “desirables” of that sort are Copland, the full custom microkernel based OS that could have been Mac OS 8, and Rhapsody, the missing link that connects Macs that have things in common with the original Macintosh and NeXTStep, prior to the birth of OS X. There are several versions of the latter in existence, including early versions of OS X Server, but the most interesting isRhapsody DR2, a developer release prior to the OS X name. In the PPC version, it has “BlueBox,” the predecessor to the Classic environment, but perhaps more amusing is the x86 version, showing an early version of the OS X codebase (or really, a late version of the OpenSTEP/Mach codebase with some Apple extensions) running on IA32 almost a decade before the first x86 compatible OS X releases.

During a distraction that reminded me to look, I found my way to a server (amusingly, an apple-hosted “me”/”iDisk” account) containing imaged install media for both Copland (and it’s marketing materials) and Rhapsody DR2. I would have to go get the 6100/66 from my parent’s house to use the Copland image, but the Rhapsody media should include the x86 version, and it apparently plays nice (-ish) with some of the emulation packages…

Obviously COMPLETELY useless software, but things I’ve wanted for my little archive of obscurities for a long time.

Posted in Computers, DIY, Entertainment, Objects | Leave a comment

Research Updates / LLVM Is a PITA

I’ve spent the last several months discovering ways in which LLVM is excessive, ill-behaved, oversold, broken or simply lying in it’s documentation while working on my master’s project. In fact, that is almost ALL of what I accomplished in the past several months, and it was griding on me psychologically. Last weekend, I finally admitted to myself that, for a mixture of psychological and technological reasons, I wasn’t going to be able to finish the project using LLVM. I’ve always had a bail-out path set up to do a simpler full-custom compiler if something proved intractable, and Monday I talked to the advisor about putting that plan into action.

I’m now building a simple C-like language with PCCTS (old school 1.33MR33 emits-pure-C ANTLR and SOURCERER PCCTS, not modern ANTLR), hand-coding C for the remainder, and concentrating on the technically interesting matters. To that end, I’ve accomplished more conceptual work in the last week than the two preceding months, started laying out my new tools, and feel much better. The best “aha” moment I’ve had in months came when I sat down and worked out how the stack and calling conventions were going to work in my new system; LARs are beautiful and well-suited to real world problems in a whole host of ways I didn’t understand before.

Note that I don’t think LLVM is entirely bad; in conception, having a nice cleanly-interfaced compiler infrastructure with a library of frontends, backends, optimizer passes and other common components which snap together via clean interfaces, high level specifications, and a standardized intermediate representation is exactly how compiler tools should be structured. The problem is that LLVM has been drastically oversold, and overcomplicated. Every neat-looking interface has a mess of poorly-documented C++ that needs to be written to support it. Everything is set up with an emphasis on LLVM’s JIT/VM features, making it unnecessarily clumsy to use to produce pure compilers, or interface with external tools. Worst of all, the documentation is deceiving — much worse than incomplete, it appears complete, but is frequently deceptive or wrong. To pick one of the more egregious examples, much of the document points to the MIPS fronted as an example. This should be a good thing – MIPS is a simple design familiar to almost anyone in computing, but the MIPS backend is broken, in apparently fairly fundamental ways. The register descriptions are buggy in ways which cause it to generate incorrect code for any input containing floats, and it appears to be a high-level design problem descended from naively trusting that the register description and allocation mechanisms work as described. It is probably already a good tool for writing production compilers for established designs, but it really isn’t suited to writing research compilers.

Posted in Announcements, Computers, Navel Gazing, School | Leave a comment