From Sprezz Towers

Notes from the workshop.

Technical discoveries, field notes, unlikely bugs and the occasional opinion.

Linear Hash Rehashed

In what has been one of the most exciting announcements since the trailers for OI 10, Revelation Software have just released UD 4.7.2 and 5.0.0.4. Whilst the small incremental release number might make this seem insignificant it actually marks one of the biggest changes in linear hash since the Universal Driver was released. For some time now we have been aware of issues with "enterprise" sites where under certain ill-defined circumstances, the network would crawl to a halt and frustrated users would sit helpless until the system eventually recovered. Under certain extreme conditions the system would never recover and the only solution would be to reboot the server with possible ensuing data corruption. After such halts linear hash files would be seen to have "exploded". Growing in size from tens of megabytes to tens of gigabytes. The suspicion has long been that some form of alpha corruption led to a massive resizing exercise and that this in turn...

Read article → 2 comments

OI 10 - Conference Presentation

At the recent conference in Orlando I was given the opportunity to present a very early preview of the sample application that Sprezzatura will be providing for the final release of OpenInsight 10. To make the application simpler for new users to follow and understand how MV can be used to improve on SQL data structures the decision was made to convert an open source SQL bug tracking system (Bugzilla) to OpenInsight 10. This article represents a distillation of the conference presentation without the rambling asides and with a little more depth given to some of the tools. If you were at the presentation then thank you for being there - but this isn't a PowerPoint of my talk! As you'll know the talk was just a live dem. (And we didn't hit the debugger once!). To make the conversion easier pre-conference the decision was made to develop the application in 9.4 and then move it over. To keep this blog post focused I won't include the screen shots of the app that were...

Read article →

When in the course of LH Events

One of our largest customers decided to use the Good Friday holiday to handle some server maintenance.  While normally a 24/7 shop, this is one of the few days of the year that not only are they on a skeleton crew, it's a skeleton of a skeleton crew and they generally receive no calls on this day. After performing and verifying the backups, upgrading the OS with all the relevant patches, the server was rebooted.  A quick check, and the LH service was not running, which seemed a bit odd mostly because it's never failed to start before.  Starting the service immediately displayed an error stating that the service did not start in a timely manner.  While none of us was completely sure what's considered "a timely manner", we were all in agreement that "a timely manner" was not "immediately". At this point, we thought it's time to examine the Window's event log for some clues.  However, this proved to be a problem because the event viewe...

Read article →

Debug at will

This is going to be one of those blog posts that will either have you saying "Well d'uh everybody knows that" or "Wow what a neat trick". I know that I fell into the latter camp which is why I'm blogging it. Aaron and I are working together on a new tool for network administrators and it has been a fun ride. Recently we had cause to have Aaron TeamViewer into my machine to help debug a specific routine. So I watched as he took over and waited for him to fire up the System Editor, open the program, insert a DEBUG, compile and run. This is how I've traditionally done it and of course you have to be really careful to remember to remove the DEBUG before shipping the code to anybody. (Or run your release through a release checker that warns of the DEBUG opcode in object code). Instead he performed the neat trick documented below. When I expressed admiration he was incredulous. "I've been doing it this way since OI 2.0" quoth he. So allow me...

Read article → 3 comments

Hexes and Curses

Of late at Sprezz Towers we've been all about taking apart Linear Hash frame headers to diagnose some, frankly bizarre, issues being experienced by one of our clients. Our utilities were working fine on "old style" Linear Hash files where the maximum frame size was 64K and the maximum file size was 4GB but on the newer UD3+ files (or "type 3" as they're referred to) we just didn't seem to be getting the consistent results we were expecting. As an example consider this section of code for examining the "Alpha Space Usage" - the total bytes of data stored in the Primary frames :-   lo_alpha   =  file [ alphaPtr$ ,   4 ]   hi_alpha  =  file [ alphaPtrHi$ ,   4 ]    If  hiBitSet  Then lo_alpha  : =  hi_alpha   value  = lo_alpha    Gosub   Convert   lo_alpha  =  value   hlo_Alpha  =   Oconv ( lo_alpha ,   "MX" )   ...

Read article →

Chasing down OLE errors - what's DWORD?

One of our clients started having issues recently when an online payment system that had worked for well over a decade suddenly started to fail. The error returned from the third party payment DLL was less than useful. In its entirety it read "". We spoke to the company's tech support and expressed some surprise that the routine did not return discrete meaningful error messages for all failure points and they basically confirmed that from their perspective - embarrassed cough - this was a valid way of dealing with errors. Well at least they didn't modify the payload parameter to return an error string - small mercies and all that. So we set about debugging this ourselves. Our first port of call was to instantiate an Msxml2.ServerXMLHTTP object and open the API URL for a POST payload. This worked well and oleStatus() indicated that all was well. But when it came time to deliver the payload using a SEND method things weren't quite so copacetic. Instead of a z...

Read article →