These notes summarize the DLXS releases chronologically, most recent first. They are structured into release numbers and within that level into General Information and then Middleware and XPAT-specific sections.

DLXS Release 11a - 5 MAR 2004

General Information

DLXS Release 11a is an interim release consisting of a few enhancements to Release 11. Refer to that section below for more detail. Release 11a is a full release of all DLXS middleware. There are no database schema changes. No database upgrades are required. A Release 11 version 4 database is fully compatible with release 11a.

Unicode support available in XPAT since Release 11 has been extended to the middleware and is delivered with working sample data under TextClass. FindaidClass shares the TextClass Unicode support changes. Refer to DLXS Unicode Data Preparation and Online Presentation Issues. ImageClass and BibClass still require minor changes to be fully Unicode compliant.

Release 11a is comprised of:

• BibClass version 3.1.2
• Broker20 version 1.1.0
• Collmgr version 3.1.1
• FindaidClass version 5.2.0
• ImageClass version 3.1.0
• Lib version 3.3.3
• TextClass version 3.3.0
• XClass version 2.1.1
• XPAT version 5.3.0
• dlxsd version 1.0.1
• mrsid_retrieve version 1.3.1
• tif2web version 1.0.3
• kakadu version 4.0.2
• cjpeg version 6b

Known Problems

XPAT Known Problems

XPAT 5.3.0 is generally backward-compatible with indexes generated by 5.2.x subject to a few isolated misses during searching. Re-indexing with 5.3 xpatbld resolves this deficiency.

Database Known Problems

The SQL::Statement version 1.005 perl module is not backward compatible with version 0.1021. Version 0.1021 was typical with Perl version 5.6.1 whereas 1.005 is typical of Perl 5.8.0. We recommend you install perl 5.8.0 or higher and SQL::Statement 1.005 or higher.

Image Class Known Problems

• The HTTP header is not being created properly by the getimage-idx cgi in Image Class (DLXS 11, 11a). The error is actually in Sidget2.pm at line 176. Here is the correction.
  

  $buf = qq{Content-type: $contentType\n} . $contentDisposition . qq{Content-length: $size\n\n};
  

• Two bugs related to sorting in Image Class (DLXS 11a) were recently resolved. Thanks to Driek Heesakkers, University of Amsterdam Digital Production Centre for his extra effort helping me reproduce the problems for debugging.
  
  Two patches are provided here...
  
  In $DLXSROOT/cgi/i/image/ImageApp.pm the subroutine prepToSort needs a minor modification.
  
  Move the closing curly bracket up a few lines so that it looks like this...

  ---

  
      $sort = $xcollSortMaps[0];
  
      }
      #  sgml data might have abbrevs with dots.
      #  collmgr has abbrevs with underscores.
      #  look for both when parsing the data for a sort value.
  
      $sort =~ s,\_,\[\.\_\],;
  
      my $totalResults = &ImageClassUtils::totalResults($cgi, $bbo);
  
  

  ---

  Also in ImageApp.pm, replace the subroutine ProcessItems with the following...

  ---

  
  sub ProcessItems
  {
      my $self = shift;
      my ( $cgi, $cio, $dso, $itemIDsRef, $bbo ) = @_;
  
      # Set $gSliceStart and $gSliceEnd
      # done globally for easy reuse
      $self->sliceBounds( $cgi );
  
      my @rset;
      my @sliceOccurArray;
  
      for (my $i = $ICGlobals::gSliceStart; $i <= $ICGlobals::gSliceEnd; $i++)
      {
  	my $idRef = $$itemIDsRef[$i];
  
  	# last if slice is larger than results
  	last if (! defined $idRef);
  
  	my @oneID = ($$idRef);
  
  	my ($coll) = ($$idRef =~ m/S-([^-]*)-/i);
  	$coll = lc($coll);
  
  	$self->ProcessItemsColl($cgi, $cio,
  				$dso, $bbo, $coll,
  				\@oneID, \@rset);
  
  	push @sliceOccurArray, $self->makeSliceOccurArray(\@oneID);
  
      }
      return ( \@rset, \@sliceOccurArray );
  }
  

  ---

• Image filenames can not begin with the letter "x" (upper or lowercase). It is not certain when this problem was introduced, but it is believed to exist in DLXS 10. It is known to exist in DLXS 11 and 11a.
• Any field that, such as an ID field, that includes non-alphanumeric chars, such as "-", should be mapped to ic_exact in the in the admin_field_maps Colldb/Collmgr field if exact searching of the entire field value is desired. This is not so much a problem as it is a fact.
• Display of JPEG2000 images as JPEG in the browser behaves oddly if the image is zoomed several times near the edge of the full image. The zoomed portion of the image is stretched to match the aspect ratio of the full-size image.
• "rgn" CGI parameters containing full field names generate an error. The CGI now expects field abbreviations, not full field names.

XPAT version 5.3.0

• No changes. Please see release notes for Release 11.

Lib version 3.3.3

New and Changed Functionality

• Middleware support for UTF-8 Unicode collections. XPat.pm sets the Perl UTF-8 flag on strings from collections configured in Collmgr to have UTF-8 localed. DlpsUtils::HighlightHit is completely new to supporting highlighting of multi-byte UTF-8 encoded results data.
• Visible in TextClass and FindaidClass: Implementation of frequency sorting, cross-collection results guide frame collection names are links to the collection's home page, sort select menu is based on the sort options of just those collections with results from a cross collection search.
• DlpsUtils::HighlightHit has been rewritten to support highlighting multi-byte UTF-8 results. It emulates the full mapping performed by XPAT during searching to match search terms exactly in the results.
• Email addresses configured in the Collmgr and displayed via PIs in the output are automatically obfuscated to make them harder for web crawlers to harvest in an effort to reduce spam.
• Support for "foreign" URLs (URLs that go offsite) in the Collmgr 'homesite' field.
• No longer delete the 'g' (group) URL parameter when building the link to the collection home so the 'g' parameter will be carried around on subsequent links maintaining the group look and feel (if any).

Text Class version 3.3.0

New and Changed Functionality

• Support for UTF-8 encoded Unicode collection data. Utilizes xpatu as search engine for Unicode collections. Reads the 'locale' field in Collmgr to determine encoding, either UTF-8 or ISO-8859-*. Adds charset=UTF-8 META tag to existing html templates on output. Refer to DLXS Unicode Data Preparation and Online Presentation Issues. A Unicode sample collection named "sampletc_utf8" accompanies this release.
• Template and CSS style sheet changes to provide page image borders in Pageviewer.
• The data prep utility program, dtdalyzer.pl, is now XML aware i.e. case-sensitive.
• Two new data prep utility programs are delivered: isocer2utf8 converts SGML ISO Character Entity References to UTF-8 encoded Unicode characters and ncr2utf8 converts Numeric Character References to UTF-8 encoded Unicode characters.
• Frequency sorting is now a supported sort option.
• Changes to footer.chnk supporting email address obfuscation.
• PageView changes to handle multiple records in Pageview table in dlxs database (contone and bitonal page images can now live side by side).
• Cross-collection results guide frame collection names are links to the collection's home page, sort select menu is based on the sort options of just those collections with results from a cross collection search.
• A summary description of the search result is saved in the Search History instead of just a single number under "Total Results" in the search history page.
• Implemented enhanced handling for TEI Level 2 materials with <DIV> depths greater than 1. This work is a generalization of a DLXS 10 contribution by Frances Webb at Cornell.

Bib Class version 3.1.2

New and Changed Functionality

Release of Z39BC.pm implementing a subclass of BibClass that is able to query Z3950 search engines. It uses Net::Z3950 (obtained from CPAN) to connect and create Z3950 queries which it then issues to a Z3950 search engine.

Presently it is designed to expect UTF-8 responses from its Z3950 queries, so the Z39App.pm application subclass should be modified to insert charset=UTF-8 <META> tags when outputting template files to handle the UTF-8 responses.

The collmgr 'host' field for Z39-based collections indicates the server where the Z3950 engine resides.

It is important to note that presently the Z39 implementation will only create queries for following fields: title, author, pubyear, language, and id, and that it assumes that the Z3950 search engine has a database with the same name as the collid, which is indicated when connecting to the engine. Here at UM, we are using Zebra as our Z3950 general-purpose structured text indexing and retrieval engine.

Image Class version 3.1.0

New and Changed Functionality

• In situations where the collection metadata is in MySQL and there are multiple "q" CGI parameters (e.g,. q1, q2, q3) it is now acceptable for any combination of the "q" parameters to have values or not. In the past if, for instance, q1 and q3 had values, but q2 did not, an assertion error would occur. Now it works fine. It also works with XPAT collections, but that is old news.
• Custom (user driven) ordering of portfolio items was added. The related MySQL tables BookBagDB and BookBagItems did not change in structure (no new or changed fields).
• The ability for any user (logged-in or not) to create a portfolio was added. If login is enabled in Image Class and the user logs in, the user's portfolios are stored long term.
• Portfolio code is more clearly separated in the middleware. Dependency on BookBag library methods increased (this is good).
• A new script called manageportfolios.pl is provided ($DLXSROOT/bin). It deletes temporary portfolios older than 2 days with the assumption the user's session has expired. It is only needed if Portfolios are enabled. Works well as a cron job.
• Template chunking was added. Results templates now use header chunks, which are found in $DLXSROOT/web/i/image with the templates. The javascript that sniffs the browser and platform is now in a chunk and all templates use it. Templates that don't use chunks should still work just fine.
• Collection and group webdir values in Collmgr/Colldb must have a leading slash. In the past Image Class would work with our without the leading slash. This is no longer the case.
• Colldb/Collmgr field "dfltsrch" fields is now required to have specific values. "default" does not work. and collid_all should be included if brwsimg and brwsrec are to work.
• The PATH processing instruction is no longer supported in Image Class templates. Use FBFILE processing instruction instead. There is no backward compatibility for this in DLXS 11a (there was in DLXS 11), so all existing templates must make this change.
• "Revert Size" functionality was added to the middleware, however the PIs are commented-out in the class level entry.tpl and bbentry.tpl templates. See also comments in entry.tpl
• Email obfuscation was added to the CONTACT processing instructions. Javascript is used to disguise email addresses from crawlers. It is recommended that the contacttext Colldb/Collmgr field value not be an email address since only the contact link is disguised.
• Significant Portfolio template, chunk, and stylesheet changes were made in the process of adding portfolio support for users not logged in. Some template cleanup was done as well.
• Added logout link to complement login.
• Made changes to bring prep under DLXSDATAROOT for data prep scripts.
• Fixed a bug in middleware that caused the MO attribute of ISTRUCT to be omitted when the collection has no media.
• Significant changes were made to the collhomeLink subroutine that is used by the COLLHOME PI. It is now able to return a collection home, group home, or class home link depending on the situation. This alllows it to be utilized from a wider array of templates. The COLLHOME PI was renamed HOME. COLLHOME will also continue to work through DLXS 12, after which it is flagged for removal.
• Changes were made to make use of the new hiliting routines in lib.
• Portfolios were not sorting properly with mysql collections. Fixed.
• A single collection can now be searched by cross collection fields, if so desired.
• Changes were needed in the mysqlImageApp::BuildCategorySearch method to properly handle all xcoll and coll specific situations. Also added a method to mysqlImageApp.pm that converts cgi parameters in to a natural language query string for display to the user when no results are achieved. This has been sorely missing from the mysql version of Image Class.
• Corrected problem where Next/Previous links were not always working properly. This was MySQL specific.
• The known problem of DLXS 11 regarding the "MEDIAEQUIVS" PI has been resolved.

Broker20 version 1.1.0

New and Changed Functionality

• No change from Release 11. See below.

Collmgr version 3.1.0

New and Changed Functionality

• No change from Release 11. See below.

FindaidClass version 5.2.0

New and Changed Functionality

• Unicode enabled due to code in Lib shared by TextClass.
• Addition of Previous and Next Item links.
• Email PIs now obfuscate the email addresses from the colldb, to aid in preventing spam.
• Changes to URL parameters (view, subview, etc.) to more closely parallel TextClass usage.
• Code moved up to DLXSApp::FullTextApp and DLXSClass::FullTextClass so it could be shared by TextClass and FindaidClass.
• Addition of "Search Within" one Finding Aid functionality.
• Addition of Next/Previous links in results.

XClass version 2.1.1

New and Changed Functionality

• No change from DLXS release 11. See below.

DLXS Release 11 - 5 DEC 2003

General Information

DLXS Release 11 is comprised of:

• BibClass version 3.1.0
• Broker20 version 1.1.0
• Collmgr version 3.1.0
• FindaidClass version 5.0.0
• ImageClass version 3.0.0
• Lib version 3.2.0
• TextClass version 3.2.0
• XClass version 2.1.0
• XPAT version 5.3.0
• XslFallback version 1.0.0
• IdResolver version 1.0.0
• dlxsd version 1.0.1
• mrsid_retrieve version 1.3.1
• tif2web version 1.0.3
• kakadu version 4.0.2
• cjpeg version 6b

Known Problems

XPAT 5.3.0 is generally backward-compatible with indexes generated by 5.2.x subject to a few isolated misses during searching. Re-indexing with 5.3 xpatbld resolves this deficiency.

The SQL::Statement version 1.005 perl module is not backward compatible with version 0.1021. Version 0.1021 was typical with Perl version 5.6.1 whereas 1.005 is typical of Perl 5.8.0. We recommend you install perl 5.8.0 and SQL::Statement 1.005 or higher. The workaround mentioned below may not be required when SQL::Statement 1.006 becomes available. Because of this the following constraints and workarounds apply.

• collmgr
  • Functions normally with either 0.1021 or 1.005

• dbmove
  • Functions normally moving CSV to MySQL under either 1.005 or 0.1021
  • Incorrectly uppercases column names when moving MySQL to CSV under 1.005. The workaround is to lower case the resulting column names using an ascii editor.
  • Fails completely under 0.1021 moving CSV to MySQL or vice versa..

• upgrade_1_2, upgrade_2_3, upgrade_3_4
  • Functions normally upgrading a MySQL database under either 1.005 or 0.1021
  • Incorrectly uppercases column names when upgrading CSV under 1.005. The workaround is to lower case the resulting column names using an ascii editor.

Image Class Known Problems

• The HTTP header is not being created properly by the getimage-idx cgi in Image Class (DLXS 11, 11a). The error is actually in Sidget2.pm at line 176. Here is the correction.
  

  $buf = qq{Content-type: $contentType\n} . $contentDisposition . qq{Content-length: $size\n\n};
  

• Image filenames can not begin with the letter "x" (upper or lowercase). It is not certain when this problem was introduced, but it is believed to exist in DLXS 10. It is known to exist in DLXS 11 and 11a.
• A media_table is needed more often than not. Documentation suggests otherwise.
• Image Class data prep scripts assume prep directory is under $DLXSROOT, when $DLXSDATAROOT would be more appropriate. This is not likely to affect too many installations.
• A "q" CGI parameter without a value generates an error if it is sequenced between two other "q" parameters that do have values. e.g., q1=house q2= q3=country. This can happen when there are 3 or more text fields in a search form and the user enters text in only the first and last.
• Display of JPEG2000 images as JPEG in the browser behaves oddly if the image is zoomed several times near the edge of the full image. The zoomed portion of the image is stretched to match the aspect ratio of the full-size image.
• "rgn" CGI parameters containing full field names generate an error. The CGI now expects field abbreviations, not full field names.
• The "MEDIAEQUIVS" PI in entry.tpl and bbentry.tpl appears (as the string "MEDIAEQUIVS") in Netscape Navigator 4.x when it really should be hidden if not utilized.

XPAT version 5.3.0

• 5.3.0 is a major new release of XPAT. Two new binaries, xpatbldu and xpatu enable indexing and searching of UTF-8 encoded Unicode XML data. Full Unicode support in the middleware will become available in a following release. In addition, "Lite" non-Unicode versions of these tools together with sgmlrgn and multirgn are now freely available without license fees and may be downloaded from http://www.dlxs.org.
• 5.3.0 is generally backward-compatible with indexes generated by 5.2.x subject to a few isolated misses during searching. 5.3 can read 5.2 indexes albeit with a warning that it is not possible for 5.3 to determine whether the Data Dictionary has changed since the 5.2 index was built because the integrity checksum for 5.3 indexes is different than for 5.2.
• XPAT 5.2.x cannot read indexes generated by 5.3. That is, 5.3 is not forward-compatible.
• Because XPAT 5.2.x cannot read indexes generated by 5.3 and because DLXS sites may continue to use 5.2 for a period of time we've chosen to deliver 5.2 versions of the sample data indexes.
• With respect to Unicode support for element names and attribute names and values, xmlrgn is limited to Unicode code points in the range from 0 to 127 decimal, i.e. to USASCII values. multirgn should be used to create region indexes for XML where element names and/or attributes and attribute values are outside this range.

Lib version 3.2.0

New and Changed Functionality

• Support for CGM (Cornel--Goettingen-Michigan protocol
• New parent class DLXSClass with children BibClass, FullTextClass
• Support for newly released ID Resolver.
• New parent class PIFiller supporting subclasses PerlPIFiller and XsltPIFiller for Perl and XSLT filtering.

lib

• New module CGMResult.pm to handle CGM result set
• Member data keys changed to lower case
• CollsInfo.pm: Addition of access methods for "globalnamespace" so that code could be shared. Also changed passing of object creation parameters as a hash rather than as an array.
• DbUtils.pm: routines were added to to provide new basic functionality for storing and retrieving rows.
• LibGlobals.cfg: Updated configuration of idresolver. The $gIdResolver variable is now initially set to the value of the virtual host for the idresolver rather than the URL for the idresolver.
• New module PIFiller.pm with subclasses PerlPIFiller.pm and XsltPIFiller.pm generalizing the filtering of XML for output.
• QueryFactory.pm: Changed 'and' to 'or in NaturalLanguageBaseQuery in the case where the search type is 'simple' and there are multiple q1's since the query is logically q1 + q1 + ... + q1 i.e. a disjunction not a conjunction. Change an '&' character into '&amp;' which is the form it must have in XML so user can search for e.g. "Memphis Light, Gas & Water" but protect actual entered character entity references like '&eacute;'.

bin/db

• upgrade_3_4 utility provided to upgrade to version 4 of database.

Obsolete fields in this release are as follows (TableName:fieldname):

• BibClass:dddir
• ImageClass:dddir
• TextClass:tcumodule
• TextClass:standalonename
• ImageClass:banner
• TextClass:lel
• GroupData:groupstandalonename
• TextClass:maxdepthitems
• TextClass:standalonename
• ImageClass:banner

Text Class version 3.2.0

New and Changed Functionality

• Support for remote collection searching via new CGM protocol.
• Partial implementation of XSLT filtering; more work to follow.
• Minor template changes
• Significant architectural change introducing TextClass as a subclass of DLXSClass::FullTextClass
• Print-on-demand functionality added.
• TextClassUtils obsolete, replaced by PIFiller object hierarchy.

web/t/text

• <?CSS_PATH filename="filename.css"> PIs added and deprecated DOC_ROOT PIs removed
• Made changes to footer text for relevant template pages be extracting footer content out into two chunk files, footer.chnk and footernolist.chnk, which appear at the bottom of list type and no list type pages.

bin/t/text, bin/WW

• importpageviewdata.pl: enhancements: * after processing a page metadata file, remember the maximum page sequence number encountered and purge any page metadata in the database for page sequences greater than that (potentially) new maximum
• WW/makeWordWheelFiles.pl: Fix counts so they agree with what you can search for in TextClass.

cgi/t/text

• New modules TextAppXsltPIFiller.pm TextAppPerlPIFiller.pm
• New modules: TextClass subclasses CgmTC and CgmPartialTC supporting CGM protocol

Bib Class version 3.1.0

New and Changed Functionality

• Full support for XSL stylesheets

web/b/bib

• Parallel set of templates with suffix '.xml' supporting XSL filtering.

cgi/b/bib

• New modules BibAppPerlFilters.pm BibAppXmlFilters.pm supporting XSL stylesheets while maintaining support for Perl filtering.

Image Class version 3.0.0

New and Changed Functionality

• MySQL is supported in addition to XPAT for searching collection metadata. XPAT will likely not be supported in future releases of Image Class.
• JPEG2000 is supported in addition to MrSID. Behavior is identical. JPEG2000 command line compression/decompression utilities are provided.
• Configuration of field abbreviations and labels, as well as the mapping of fields for cross-collection searching, is now done in Collmgr. Collectionmaps.pm and makeCollectionmaps-idx are no lnger used.
• The form of field abbreviations has changed. "dots" are no longer allowed. SGML may continue to have dots, no need to redo data. As field abbreviations are migrated to Collmgr they must have "dots" converted to underscores.
• The Collmgr field "dfltsrchflds" now must include an abbreviation in the form "collid_all" to enable searching of the entire record. This field should be mapped to ic_all in the field_xcoll_maps Collmgr field for full record searching in across collections.
• MySQL table structure for Portfolios has changed for increased data stability.
• Media support has been improved. Practically any form of media (QuickTime, Flash, MP3) can be included in Image Class. Level of support varies. Configuration of imageprep has changed significantly.

web/i/image

• bbentry.tpl
  • changed dlxs.ma to dlxs_ma
  • A PI was added to entry.tpl and bbentry.tpl called "MEDIAEQUIVSTOOL" which displays links for viewing item in different media formats. Anticipated use is for video in more than one format.

• bbthumbfull.tpl
  • bbthumbfull.tpl: significant changes were made in order to support scrollable iframes on the portfolio thumbfull pages. the same changes could be applied to the thumbfull.tpl template.

• search.tpl
  • Replaced missing javascript loading element that caused the search tips not to open when requested.
  • small style change
  • style tweak
  • Changed search.tpl and searchgroup.tpl to use "TIPSURL" PI.

• searchgroup.tpl
  • announcement tweaks
  • Changed search.tpl and searchgroup.tpl to use "TIPSURL" PI.

• css/imageclass-ie-mac.css
  • A few styles definitions were added related to display of the bbthumbfull page.
  • Added style used to display a message when there are no related views for an item and a mysql media table is not being used with the colllection.
  • added toolsbg style def

• graphics/recinit.jpg
  • this new graphic is used as part of the "help" display in the bbthumbfull display.

• js/imageclass.js
  • changes to support move away from Collectionmaps.pm to collmgr management of field mappings, labels, etc.
  • imageclass.js: significant changes were made in order to support scrollable iframes on the portfolio thumbfull pages.

cgi/i/image

• ICLocalUtils.pm
  • Changes were made to improve support for media formats other than images. Also, minor changes were made to enable the reduction of customized templates. In other words, some basic generalizations were made so that class or group level templates can do the job.
  • Dropped reference to Collectionmaps.pm, which isn't used anymore.

• ImageApp.pm
  • Fix server error: changed __AdjustOccurrenceCounts() to AdjustOccurrenceCounts() for ARO changes to xclass.
  • Made a change to ImageApp so that portfolios can find items that have old ID delims. Made a change to Image Class Utils to support new and old delims in nextpreventry.
  • Small changes to make portfolios work properly with new as well as old isentryid delimiters.
  • Fixed a bug that had disabled adding to or deleting from Bookbag/Portfolio. Also made retrieval of existing BookBag items more robust in the sense that it now is better about retrieving and deleting items with ids that are in older forms.
  • Parameters passed to object creation now a hash instead of an array.
  • Major changes were made in order to add support for mySQL to image class. ImageApp methods were shifted and/or partitioned in order to simplify subclassing for mySQL. With this commit, both xpat and mysql should be largely functional. XClass searching needs to be tested. The changes for mySQL provided an opportune time to stop the use of full region names in rgn parameters and to stop using Collectionmaps.pm. These changes are complete with the exception if needing some validity checking of rgn parameters.
  • Changed all member data keys to lowercase (ciowrapper, session, cgi, etc.)
  • made to be compatable with lib changes. also fixed bug in portfolios where missing items were not being displayed as "missing" they were simply not being displayed. other changes included a fix for the problem where xcoll field data would not display (e.g., dlxs_ma) and other little things.
  • Changes were made to ImageApp.pm, ImageClassUtils.pm, and imageclass.cfg to abandon the use of "storable" freeze and thaw for the long-term storage of BookBag items. The new mechanism stores BookBag items in a seperate table, one per row. The freeze/thaw approach was occassionally storing BookBags that could not be thawed. The root of the problem was never discovered. To faciliate this change and to migrate data from the frozen storage to the new table, a script called convertBookBag.pl has been created and can be found in bin/i/image. It is important to read the comments in the head of the convertBookBag.pl file to understand the steps required to make this transition smoothely.
  • Natural language query string now displays properly on "no results" page. It was failing perhaps due to a race condition related to the cgi redirect that followed and storage of the natlangquery on the session. Also fixed a bug with portfolios. When last item of portfolio was deleted, an internal server error occurred due to an attempt to insert non-existant data rows into the BookBagItems table at the time of storage.
  • Changes were made to improve support for media formats other than images. Also, minor changes were made to enable the reduction of customized templates. In other words, some basic generalizations were made so that class or group level templates can do the job.
  • Greater support for media formats was added, which for ImageApp mostly meant the additon of a pi handler for the mediaequivstool.
  • A request for a bookmarked portfolio would not redirect to the login page if the user was not logged in. Now it does.
  • A request for a bookmarked portfolio would not redirect to the login page if the user was not logged in. Now it really does.
  • Cleaned up code and added comments related to BookBag / Portfolio changes.
  • ImageApp.pm::forceAuth now checks, when opening portfolio, to see if the user is authed, and if not, redirects to auth. this is most likely to occur when a portfolio page has been bookmarked. previously the behavior was to display the items the user is authorized to use, but this could be confusing.
  • ImageApp.pm: support for TOTALRESULTS PI was added to results handler. It simply inserts the number of total results. The intended use is in bbthumbfull.tpl (portfolios) to create a referenceable javascript variable that knows the total number of results. This addition allowed the PI THUMBFULLJSARRAYS to be deprecated. Minor mods were also made to maintain the results view when opening a new portfolio, etc. ImageClassUtils.pm: Primarily, changes were made to support new functionality in portfolio's "thumb with full record" view. iFrames are now used to allow scrolling of thumbs while keeping the full record in it's place. This functionaly can also be used in the regular (non-porfolios) "thumb with full record" view, though it has not yet been applied. Care was taken to maintain backward compatibility with existing templates. As of this commit, however, it is most likely that NS Nav 4.x has some disfunctioning portfolio functions. Namely, check/uncheck all items. imageclass.cfg: Minor changes were made to "help" text for thumbfull views. Also minor changes to the global var gWindowProps, which specifies how certain pop-up windows are to be created.
  • Minor changes to further advance support for mysql. Added data_table field to collmgr. Changed code to use data_table field. Changed nature of media_table field. Instead of "yes"/"no" values, it now holds the name of the media_table. Code was updated to use media_table in this new way.
  • Added support for 'SID' PI to all page handlers. Dropped a related but unused subroutine sidParam from ImageClassUtils.
  • Fixed a bug that caused portfolios to fail to display items in all cases. Stemmed from Lib change that added cio to the list of parameters passed to BookBagItem for initialization. Also added use of new mediahost colldb field, which allows the server that delivers images to be specified per collection. The default is still specified in imageclass.cfg.
  • Corrected a bug in the way links from coll pages to group pages were built. Relates to GROUPSLINK pi.
  • JPEG2000 support was added to the middleware. Also made a small change to mysqlImageApp.pm so that it gets the data table name from Collmgr rather than basing it on the collid.
  • Corrected a bug in sorting when only 1 coll of group searched.

• ImageClassUtils.pm
  • A minor modification was made to display a list of all colls on the group selection page in the situation where there are no groups defined in collmgr.
  • A minor modification was made to display a list of all colls on the group selection page in the situation where there are no groups defined in collmgr.
  • Some adjustments were needed in Image Class utils in order to properly handle leading slashes on webdir paths.
  • Changed filtering of isentryid to support "]" as a delimiter within the ID in additon to "-" which has been used traditionally but has been problematic.
  • added filtering for javascript window naming to take "]" out of idnos.
  • changed related views display code to make it properly select a viewid (given recent changes to isentryid) for entry link building.
  • Made a change to ImageApp so that portfolios can find items that have old ID delims. Made a change to Image Class Utils to support new and old delims in nextpreventry.
  • A small fix to ImageClassUtils.pm ThumbRecordFilt which was not reading collmgr field properly when "bb"/bookbag/portfolio view.
  • Fixed a bug that had disabled adding to or deleting from Bookbag/Portfolio. Also made retrieval of existing BookBag items more robust in the sense that it now is better about retrieving and deleting items with ids that are in older forms.
  • Major changes were made in order to add support for mySQL to image class. ImageApp methods were shifted and/or partitioned in order to simplify subclassing for mySQL. With this commit, both xpat and mysql should be largely functional. XClass searching needs to be tested. The changes for mySQL provided an opportune time to stop the use of full region names in rgn parameters and to stop using Collectionmaps.pm. These changes are complete with the exception if needing some validity checking of rgn parameters.
  • made to be compatable with lib changes. also fixed bug in portfolios where missing items were not being displayed as "missing" they were simply not being displayed. other changes included a fix for the problem where xcoll field data would not display (e.g., dlxs_ma) and other little things.
  • minor fixes. recordFilter section labels are no longer lowercased.
  • made a small fix to record filt to stop "empty" fields from displaying
  • Image Class middleware was altered to allow the maximum viewable image size to be restricted based on the value of the imgsizemax collmgr field.
  • Changes were made to ImageApp.pm, ImageClassUtils.pm, and imageclass.cfg to abandon the use of "storable" freeze and thaw for the long-term storage of BookBag items. The new mechanism stores BookBag items in a seperate table, one per row. The freeze/thaw approach was occassionally storing BookBags that could not be thawed. The root of the problem was never discovered. To faciliate this change and to migrate data from the frozen storage to the new table, a script called convertBookBag.pl has been created and can be found in bin/i/image. It is important to read the comments in the head of the convertBookBag.pl file to understand the steps required to make this transition smoothely.
  • Natural language query string now displays properly on "no results" page. It was failing perhaps due to a race condition related to the cgi redirect that followed and storage of the natlangquery on the session. Also fixed a bug with portfolios. When last item of portfolio was deleted, an internal server error occurred due to an attempt to insert non-existant data rows into the BookBagItems table at the time of storage.
  • Changes were made to improve support for media formats other than images. Also, minor changes were made to enable the reduction of customized templates. In other words, some basic generalizations were made so that class or group level templates can do the job.
  • A minor change was made to the method that concatenates meta field values so that it skips empty fields.
  • Fixed a bug where keylinks in thumbfull results view were being built without a "c" parameter.
  • added basic support for turning urls into links in fields.
  • Greater support for media formats was added, which for ImageClassUtils.pm included a great number of changes to the following subroutines... imageDecision, parseImgInf, parseImgInfVariations, and a few others to a lesser degree. Also, use of the subroutine _ParamsToURL was dropped in favor of the existing CGI method self_url.
  • _ParamsToURL subroutine deleted.
  • minor "view for type" changes
  • Fixed bug in ImageClassUtils::convertInfFileData. Extensions were not being parsed from filenames properly.
  • ImageApp.pm: support for TOTALRESULTS PI was added to results handler. It simply inserts the number of total results. The intended use is in bbthumbfull.tpl (portfolios) to create a referenceable javascript variable that knows the total number of results. This addition allowed the PI THUMBFULLJSARRAYS to be deprecated. Minor mods were also made to maintain the results view when opening a new portfolio, etc. ImageClassUtils.pm: Primarily, changes were made to support new functionality in portfolio's "thumb with full record" view. iFrames are now used to allow scrolling of thumbs while keeping the full record in it's place. This functionaly can also be used in the regular (non-porfolios) "thumb with full record" view, though it has not yet been applied. Care was taken to maintain backward compatibility with existing templates. As of this commit, however, it is most likely that NS Nav 4.x has some disfunctioning portfolio functions. Namely, check/uncheck all items. imageclass.cfg: Minor changes were made to "help" text for thumbfull views. Also minor changes to the global var gWindowProps, which specifies how certain pop-up windows are to be created.
  • Minor changes to further advance support for mysql. Added data_table field to collmgr. Changed code to use data_table field. Changed nature of media_table field. Instead of "yes"/"no" values, it now holds the name of the media_table. Code was updated to use media_table in this new way.
  • Changes were made related to the use of mysql as a search engine for image class. A bug in the area of related views was fixed. Query building was improved (the query itself is more efficient when run).
  • Add to Bookbag from entry view was generating an assertion error for mysql collections. Fixed two small things and it is fine.
  • getimage-idx was altered in order to add mySQL support for metadata. Now it would work with xpat, or mysql, and with our without a mysql media_table. Part of this change included shifting the mysqlSearchEngineInit subroutine from mysqlImageApp.pm to ImageClassUtils.pm so that it can be also be used by getimage-idx.
  • Added support for 'SID' PI to all page handlers. Dropped a related but unused subroutine sidParam from ImageClassUtils.
  • Adjustment for dropping of dddir collmgr field.
  • Fixed a bug that caused portfolios to fail to display items in all cases. Stemmed from Lib change that added cio to the list of parameters passed to BookBagItem for initialization. Also added use of new mediahost colldb field, which allows the server that delivers images to be specified per collection. The default is still specified in imageclass.cfg.
  • Corrected a bug in the way links from coll pages to group pages were built. Relates to GROUPSLINK pi.
  • Modified the checking of old params to flag occurrences of catX parameters and give the user a link to the collection page.
  • Portfolio pick list is now sorted by userid and then portfolio name. This came at the request of a faculty member.
  • JPEG2000 support was added to the middleware. Also made a small change to mysqlImageApp.pm so that it gets the data table name from Collmgr rather than basing it on the collid.
  • Added cgi validity check to add a viewid of "1" if none provided.
  • Minor change to ImageClassUtils::browseAll so that it now uses collmgr to determine the view for browsing images.

• Searchbuild.pm
  • Major changes were made in order to add support for mySQL to image class. ImageApp methods were shifted and/or partitioned in order to simplify subclassing for mySQL. With this commit, both xpat and mysql should be largely functional. XClass searching needs to be tested. The changes for mySQL provided an opportune time to stop the use of full region names in rgn parameters and to stop using Collectionmaps.pm. These changes are complete with the exception if needing some validity checking of rgn parameters.
  • made to be compatable with lib changes. also fixed bug in portfolios where missing items were not being displayed as "missing" they were simply not being displayed. other changes included a fix for the problem where xcoll field data would not display (e.g., dlxs_ma) and other little things.
  • Natural language query string now displays properly on "no results" page. It was failing perhaps due to a race condition related to the cgi redirect that followed and storage of the natlangquery on the session. Also fixed a bug with portfolios. When last item of portfolio was deleted, an internal server error occurred due to an attempt to insert non-existant data rows into the BookBagItems table at the time of storage.

• Sid2.pm
  • Image Class middleware was altered to allow the maximum viewable image size to be restricted based on the value of the imgsizemax collmgr field.
  • Greater support for media file formats was added. Parameter passing in Sid2.pm was changed for a few routines. Sidget2.pm had minor changes in an attempt to improve downloading of media to disk using content disposition headers. Some improvement was achieved.

• Sidget2.pm
  • corrected the mime-type for jpeg images, which has been wrong for all of these years.
  • Greater support for media file formats was added. Parameter passing in Sid2.pm was changed for a few routines. Sidget2.pm had minor changes in an attempt to improve downloading of media to disk using content disposition headers. Some improvement was achieved.
  • JPEG2000 support was added to the middleware. Also made a small change to mysqlImageApp.pm so that it gets the data table name from Collmgr rather than basing it on the collid.

• getimage-idx
  • Removed $userpath remnants from code.
  • Major changes were made in order to add support for mySQL to image class. ImageApp methods were shifted and/or partitioned in order to simplify subclassing for mySQL. With this commit, both xpat and mysql should be largely functional. XClass searching needs to be tested. The changes for mySQL provided an opportune time to stop the use of full region names in rgn parameters and to stop using Collectionmaps.pm. These changes are complete with the exception if needing some validity checking of rgn parameters.
  • Image Class middleware was altered to allow the maximum viewable image size to be restricted based on the value of the imgsizemax collmgr field.
  • A one line change was made to correct a problem seen when displaying an image that exists on the server as a series of fixed size images (e.g., small, medium, large jpegs) as opposed to a multi-res sid file.
  • Changes were made to improve support for media formats other than images. Also, minor changes were made to enable the reduction of customized templates. In other words, some basic generalizations were made so that class or group level templates can do the job.
  • getimage-idx was enhanced for greater support of media formats.
  • Fixed a bug. "Image Access Restricted" was not displaying when needed. Assertion error was being generated.
  • getimage-idx was altered in order to add mySQL support for metadata. Now it would work with xpat, or mysql, and with our without a mysql media_table. Part of this change included shifting the mysqlSearchEngineInit subroutine from mysqlImageApp.pm to ImageClassUtils.pm so that it can be also be used by getimage-idx.
  • fixed bug related to old id retrieval.
  • Minor change to getimage-idx to add handling of tif, tiff, jpg extensions when there is not a media_table.
  • In a couple of spots, getimage-idx had the mysql media table name hard coded when it should have been getting it from the colldb. This was corrected.
  • JPEG2000 support was added to the middleware. Also made a small change to mysqlImageApp.pm so that it gets the data table name from Collmgr rather than basing it on the collid.

• getthumbnail-idx
  • Removed $userpath remnants from code.
  • getthumbnail-idx was enhanced for greater support of media formats. Changes were minimal.

• image-idx
  • Removed $userpath remnants from code.
  • Parameters passed to object creation now a hash instead of an array.
  • Major changes were made in order to add support for mySQL to image class. ImageApp methods were shifted and/or partitioned in order to simplify subclassing for mySQL. With this commit, both xpat and mysql should be largely functional. XClass searching needs to be tested. The changes for mySQL provided an opportune time to stop the use of full region names in rgn parameters and to stop using Collectionmaps.pm. These changes are complete with the exception if needing some validity checking of rgn parameters.
  • Minor changes to further advance support for mysql. Added data_table field to collmgr. Changed code to use data_table field. Changed nature of media_table field. Instead of "yes"/"no" values, it now holds the name of the media_table. Code was updated to use media_table in this new way.
  • Changes were made related to the use of mysql as a search engine for image class. A bug in the area of related views was fixed. Query building was improved (the query itself is more efficient when run).

• imageclass.cfg
  • Major changes were made in order to add support for mySQL to image class. ImageApp methods were shifted and/or partitioned in order to simplify subclassing for mySQL. With this commit, both xpat and mysql should be largely functional. XClass searching needs to be tested. The changes for mySQL provided an opportune time to stop the use of full region names in rgn parameters and to stop using Collectionmaps.pm. These changes are complete with the exception if needing some validity checking of rgn parameters.
  • Image Class middleware was altered to allow the maximum viewable image size to be restricted based on the value of the imgsizemax collmgr field.
  • tweak
  • reset image host url for dev enviro
  • Changes were made to ImageApp.pm, ImageClassUtils.pm, and imageclass.cfg to abandon the use of "storable" freeze and thaw for the long-term storage of BookBag items. The new mechanism stores BookBag items in a seperate table, one per row. The freeze/thaw approach was occassionally storing BookBags that could not be thawed. The root of the problem was never discovered. To faciliate this change and to migrate data from the frozen storage to the new table, a script called convertBookBag.pl has been created and can be found in bin/i/image. It is important to read the comments in the head of the convertBookBag.pl file to understand the steps required to make this transition smoothely.
  • Portfolio functionality is set to be "off" for migration to new BookBag code.
  • Natural language query string now displays properly on "no results" page. It was failing perhaps due to a race condition related to the cgi redirect that followed and storage of the natlangquery on the session. Also fixed a bug with portfolios. When last item of portfolio was deleted, an internal server error occurred due to an attempt to insert non-existant data rows into the BookBagItems table at the time of storage.
  • imageclass.cfg was enhanced for greater support of media formats. Changes were minimal, and mostly included additions to the gWords hash..
  • minor
  • A request for a bookmarked portfolio would not redirect to the login page if the user was not logged in. Now it does.
  • A request for a bookmarked portfolio would not redirect to the login page if the user was not logged in. Now it really does.
  • ImageApp.pm: support for TOTALRESULTS PI was added to results handler. It simply inserts the number of total results. The intended use is in bbthumbfull.tpl (portfolios) to create a referenceable javascript variable that knows the total number of results. This addition allowed the PI THUMBFULLJSARRAYS to be deprecated. Minor mods were also made to maintain the results view when opening a new portfolio, etc. ImageClassUtils.pm: Primarily, changes were made to support new functionality in portfolio's "thumb with full record" view. iFrames are now used to allow scrolling of thumbs while keeping the full record in it's place. This functionaly can also be used in the regular (non-porfolios) "thumb with full record" view, though it has not yet been applied. Care was taken to maintain backward compatibility with existing templates. As of this commit, however, it is most likely that NS Nav 4.x has some disfunctioning portfolio functions. Namely, check/uncheck all items. imageclass.cfg: Minor changes were made to "help" text for thumbfull views. Also minor changes to the global var gWindowProps, which specifies how certain pop-up windows are to be created.
  • Fixed windowprops so they work with netscape nav 4.
  • Minor changes to further advance support for mysql. Added data_table field to collmgr. Changed code to use data_table field. Changed nature of media_table field. Instead of "yes"/"no" values, it now holds the name of the media_table. Code was updated to use media_table in this new way.
  • Changes were made related to the use of mysql as a search engine for image class. A bug in the area of related views was fixed. Query building was improved (the query itself is more efficient when run).
  • Added a global variable to act as a switch for turning on and off mysql fulltext boolean mode, which is only available in version 4.0.2 or newer of MySQL.
  • Fixed a bug in the use of "Boolean" mysql searching.
  • Fixed a bug that caused portfolios to fail to display items in all cases. Stemmed from Lib change that added cio to the list of parameters passed to BookBagItem for initialization. Also added use of new mediahost colldb field, which allows the server that delivers images to be specified per collection. The default is still specified in imageclass.cfg.
  • Modified the checking of old params to flag occurrences of catX parameters and give the user a link to the collection page.
  • JPEG2000 support was added to the middleware. Also made a small change to mysqlImageApp.pm so that it gets the data table name from Collmgr rather than basing it on the collid.
  • added one space to string.

• ImageApp/mysqlImageApp.pm
  • first entry for additions to support mysql as for image class content in image class. this commital might have errors.
  • Minor changes to further advance support for mysql. Added data_table field to collmgr. Changed code to use data_table field. Changed nature of media_table field. Instead of "yes"/"no" values, it now holds the name of the media_table. Code was updated to use media_table in this new way.
  • Changes were made related to the use of mysql as a search engine for image class. A bug in the area of related views was fixed. Query building was improved (the query itself is more efficient when run).
  • Add to Bookbag from entry view was generating an assertion error for mysql collections. Fixed two small things and it is fine.
  • getimage-idx was altered in order to add mySQL support for metadata. Now it would work with xpat, or mysql, and with our without a mysql media_table. Part of this change included shifting the mysqlSearchEngineInit subroutine from mysqlImageApp.pm to ImageClassUtils.pm so that it can be also be used by getimage-idx.
  • Added functionality to retrieve an individual item by an old id that may have been bookmarked or stored in a portfolio.
  • minor change
  • Added support for 'SID' PI to all page handlers. Dropped a related but unused subroutine sidParam from ImageClassUtils.
  • Added a global variable to act as a switch for turning on and off mysql fulltext boolean mode, which is only available in version 4.0.2 or newer of MySQL.
  • Fixed a bug in the use of "Boolean" mysql searching.
  • Clarified query building options for mysql in code and in comments.
  • Minor mod to distinguish between an undef and an empty media_table field.
  • Modified the tagDBdata subroutine to handle the most basic image filename extensions (without needing to have a media table). Specifically, deals with the situation where the image filename field contains a filename that includes a filename extension. If extensions other than tif, tiff, jpg are encountered, a media table is required. It is also OK not to have a filename extension.
  • Minor change to getimage-idx to add handling of tif, tiff, jpg extensions when there is not a media_table.
  • Fixed bug that caused record and image counts to fail with mysql colls.
  • Added phrase searching of a specified field in order to enable accurate retrieval of IDs that have non-alpha-numeric chars. The field can be specfied in the field_admin_maps field of collmgr.
  • Fixed bug that caused assertion error when the user does not use the first search box.
  • Fixed a bug in the bug fix that caused assertion error when the user does not use the first search box.
  • JPEG2000 support was added to the middleware. Also made a small change to mysqlImageApp.pm so that it gets the data table name from Collmgr rather than basing it on the collid.
  • Corrected a bug in sorting when only 1 coll of group searched.

/bin/i/image

• getFlds.pl
  • These scripts can be used to transfer data from image class sgml to collmgr.

• getFlds_all.sh
  • These scripts can be used to transfer data from image class sgml to collmgr.

• icsgml2icmysql.pl
  • first entry of script to convert image class sgml to mysql tables for use with image class.
  • Added index building commands in the sql output. Added field size info for media table. Fixed bug in field identification that in rare cases would cause a row to not have the same number of columns as expected.
  • Problem corrected where entryauth data was not being written to sql data loading file for all items of the entry.
  • Now looks to colldb to know which fields need to be indexed for searching.
  • small change.
  • added collid to "all" field to enable retrieval of all records by collid. this will only work reliably with xpat or mysql 4. mysql 3 will probably misbehave, but maybe not.

• idb
  • changed isentryid delimiter to "]"
  • A new reporting mechanism was added to "idb". A simple tab-delimited report of entryid and filename for MISSING image/media files is now generated in the coll's prep dir. The files is called collid-missing.txt.
  • Support was added for a couple more media formats.
  • Many significant changes were made relative to the handling of media files in the data prep process. The goal being to expand support for media types.
  • Minor changes for friendlier handling of index / indexprep dir options in imageprep and idb. Also added confirmation of collid to idb.
  • Changes to support JPEG2000.
  • made a configuration change for bmp files so that they map to jp2, sid, and then jpg. they were all going to jpg, so all the old static jpgs were being used rather than the sids.

• imageprep
  • changes to fix a problem with fbfile in the coll specific arena
  • minor bug fix related to images in dirs named "large"
  • A problem was fixed in imageprep. It wasn't properly accounting for multiple fixed size images e.g., small, medium, large jpegs. A related change was made to ImageClassUtils.pm so that the middleware would display the multiple images properly.
  • multimedia enhancements
  • Many significant changes were made relative to the handling of media files in the data prep process. The goal being to expand support for media types.
  • Minor changes for friendlier handling of index / indexprep dir options in imageprep and idb. Also added confirmation of collid to idb.
  • JPEG2000 support added.
  • minor change

• imageprep.cfg
  • A bug in imageprep was fixed. The number of binary files was being calculated wrong and if there were only 1 file, it would be skipped. Also, minor changes were made to improve support for other media formats, especially audio and flash.
  • Many significant changes were made relative to the handling of media files in the data prep process. The goal being to expand support for media types.
  • Configuration changes for better support of thumbs for fixed images.
  • 10->4b/blake/rdist.blaketc
  • reverting to jpeg2000-less version for now
  • JPEG2000 support added.
  • configuration adjustment for jpeg2000
  • Added better checking for binaries mrsid_retrieve and kdu_expand.

• imagetobib.pl
  • fixed id location problem
  • stopped the cleaning of viewids for url building because image class does not clean viewids
  • DC.ri was not being output properly due to a case sensitity problem
  • commented out a debugging print statement
  • Added tagging for DC.SO (source) as
    in bib class sgml.
  • Changed to use unnormed rather than normed imageclass sgml for transformation to bib. hmmmm.

• localimageprep.cfg
  • changes to fix a problem with fbfile in the coll specific arena
  • added a little sample configuration code
  • A problem was fixed in imageprep. It wasn't properly accounting for multiple fixed size images e.g., small, medium, large jpegs. A related change was made to ImageClassUtils.pm so that the middleware would display the multiple images properly.
  • Added support for more media formats.
  • Many significant changes were made relative to the handling of media files in the data prep process. The goal being to expand support for media types.
  • Minor changes for friendlier handling of index / indexprep dir options in imageprep and idb. Also added confirmation of collid to idb.
  • Configuration changes for better support of thumbs for fixed images.
  • added configs for bp1ic
  • Adjustment for apis thumbnails.

• putFlds.pl
  • These scripts can be used to transfer data from image class sgml to collmgr.
  • Modified putFlds.pl to properly use DLPS_DEV to determine which colldb row to edit.

• putFlds_all.sh
  • These scripts can be used to transfer data from image class sgml to collmgr.

• setupcollindex
  • commented out some of the perl replacements because they cause troubl
  • Corrected problems related to installation and dlxsdataroot. This should address issues raised by UPitt.

• convertBookBag.pl
  • convertBookBag.pl was created to convert user data stored in a BookBagDB table from the type that uses the "storable" module to freeze and thaw BookBag data for storage to the type that uses a separate table (BookBagItems) to store items individually.

Broker20 version 1.1.0

New and Changed Functionality

• Incorporates support for the CGM protocol.

bin/b/broker20

• CreateAndPopulateCGMTables.txt: contains sql commands used to create the cgm database used by the CgmTC subclass. These tables are created on a dlxs MySQL database.

Collmgr version 3.1.0

New and Changed Functionality

• Deleting a released collection or group deletes the collection or group every where. Added "hold" functionality
• Added release of a single collection at a time
• Added some checks so that when a user reauthenticates after being logged in as admin he will not go to web pages he should not be accessing.
• When a collection is inserted into the dlxs database it checks if the collid is in use by any user. It use to check if it was in use by release, or the user inserting.
• Added some validatiion check for collid. Collid for non bib class collections must be of the form [A-Za-z][A-Za-z0-9_]*.

FindaidClass version 5.0.0

New and Changed Functionality

• Major re-write of Finding Aids middleware making it a full DLXS class.
• Participates in the DLXSClass::FullTextClass object hierarchy.
• Supports EAD 2002 Standard for encoding Finding Aids.
• Configurable via collmgr

XClass version 2.1.0

New and Changed Functionality

• No change in DLXS release 11.

XslFallback version 2.1.0

New and Changed Functionality

• New CGI program supporting fallback of XML templates under XSL stylesheets.

IdResolver version 1.0.0

New and Changed Functionality

• New CGI program that supports the mapping of an ID into a URL for purposes of linking between teh DLXS mideleware classes. Previously Used internally at DLPS and now available to DLXS. The IdResolver CGI is integrated with the MySQL database configuration established in LibGlobals.pm.

DLXS Release 10 - 15 FEB 2003

General Information

DLXS Release 10 is comprised of:

• TextClass version 3.0.0
• BibClass version 2.3.0
• FindingAids version 2.1.0
• ImageClass version 2.5.0
• Broker20 version 1.0.0
• Collmgr version 3.0.0
• XClass version 2.0.0
• Lib version 3.0.0
• mrsid_retrieve version 1.3.1
• tif2web version 1.0.3
• dlxsd version 1.0.0
• XPAT version 5.2.3

Known Problems

The SQL::Statement version 1.005 perl module is not backward compatible with version 0.1021. Version 0.1021 was typical with Perl version 5.6.1 whereas 1.005 is typical of Perl 5.8.0. We recommend you install perl 5.8.0 and SQL::Statement 1.005 or higher. The workaround mentioned below may not be required when SQL::Statement 1.006 becomes available. Because of this the following constraints and workarounds apply.

• collmgr
  • Functions normally with either 0.1021 or 1.005

• dbmove
  • Functions normally moving CSV to MySQL under either 1.005 or 0.1021
  • Incorrectly uppercases column names when moving MySQL to CSV under 1.005. The workaround is to lower case the resulting column names using an ascii editor.
  • Fails completely under 0.1021 moving CSV to MySQL or vice versa..

• upgrade_1_2, upgrade_2_3
  • Functions normally upgrading a MySQL database under either 1.005 or 0.1021
  • Incorrectly uppercases column names when upgrading CSV under 1.005. The workaround is to lower case the resulting column names using an ascii editor.

XPAT version 5.2.3

• No change from Release 9

Lib version 3.0.0

New and Changed Functionality

lib

• ApplicationResult.pm
  • Significant enhancements to support TextClass sorting and results inter-filing. Caching mechanism for performance.
  • Support ISO date in sorting
  • Add id array compression to save space in session

• BookBag.pm
  • When removing an item from the bookbag if it is the last item for a collid, remove the collid so we wont try to search a bookbag collid list that has no idnos in it.

• CioFactory.pm
  • Fix bug where database was always being read even if there was a cio already on the session.
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • Changed calls to html template handling to be in DlpsUtils rather than in each of the apps. Added to DlpsSession, DlpsUtils and LibGlobals data to hold a history of URLs to make assertions able to trace back a user's path to a bad URL. Previous subroutines like SetOriginalCgi are now SetOriginalCgiHistory and so on.
  • Remove $main::user[name|part] workdir syntax
  • Enhanced fallback for ImageClass using a new mode "groupcoll" which supports fallback for the case of a single c= appearing with a g= The fallback is from coll to group to default group to class. Also support for "defaultgroupid" in Collection table when it is added to the database schema. This allows singlecoll mode 'to fallback form coll to default group to class, again for ImageClass and probably TextClass.

• CioWrapper.pm
  • Added messages for assertions

• CollsInfo.pm
  • AddClassObjects now take the requestedCollArr instead of grabbing it internally so we can add class objects on the fly for next/prev item links
  • Made it a crime to ask for a tco using an undef collid
  • Allow multiple ignoreon hosts
  • Added matching and 'all' token for ignoreon
  • Added NOASSERT param to GetClassObjByCollId() to test whether tco has been added to CIO

• DLXSApp.pm
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • Fix problem in Debug method where DumpEnvVars called without empty parameter list "()" was shifting a cgi object into its scope making it produce plain text
  • branches: 1.16.2; Change to move call to ValidityChecks to individual applications subclasses' initialize methods.
  • Add PrepareAroForCacheKey() to globally flush cache on key mismatch instead of doing it as a side-effect in ValidOccurrencesInCache and ComputeCacheState
  • Fix XClass app trying to prepare aro for caching. it is the child's responsibility only.

• DbUtils.pm
  • All uses of double-quotes in SELECT statements were changed to single quotes for compatibility with future versions of the SQL::Statement perl module.
  • use DlpsUtils qw( :DEFAULT ); not use DlpsUtils;
  • Fix of typo in error message.

• DevUtils.pm
  • Enhanced AUTHZD_COLL file error message

• DlpsSession.pm
  • Fix bug where database was always being read even if there was a cio already on the session.
  • Changed calls to html template handling to be in DlpsUtils rather than in each of the apps. Added to DlpsSession, DlpsUtils and LibGlobals data to hold a history of URLs to make assertions able to trace back a user's path to a bad URL. Previous subroutines like SetOriginalCgi are now SetOriginalCgiHistory and so on.
  • use DlpsUtils qw( :DEFAULT ); not use DlpsUtils;
  • Added GetPersistentSessionItemByKeySubkey4() for caching mechanism in TextClass
  • branches: 1.33.2; Clone cgi before saving it to history array

• DlpsUtils.pm
  • Added html CHUNK handling subroutine.
  • Modified SingularizePluralizeTerm so term must match exactly so we can pass in keys likes 'match' and 'matching term'
  • Changes related to work in collection/group selection and consolidation of templates.
  • TrimSpaces after removing metachars in case this removal introduced leading or trailing spaces
  • Added parameter to RemoveTags() to make it remove entire elements or just the tags
  • Added excl to entity filter
  • Removed. home.tpl now covers all cases by redirecting to ets post-login
  • added assertion for missing filename in resolution in GetDefaultFileForCGC(). if page=foobar the hash lookup for the corresponding filename fails and we end up resolving to a directory instead of a file and spew garbage.
  • Fix bug in BuildAuthPageContent() which caused a blank dlpserror page if $LibGlobals::gLoginUrl was empty (as it would be after a normal dlxs install. Fix bug in BuildLoginRedirect(). Url passed to the auth system needed to be URL escaped to fix: escape the URL string so it will survive URL unescaping by the auth system. In addition the auth system will replace ';' by '&' for separators to work around the meta tag refresh parsing bug present in most browsers where a meta tag like <META http-equiv="Refresh" content="1; URL=http://fizzie/text-idx?c=moa;sid=foo"> causes the sid following the second semicolon to be stripped
  • Added new system error message
  • Print trace if DEBUG or DLPS_DEV not just DLPS_DEV
  • Added RemoveXPATMetachars() called from enhanced Filter_NOTEn_NotesForText() to use content as well as ID to uniquify note.
  • Added dump of envvars to assertion email
  • Changed calls to html template handling to be in DlpsUtils rather than in each of the apps. Added to DlpsSession, DlpsUtils and LibGlobals data to hold a history of URLs to make assertions able to trace back a user's path to a bad URL. Previous subroutines like SetOriginalCgi are now SetOriginalCgiHistory and so on.
  • added comment to URL History
  • Remove hardcoded mail addr left in accidentally
  • Fix logic in GetDefaultFileForCGC(). It needs to be told whether $filename came in as being explicitly set as tpl= for customization on the url or was derived from cgi parameters like page, view, or browse. In the explicit case the fallback is from collection to group but cannot proceed to class (because it's custom) whereas in the non-explicit case the fallback depends on the cross-collection mode i.e. on whether we're looking for collection, group or class templates.
  • fix SetOriginalCgiHistory() to allow for no $dso
  • Finally get fallback correct for tpl= parameter. The specified value of the tpl= parameter is a filename that falls back as a function of xcollmode (groups colls singlecollection) just like everything else
  • Enhanced fallback for ImageClass using a new mode "groupcoll" which supports fallback for the case of a single c= appearing with a g= The fallback is from coll to group to default group to class. Also support for "defaultgroupid" in Collection table when it is added to the database schema. This allows singlecoll mode 'to fallback form coll to default group to class, again for ImageClass and probably TextClass.
  • Remove '|' from the RemoveXPATMetachars() subroutine. It's not a metachar and we do not map it to a space in most all .dd's
  • Added semicolon to &nbsp of environment variable dumping routine in DlpsUtils
  • Fix case in GetDefaultFileForCGC() SPECIAL CASE: for resolving tpl=file.tpl (e.g. browse.tpl). file.tpl must be located in coll, default group or (unlikely) class space: if $xcollMode is 'colls' because xc=1 (meaning we came from the cross-collection interface) but there is only once 'c' (user is navigating within a single collection) we need to make it look like we're in single collection mode for the purposes of resolution in this routine.
  • Added $gIdResolver to LibGlobals so that all classes may call it there. Also, moved the resolveIdToURL routine from ImageClass to DlpsUtils so that all can call it there.
  • Added "use LWP::Simple" so that call to IdResolver could be made.
  • added q4, q5 and q6 to terms that will be highlighted
  • SingularizePluralizeTerm() handles zero as the number as well as 1 or greater. If zero, return plural.
  • branches: 1.136.2; Fisheye routines now ASSERT if $script is not passed in.
  • added GenComputeTime
  • Needed new routine to get only the last CGI object from the CgiHistory.
  • Fix OELIG => OElig charent
  • Changed SingularizePluralizeTerm to send back originally passed in term, unchanged, if it is not found in the hash.

• GroupsInfo.pm
  • use DlpsUtils qw( :DEFAULT ); not use DlpsUtils;
  • Added ignoreon for groups

• LibGlobals.cfg
  • Removed. home.tpl now covers all cases by redirecting to ets post-login
  • Enhanced system error message
  • Changed calls to html template handling to be in DlpsUtils rather than in each of the apps. Added to DlpsSession, DlpsUtils and LibGlobals data to hold a history of URLs to make assertions able to trace back a user's path to a bad URL. Previous subroutines like SetOriginalCgi are now SetOriginalCgiHistory and so on.
  • branches: 1.23.2; Added $gIdResolver to LibGlobals so that all classes may call it there. Also, moved the resolveIdToURL routine from ImageClass to DlpsUtils so that all can call it there.

• LibVersion.pm
  • use LibVersion 3.0

• ObjectFactory.pm
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.

• ProcIns.pm
  • Allow the SimpleSubstitution to take a ref to a string as well as a string to save copying
  • Scalar ref accepted as return value from PI handler method

• QueryFactory.pm
  • Allow full Reverse Polis Notation in the boolean search. So that queries like (a and b) or (c and d) can now be converted into xpat queries. Prior to this change only boolean queries like (((a and b) and c) or d) could be made
  • Corrected a problem from previous release so that boolean searches can be RPN.

• SearchHistory.pm
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • Use ';' instead of '&' in URLs
  • No longer remove sort cgi parameter so that different sorts show up in search history as different searches easily recovered. Corresponds to change in TextApp::BuildNatLangSearchString to mention sort used

• SearchSet.pm
  • byte mode implemented

• XPat.pm
  • byte mode implemented
  • enhancements to support bytemode in XPat
  • Print trace if DEBUG or DLPS_DEV not just DLPS_DEV
  • use DlpsUtils qw( :DEFAULT ); not use DlpsUtils;
  • added path truncation to GetDataDictName() method.
  • Changed GetRegionSize to use new signature for GetSimpleResultsFromQuery.

• XPatResult.pm
  • enhancements to support bytemode in XPat
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • Added save/restore for XRO for caching
  • branches: 1.10.2; added only one-half of pset offset to pset result byte offset to keep KWICs in their regions

• XPatResultSet.pm
  • Added a new SSize label type 'hitsinbooleanregionssearch'
  • generalized detailhitsinitemsearch type to work for boolean and simple search hits counts in a single item
  • enhancements to support bytemode in XPat
  • Added GetResultsAsArrayRef() for efficiency in accessing result in sort key case where the arrays are large and iterating over the result is too expensive
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • branches: 1.19.2; use DlpsUtils qw( :DEFAULT ); not use DlpsUtils;

• repositoryNames.pl
  • new for repository counting reslist
  • new CCSDthesis description
  • new uq description

• BookBagItem/BBItemBC.pm
  • Since TextClass::_HeaderFilter is called by BBItemTC::_initialize, and it requires the $cgi and $dso, they also needed to be sent to the BBItemTC::_initialize method. Also, added these as parameters in BBItemBC so that they might be accessed downstream if need be.

• BookBagItem/BBItemTC.pm
  • enhancements to support bytemode in XPat
  • Since TextClass::_HeaderFilter is called by BBItemTC::_initialize, and it requires the $cgi and $dso, they also needed to be sent to the BBItemTC::_initialize method. Also, added these as parameters in BBItemBC so that they might be accessed downstream if need be.
  • branches: 1.8.2; Filter tags in all the pieces that come back from _HeaderFilter() not just source but title, author, availability etc.
  • Commit after merge of results and groups work.

bin/db

• dbmove
  • put in some error checking and included some logic for the PageviewFig table.
  • included PageviewFig logic

• dbmove.cfg
  • included PageviewFig logic

• upgrade_1_2
  • put in a bit more error checking.

• upgrade_1_2.cfg
  • changed test dirs.

• upgrade_2_3
  • initial release.
  • got rid of the use of userpart, and move lib version up to 3.0000

• upgrade_2_3.cfg
  • initial release.

Bugs Fixed

Text Class version 3.0.0

New and Changed Functionality

• TextClass
  • TextClass has undergone significant re-architecture in order to implement sorting of results by author, title or date and, in cross-collection searches, to inter-file results from all selected collections.
  • The results list is now more consistent across encoding levels. The initial results list consists of a bibliographic display per item.
  • The user may select a link on the to see detailed search results either as summaries of hits or as key-word-in-context (KWIC).
  • Full support for collection groups is now available via a "group select page" allowing the user to narrow their attention to search a group of related collections.
  • The cross-collection search page now displays the group (if any) within which the collections to be searched reside, along with the other available groups.
  • TextClass default templates have been modularized so that, for example, the search page template is a single file supporting all of the search types via "chunks" of html that can be plugged into the master template. The navbar is also a module. In general, this modularization should reduce the number of files that require modification to effect a site-wide change.
• Pageviewer
  • Contone pages can now be displayed as well as bitonal pages.
  • Pages can be associated with contone "figures" that appear in them. When displaying the bitonal page, thumbnails of included figures, if any, are displayed. Each thumbnail has a link built to ImageClass to display a larger image, with all associated ImageClass behavior (panning, zooming, etc.)
  • There is a new table in the dlxs database called PageviewFig to hold information about any figure images, and there is a new field in the Pageview table to hold information about the bit depth of a page image (related to whether it is bitonal, contone, etc.)

web/t/text

• accesspolicy.tpl
  • new supporting files for umdl texts

• bbagbooleansearchform.chnk
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks.

• bbagemail.tpl
  • minor fixes to header.tpl, and bbaglist and bbagemail to correct labeling of search options.

• bbaglist.tpl
  • minor fixes to header.tpl, and bbaglist and bbagemail to correct labeling of search options.

• bbagproximitysearchform.chnk
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks.

• bbagsearch.tpl
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks.

• bbagsimplesearchform.chnk
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks.

• bib.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• bibext.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• bibsearchform.chnk
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.

• boolean.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• booleanbbag.tpl
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks. So, old bbag search tpls not needed.

• booleanext.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• booleansearchform.chnk
  • Chunking in more generic searchext form and ongoing groups/collections selection work.
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.

• browse_template.tpl
  • replaced dynamically built references to plug.gif with static ones in all tpl files

• browsecolls.tpl
  • Initial commit of collection browsing page.
  • Hard paths to graphics files (to avoid numerous GRAPHICS_PATH PI resolutions).
  • updated js code for new menus
  • updated search form chunkfiles to include collection specific field pis. Also added nav header chunks to header.tpl and reslist.tpl

• browsetabstyles.css
  • Creation of NAV_TAB_STYLE_OVERRIDES PI and supporting code and files.

• header.tpl
  • First checkpoint on Branch_1_results_groups
  • Removed <?GRAPHICS_PATH> PI for plug.gif
  • updated search form chunkfiles to include collection specific field pis. Also added nav header chunks to header.tpl and reslist.tpl

• home.tpl
  • Initial commit of new splash page to replace previous "home.tpl".
  • changes to search form chunks implement a change to the search submit button eliminating the type=image. change to search.js adds a line or to to the pageinit function that unchecks all the collname checkboxes if the selected group is "ALLSELECTED", or the colls by title list.

• index.html
  • these files are no longer used, since the counts of collections and text is dynamically calculated and the home.tpl file is used for display.

• jsheader.chnk
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.

• mm_menu.js
  • Adding of mm_menu.js.

• navheader.chnk
  • Ongoing work for group/collection selection.
  • Chunking in more generic searchext form and ongoing groups/collections selection work.
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.
  • Removed reference to "searching UMDL Collections" since other information about the collection or group being searched is already present.
  • updated search form chunkfiles to include collection specific field pis. Also added nav header chunks to header.tpl and reslist.tpl
  • added graphics. updates to css. fixed form wrap in ww form, and some link problems in navheader.chnk
  • navheader now includes bookbag notification search form chunk files now have fix in layout for specific restriction elements search tpl fixed now so that loose table cell end tags don't' hang around in some circumstances
  • fixed affecting netscape display of standalone search forms.
  • many changes to all search and bbagsearch form chunk files. all bbagsearchform chunk files should now be consistent with the rest of the search forms. Also restored search_restrictions PI to search.tpl. minor fixes to text class.css

• newmaterial.tpl
  • new supporting files for umdl texts

• pageviewer.frameset.tpl
  • tweaking navheaderchunk and searchform chunks. Added also navhaeder chunk to pageviewer.nav. ww search links are included on search forms, but not yet in the navigation pulldown menu

• pageviewer.js
  • removed unnecessary lines from pageviewer.js
  • edited the pageviewer.js file so that the open window function would work minimally.

• pageviewer.main.tpl
  • Addition of figures PI.

• pageviewer.nav.tpl
  • changed pageview.nav.tpl to fix a target bug in the nav links. Updated and commented much of text class.css
  • tweaking navheaderchunk and searchform chunks. Added also navhaeder chunk to pageviewer.nav. ww search links are included on search forms, but not yet in the navigation pulldown menu
  • added graphics. updates to css. fixed form wrap in ww form, and some link problems in navheader.chnk

• pageviewer.pagenav.tpl
  • tweaking navheaderchunk and searchform chunks. Added also navhaeder chunk to pageviewer.nav. ww search links are included on search forms, but not yet in the navigation pulldown menu

• proximity.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• proximitybbag.tpl
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks. So, old bbag search tpls not needed.

• proximityext.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• proximitysearchform.chnk
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.
  • additional adjustments to headernav.chnk --including addition of auth and umdl home links--and adjustments to all search forms to fix an alignment problem.
  • fixed small bug in search.js pageinit function, and straightened out some alignment issues in the search form chunks.
  • changes to search form chunks implement a change to the search submit button eliminating the type=image. change to search.js adds a line or to to the pageinit function that unchecks all the collname checkboxes if the selected group is "ALLSELECTED", or the colls by title list.

• reslist.tpl
  • First checkpoint on Branch_1_results_groups
  • Removed <?GRAPHICS_PATH> PI for plug.gif
  • updated search form chunkfiles to include collection specific field pis. Also added nav header chunks to header.tpl and reslist.tpl
  • fix occ=2 for second occurrence of nav links
  • Changed SEARCH_TYPE to SEARCH_TYPE_NAME

• search.js
  • Chunking in more generic searchext form and ongoing groups/collections selection work.
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.

• search.tpl
  • Ongoing work with collection/group selection. Template consolidation using chunks and only one search page (search.tpl) to handle all "ext" type pages and search types.
  • Added PI for hidden variable for search type within the form, based on the URL's page parameter (now that all types are using the same template).
  • Added PI for hidden variable for REQUESTED_COLLECTIONS and BOOKBAG, left out of mockup.
  • Creation of NAV_TAB_STYLE_OVERRIDES PI and supporting code and files.
  • changes to navigation chunk, search.tpl, and associated css files to implement the horizontal navigation menu to all pages
  • Added HIDDEN_XG PI.
  • added <?HIDDEN_DEBUG>

• searchext.tpl
  • Chunking in more generic searchext form and ongoing groups/collections selection work.

• searchhistory.tpl
  • added new styles to text class.css to handle fonts for l2 pages form the portal home page. Changed searchhistory.tpl so that it would resemble other searches

• searchtabstyles.css
  • Creation of NAV_TAB_STYLE_OVERRIDES PI and supporting code and files.

• simple.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• simplebbag.tpl
  • Modified bookbag search templates. Collapsed to bbagsearch.tpl and search form chunks. So, old bbag search tpls not needed.

• simpleext.tpl
  • Removal, since these are superseded by search.tpl and html chunking.

• simplesearchform.chnk
  • Chunking in more generic searchext form and ongoing groups/collections selection work.
  • updated search form chunkfiles to include collection specific field pis. Also added nav header chunks to header.tpl and reslist.tpl

• splash.tpl
  • replaced dynamically built references to plug.gif with static ones in all tpl files

• text.picklist.tpl
  • replaced dynamically built references to plug.gif with static ones in all tpl files

• text.tpl
  • additional adjustments to headernav.chnk --including addition of auth and umdl home links--and adjustments to all search forms to fix an alignment problem.

• textclass.css
  • added new styles for the collection browse page,added new styles for results and navigation, and weeded out a lot of the old style declarations
  • Added .indentlevel0 to support inline summaries following pages in level 1 and 2 material
  • Added some additional indent levels for outline layout (vs. breadcrumb)
  • added new styles to textclass.css to handle fonts for l2 pages form the portal home page. Changed searchhistory.tpl so that it would resemble other searches

• textclass.js
  • Added a mechanism to popupNotesWindow() to fork off a new window for note links contained within the note popup window itself and so on recursively. Fixes javascript problem in Netscape where clicking on the second link failed to replace the URL content of the original popup, hanging instead.

• viewtextnote.tpl
  • added graphics. updates to css. fixed form wrap in ww form, and some link problems in navheader.chnk

• ww-fullform.chnk
  • new chunks for wwheel

• ww-startform.chnk
  • new chunks for wwheel

bin/t/text

• importpageviewdata.pl
  • bug fixes: * check, rework parameters used to effect directory recursion (File::Find) enhancements: * add capability to skip directories which contain a file named ".importpageviewdata.skip"
  • bug fixes: * correct typo in output generated by new directory skipping function

• makepageviewdata.pl
  • Initial commit of makepageview.data.pl

cgi/t/text

• DlpsLocalUtils.pm
  • Fix 'view entire link, add InMyOwnWOrld method
  • Changed calls to CgiToHtmlTemplate and such to use DlpsUtils routines.
  • use DlpsUtils qw( :DEFAULT ); not use DlpsUtils;
  • Change to move call to ValidityChecks to TextApp subclass's' initialize method and to group various functions in the initialize method to allow further subclassing. Changed calls to CgiToHtmlTemplate to use the formerly global, now member data version of the pages handled hash.
  • branches: 1.13.2; Fixed ASSERT in DlpsIdResolver() in call to CgiToHtmlTemplate() where $self was used instead of the parent app of the tco in question.
  • Changed CheckIdMatches to search for matches in all cases except when the idno has a volume/issue extension (such as "0001.001").
  • Changed IdResolver trap so that it would use whatever IDNO region is mapped in the specific collection's map file.
  • Fixed PVApp.pm initialize to properly call AddClassObjects, so that the 'parentapp' key was defined, it in turn being needed in DlpsLocalUtils's DlpsResolver trap. Also fixed textclass.cfg's pages handled for pageviewer.

• PVApp.pm
  • removed GenComputeTime() now in DlpsUtils
  • Fix 'view entire link, add InMyOwnWOrld method
  • Added digit to regexp on dev directory name (for branching in development work) in routine to clean path names when in remote mode.
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • Added handling of JS_PATH PI to frameset handling.
  • Changed calls to CgiToHtmlTemplate and such to use DlpsUtils routines.
  • Remove userpath, userpart old workdir model
  • Remove userpath, userpart old workdir model
  • Change to move call to ValidityChecks to TextApp subclass's' initialize method and to group various functions in the initialize method to allow further subclassing. Changed calls to CgiToHtmlTemplate to use the formerly global, now member data version of the pages handled hash.
  • Changes in initialize to segregate setting of member data (offshoot of changes in 'pageshandled' hash).
  • add validity checks to initialize
  • Changes to pageviewer to allow for contone figures within bitonal pages and contone pages. Note: this is in conjunction with the addition of the dlxs database's PageviewFig table and the bpp field in the Pageview table.
  • Changes for figure navigation.

• PageView.cfg
  • Changes to pageviewer to allow for contone figures within bitonal pages and contone pages. Note: this is in conjunction with the addition of the dlxs database's PageviewFig table and the bpp field in the Pageview table.

• PageView.pm
  • Change to move call to ValidityChecks to TextApp subclass's' initialize method and to group various functions in the initialize method to allow further subclassing. Changed calls to CgiToHtmlTemplate to use the formerly global, now member data version of the pages handled hash.
  • Changes to pageviewer to allow for contone figures within bitonal pages and contone pages. Note: this is in conjunction with the addition of the dlxs database's PageviewFig table and the bpp field in the Pageview table.
  • Fixed typo in tif2gif handler.
  • Added debugging to daemon call routine.

• TextApp.pm
  • Use byte offsets for speed
  • Use QueryFactory for all id searches and begin boolean kwic search work.
  • Added boolean kwic and slicing thereof
  • Next/previous item links
  • Ongoing changes to search page handling. Added HIDDEN_XG PI and building of hidden "c" and building of collection list with checkboxes based on number of "c" params in URL.
  • Fix broken view entire text link
  • Work enhancements to support bytemode in XPat
  • Added node/idno parameter to BuildMainEntry and BuildSerialEntry for overrides that need to build links
  • Remove citerestrict if cite is empty;remove submit.x, submit.y
  • Added subsorting by title for date and author
  • Fixed "view text" links to go to first page pageviewer of iel 1 and first page of article in iel 2
  • Added item-level search test routine, added removal of sort menu when over threshold
  • Added sortflds collmgr field processing
  • Reset start=1 if sort order changes. Fix cross class sort menu and search code if all collections do no share all of the sort types.
  • Fix type=bib searches and make the naming of the bib search (Bibliography) consistent.
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • More error reporting for XPat errors
  • ASSERT that 'idno' has a 'cc' in URL
  • Changed calls to CgiToHtmlTemplate and such to use DlpsUtils routines.
  • Remove userpath, userpart old workdir model

• TextClass.pm
  • Added $dso param to some methods
  • typo
  • Changes for ALLSELECTED=1 and prev/next item links
  • Fix 'view entire link, add InMyOwnWOrld method
  • Added parameters to StripMainHeader() and cosmetic byte mode changes
  • Added node/idno parameter to BuildMainEntry and BuildSerialEntry for overrides that need to build links
  • fix StripDivhead param order
  • Added parameter to RemoveTags() to make it remove entire elements or just the tags
  • Added subsorting by title for date and author
  • Sort quoted titles correctly
  • use correct "main" (article) region to query for hits summary in serialissue encodingtype (moajrnl)
  • Added debugging. Fixed sorting for the case where there are missing dates or authors. We have to do 2 queries: one for the dates and one for the titles in headers without dates and merge the results in an rset. Cant be done in one query because there are 2 regions (date and title) but the pr.region.... command only lets us spec one of them. The same for author too. Removed ALLSELECTED from the CGI object before constructing the cache key -- ALLSELECTED is analogous to the cc -- it should not appear.
  • Fixed "view text" links to go to first page pageviewer of iel 1 and first page of article in iel 2
  • New routines BuildLinkToFirstIdnoPage( $cgi, $dso, $xpat, $idno, $iel ); and BuildLinkToFirstNodePage( $cgi, $dso, $xpat, $idno, $node, $iel ); replacing ones that were iel specific
  • Added params to FigureFilter()
  • VIEW_ENTIRE_TEXT_LINK no includes entire html content for complete over-ride if desired
  • Added some additional indent levels for outline layout (vs. breadcrumb) and implemented detailviewayout in db
  • Added sortflds collmgr field processing
  • Added ftr to PB filter so the "all pages' can list the page type if available as well as the pages
  • Changed 'view text' to 'view first page' for lel < 3
  • Added PI handler for "add to bookbag" link in header.tpl
  • Fix type=bib searches and make the naming of the bib search (Bibliography) consistent.
  • Removed qw( :standard :html3 escape unescape escapeHTML ) from all "use CGI" pragmas. 8% performance improvement.
  • Enhance <PTR> note handling allowing reference to pointer targets in different texts within the same collection. For ecf.
  • Enhanced Filter_NOTEn_NotesForText() to use content as well as ID to uniquify note.
  • More work on Filter_NOTEn_NotesForText allowing for note content having been previously highlighted by TextFilter()
  • Remove userpath, userpart old workdir model
  • When Refining a search within an item after already having refined once, the search searches across that item. It use to search across the entire collection after Refining more than once. When Refining the search within a bookbag after already having refined once, the search searches across the contents of the bookbag. It use to search across the entire collection after Refining more than once.

• TextClassUtils.pm
  • Added PIs and methods to grab total collection and total group numbers.
  • Work for Group/Collection selection: handling of browsecolls (groups) page.
  • Creation of NAV_TAB_STYLE_OVERRIDES PI and supporting code and files.
  • Ongoing changes to search page handling. Added HIDDEN_XG PI and building of hidden "c" and building of collection list with checkboxes based on number of "c" params in URL.
  • Changed WW_NAV to look only and collection number and type rather than xcollmode.
  • Changed PI handler for TITLE to call HOME_LINK handler
  • Fixed up a couple of link building routines that need to set ALLSELECTED=1 and moved a tco access based on cc to the case where there'll actually be a cc.
  • Added tpl=home.tpl in "collection home" links in collection list of cross-collection mode.
  • In the building of a "word index" link in the nav bar's search pull down, added a test to see if in xcoll mode. So, even if there is only one c (that does have a word wheel index), no link to wordwheel will be built if there is a "xc" parameter.
  • In the building of a "word index" link in the nav bar's search pull down, changed the test to use the xcollmode saved on the $dso (which in turn meant passing the $dso to the IncludeExcludeNavLinks routine.
  • Changes to building of home link to use fallback for finding home.tpl.
  • Added xg parameter to links on groups (and "all collections" ) when in xg mode, so that the left frame (with aforementioned links) continues to be built.
  • Added logic to force intersection of values in region pulldown in search forms to 'full text' for simple and proximity and 'works' for other search types. Javascript in search.js will need to have the same logic (although it intersects values from the arrays built from the CGI grabbing colldb valu