Week Beginning 10th August 2026

I was back in Glasgow and back to a five-day working week this week, as the summer holiday period drew to a close.  I spent a fair amount of time this week continuing to work on the DOST Auld Laws project.  Luca has been working on the XML queries I’d specified for the advanced search and I was able to test them out and give feedback on them.  These are mostly all working as I’d hoped, which is really great, and I was able to begin working on the front-end aspects of the advanced search, with the aim of connecting all of this into the queries Luca had created.

However, I also had to spend quite a bit of time working with the source files, as the project PI Joanna Kopaczyk-McPherson had realised that two of the eight documents should really be split up into smaller sections.  This was no straightforward task, as not only did it require the XML documents to be split into smaller sections, but many other aspects needed to be updated.  The document IDs needed to be changed, which mean IDs used for image filenames throughout the documents also needed to be changed, with the filenames of the actual images also then needing to be updated too.  For page navigation in the site data is stored in a database and this also needed to be updated, and the XML files stored in eXist for search purposes also needed to be updated.  There were twelve steps I needed to follow for each required split, which took some time, but thankfully the process went pretty smoothly and we ended up with 13 documents in the site instead of the original 8.

There were further issues to come, as Joanna has now noticed that the documents need further edits and tweaks, and not just minor changes to text but structural issues such as the insertion of omitted lines.  This is going to be very difficult to do as lines are linked to coordinates in the images, which was all handled via the Transkribus tool.  We exported the XML files from Transkribus month ago and many major changes have been made to the files since the export so it’s not going to be possible to re-import them.  Manually creating new lines in the XML files as they are now will not have the connections through to coordinates in the corresponding image files, so we’ll end up with inconsistent data.  It’s not a great situation to be in, and ideally all editing of the documents should have been completed in Transkribus before we exported the files, something I’d mentioned back when I undertook the export process months ago.  We haven’t reached a decision on how best to handle this yet and we’ll continue to discuss the options next week.

Despite all of this I did manage to work on the advanced search, creating the advanced search form which, as specified, features a textbox where you can enter some text, a list of documents from which you have the option of selecting the ones you’re interested in and a list of tags that you can either include, exclude or limit your search to, as you can see in the following screenshot:

As of yet I have not implemented the tag limits, but the limit by documents is operational.  This connects through to Luca’s new eXist-db queries to perform a search limited by documents and as with the quick search, you can also sort the results by words to the left and right of the term, although I’ll need to get Luca to look into how the KWIC is generated for the advanced search results as they don’t seem to cross line boundaries, unlike the quick search.  The advanced search results display information about the documents you’ve selected and if you press on a search result to load the corresponding page the link back to the search results takes you to the right place.  There’s still lots to do.  The limit by tags is the biggest thing and will probably take quite some time.  I also still need to add in an option to cite a specific search result page and add in an option to refine your search, which will remember the options you previously filled in when you return to the search form.  An option to clear the search also needs to be added.  I’ll continue with this next week.

Also this week I participated in two meetings about the place-names AHRC proposal I’m involved with, and this is coming together very well.  We now have an outline proposal completed and pretty much ready for submission.

I also spent a bit of time continuing with the travel routes for the HiMuJe Malabar project, adding in a few more travel routes that had been prepared and made a few tweaks to the XSLT that generates the entry HTML for the new DSL interface, fixing some issues with the layout of the new ‘combs’ sections.