Theo Todman's Web Page - Notes Pages

Status Reports

Website - Outstanding Developments (2020 - June)

(Text as at 03/07/2020 22:09:07)

*** THIS IS NOT THE LATEST VERSION OF THIS NOTE ***


(For the live version and other versions of this Note, see the tables at the end)

Rationale for this Document


  1. Own Website: Outstanding Items By Priority:-
    • Priority: 1
      1. Architecture (In Progress): Compact and Repair Problems
        1. On compacting and repairing my main database I sometimes get the error "The query cannot be completed. Either the size of the query result is larger than the maximum size of a database (2 GB), or there is not enough temporary storage space on the disk to store the query result".
        2. It happens 3 times while the database is re-opening.
        3. There is lots of space, and the database is only 600Mb (and the error started when it was under 500Mb).
        4. This mostly happens after I've run long processes, so I usually close the database, re-open it and then try the compact and repair. Usually this works, but not always. But I then try again and the message disappears.
        5. I strongly suspect that this is MS Access itself re-indexing tables, and blowing up a temporary database, but I can’t find any evidence for this on-line. Or help, other than suggestions to split databases and do other sensible things. Given that the error occurs when the database is re-opening, with no temporary file visible, is very strange.
        6. 17/04/20 - set MaxLocksPerFile to 1,000,000 (from the default 9,500). Sadly, it doesn't seem to have made a difference.
      2. Architecture (In Progress): Complete XRef-re-engineering project:-
        1. Ensure all links and link-pages use the new XRef table, and pension off the old tables.
        2. Look into writing out specific object-identifiers, and linking thereto for Citations, rather than paragraph references. An issue is multiple instances of the same object in a document.
        3. Check all link-types still work and fix any errors.
        4. Complete the auto-triggering of regeneration of “associated” link pages.
        5. Fix update bug in Convert_Webrefs.
        6. Fix Bug whereby PaperSummary pages seem to have “Works-” and “Books/Papers-” Citings that refer to the same link-pages.
        7. Document the process!
      3. Architecture (On-Going): Review effectiveness of hyperlinking method in the light of PhD and Philosophy of Religion experience.
      4. Architecture: Where possible, use ID rather than NAME for in-page hyperlinks
      5. Backups: Investigate Record-count discrepancies:-
        1. How do website files work as far as counts are concerned?
        2. Why aren't they recorded in Backup_History, nor the fact that the website was backed up?
        3. Different counts depending on whether new or old laptop is backed up. Investigate 63k discrepancy - lower on new laptop.
      6. Backups: Review architecture to improve performance; Need to document first
      7. Books: Further improve the time to regenerate Book Summaries. Now takes about 39 minutes, but should be under 5 minutes!
      8. Books/Papers: Investigate whether multiple Subject/Topic/Subtopic usage leads anywhere (ie. are just the first (of 3) actually used). Fix anything amiss.
      9. Books/Papers: Reformat the PaperCitings pages:-
        1. Include only useful information on the detail pages; but if there are multiple links from the same object, include them on the same line as 'extra links' as in Authors' Citations (copy the code).
        2. Include counts on the summary page.
        3. Document!
        Do the same for BookCitings
      10. Bridge (In Progress): Develop auto-reconciliation routines vs EBU results download
      11. Documenter (On-Going): Investigate the error reports from the Documenter, especially unused variables & queries.
      12. Documenter (In Progress): Provide Functional Documentation for Website Generator (using Notes)
      13. Education: "Sitepoint (Learnable) - Sitepoint Learnable Web Development Courses": Membership cancelled, but plan what to do with the eBooks in my possession.
      14. Education (In Progress): Read "PC Pro - Computing in the Real World".
      15. Education: Read "White (Ron) & Downs (Timothy Edward) - How Computers Work: The Evolution of Technology".
      16. Infrastructure: iCloud for Windows: Re-install & solve 'The upload folder for iCloud Photos is missing' problem. Try on new Laptop.
      17. Notes: Add "Note Alternates" to Note pages.
      18. Notes: Add option in Auto-Reference Notes to automatically ignore words containing certain strings that include the key-word (eg. ignore 'grace' and 'trace' when indexing 'race')
      19. Notes: Add option in Auto-Reference Notes to only confirm new items (leaving previously-flagged items untouched)
      20. Notes: Allow the option to concatenate Notes in the Printed version (ie. linearly embed them essay-style), rather than treating the hyperlinks as footnotes – but still keep the hyperlink & cross-referencing in place.
        1. For use as "disclaimers" - eg. for "Plug Notes".
        2. For Thesis / essays: the difficulty here is the need for linking passages to make the text run smoothly.
      21. Notes: As part of the Cross-Referencing project, check out the consistent treatment of Note 8753, which should be universally ignored. Recently, links to it appeared on Book-Summaries, Book_Paper_Abstracts and Note_Book_Links, as a Note referencing a Book. The critical item was a row on the Note_Book_Links table.
      22. Notes: Determine why very long printable notes (eg. Level 3+ for Note 1704) are being truncated. Probably suppress them in any case, as they take far too long to load.
      23. Notes: Fix bugs in multi-level footnoting in Printable Notes – the referencing is going wrong.
      24. Notes: Investigate Note_Links: Section references seem to be incorrect
      25. Notes: Printable Notes: fix the bug whereby the “private” flag is round the wrong way.
      26. Notes: Split Aeon Page5 into multiple sub-pages (either by topic or by priority)
      27. Notes: Suppress the publication of the Printable versions of Temp Notes
      28. Papers: The monthly regeneration process for Paper Abstracts still takes just over 5 hours. Problem is with Cross_Reference_Deletions and Cross_Reference_Additions. Cannot be fixed until the cross-referencing project is fully complete and documented.
      29. Photos: Develop software & procedure to make adding more content to the photos pages easier to undertake.
      30. Photos: Timeline software: Add photos for Holidays & Family History
      31. Process: Determine why Recalculation & Changed Book/Papers produce unneeded regeneration.
      32. Spider (On-Going): Analyse the results of the data collection exercise and design a plan of campaign to fix broken Internal links and prevent recurrence.
        1. Correct the code so the problems discovered by the Spider don’t recur.
        2. Delete 'orphan pages' that are never linked to, ie. Use the Spider to prune redundant pages6 automatically where possible.
        3. Fix the historical data where errors are uncovered by the Spider. An easier task now the site has a full-regen function.
      33. Spider: The size of the main database bloats to over 1.6Gb during the spider run, so is approaching the 2Gb limit.
        1. Use Check_Database_Size, with a parameter, to monitor the size – output a message along the those reporting the compact / repair of the Slave database).
        2. Put a checks in to STOP if over 1.8Gb.
        3. Determine a solution as the limit is pushed. Some tables are “local” for performance reasons and are later copied to the Slave … maybe move them?
      34. Spider (In Progress): The Spider was generating WebRefs. Procedurally, this ought not to have been possible.
        1. The major problem turned out to be because unprocessed7 URLs got added to the end of the last WebLinks_Tester_Brief page, which then got Spidered. I've stopped this happening, so hopefully the problem will not recur. The fix was made in 18Q2.
        2. However, 4 other creations appeared - dated 18/05/18 - from the run of 10/07/18. The creation date was from the previous spider run, but the IDs show that they were produced in the latest run.
        I've re-opened the case!
      35. Status (In Progress): Quarterly Project Reports: Correct Functor_08. The Project Planned YTD % keeps having to be bodged!
      36. Technology (In Progress): Look into Sistrix Smart8. Errors and warnings itemised are:-
        1. Duplicate content: seems to be variants on theotodman.com
        2. Title Tags: Empty, too long, identical
        3. Page Not Found
        4. Filesize in excess of 1Mb
        5. Meta-Description: Empty
        6. Few words on Page
        7. H1: Not used, used multiple times per page, identical across pages
        8. Pictures: Alt attribute missing
      37. WebRefs: Documentation & Bug-fixes: Phase 2
        1. Re-document the procedures in the light of recent changes.
        2. Resolve issues generated / revealed by the spider.
        3. Investigate - and fix where possible - broken links.
      38. WebRefs: Improve WebRefs checker (Webrefs_Update) further to check for Error 403 "Forbidden". This will often involve finding way of checking pdfs where the returned page is in fact HTML or XML (see DevLog Ref 379).
      39. WebRefs: Investigate defunct items. Populate Defunct_Explanation in WebRefs_Table and include in relevant WebLinks_Tester reports. Consider use of FairUse (Link (Fair Use)) for documents no longer available that I'd downloaded.
      40. WebRefs: Reformat WebLinks_Tester.htm, WebLinks_Tester_Map.htm, WebLinks_Tester_Full.htm & WebLinks_Tester_Full_Map.htm
        1. Clarify 'truncated': Display, not link
        2. Allow more space for 'link returned', 'issue' and 'display text'
        3. The 'As Above" lines waste space. Only for Notes Archive? Consolidate onto single second line.
      41. WebRefs: Reformat WebLinks_Tester_Brief: Allow more space for 'link returned', 'issue' and 'display text'
    • Priority: 2
      1. Abstracts (In Progress): Ensure some minimal data on Abstracts for Identity Papers Read
      2. Architecture: Improve flexibility of password-protected areas (ie. multiple areas, with different log-ons).
      3. Backups: Determine why flag on directories "not to be backed up" gets reset
      4. Backups: Investigate historic error messages
      5. Education: "Harvard University - CS50 Introduction to Computer Science": Re-start, or maybe just "audit".
      6. Education: "Harvard University - CS50W Web Programming with Python and JavaScript": Re-start, or maybe just "audit".
      7. Education: Bitcoin & Blockchain: Understand better
      8. Education: Bootstrap: Investigate.
      9. Notes: Add "Specific", "Contextual" & "General" Notes as an optional footer to all Notes. I think this is important – part of the difficulty in understanding some philosophers is knowing what their background assumptions are, as this influences what they take to be “obvious” or “a given”.
      10. Notes: Bug: "++ NP ++" links to previously linked note or to (non-)Note 0. Example9!
      11. Notes: Check (in use) that the optional "don't print" feature for specific footnotes doesn't print other footnotes further down the chain. Probably OK.
      12. Notes: Enable reproduction of archived “Printed Notes”.
      13. Notes: Improve Printable notes processing for "Temp" Notes (ie. produce a "_T" (& include all "_T"s), but leave standard prints free of "Temps".
      14. Notes: Investigate Notes Archiving - see if could re-create re-formatted if required from saved historical versions (but not fixed re directories)
      15. Notes: Reading Lists: Fix duplications:-
        1. Items "cited" and "categorised" (sometimes seem to) appear twice.
        2. Books and "single papers" of that Book both appear.
      16. Papers: When "+PnnnP+" reference used in an Object, allow "#Reference" style to be more specific where in the Paper Abstract the reference is.
      17. Technology: Increase use of CSS Style Sheets
      18. WebRefs (In Progress): Complete investigation and correction of broken “External” Links.
    • Priority: 3
      1. Aesthetics: Undertake a trawl through all (categories of) web-page, making aesthetic improvements, and correcting content.
      2. Architecture: Add scrolling titles to Lists
      3. Books/Papers: Introduce check that if a Book is flagged as "read" so are its Papers. Manual check completed in March 2018.
      4. Books/Papers: Review the effectiveness of the categorised reading lists for both Papers and Books.
      5. Bridge: Hand-Dealing:
        1. Some hands not showing in consolidated lists
        2. Bidding sometimes missing for SD (maybe connected)
      6. Documenter: Investigate & fix “Query Fragments” issue.
      7. Documenter: Separate Documenter from the main database & code, then add a parameter so it doesn’t necessarily document itself.
      8. Documenter: Undertake a trawl through the code for all functions within the generator – making improvements for efficiency and function. Supply rudimentary functional documentation as a spin-off therefrom.
      9. Facebook: Upgrade my Facebook page ("Facebook - Understand Facebook & Build Personal Facebook Page") using "Abram (Carolyn) - Facebook for Dummies: Fifth Edition" for inspiration / guidance.
      10. Notes: Fix problem with broken bespoke links to Printed Notes from Archived Notes.
      11. Notes: Improve flexibility of reading lists attached to printable version of Notes (different sort orders, priority items only, etc).
      12. Notes: Improve reading-lists from Notes (ie. firstly PID, then all starting with topic from Philosophy Papers Full)
      13. Status: Check how "YTD Planned %" is calculated - seems incorrect early in the Quarter if the plan varies during the year.
      14. Technology: Investigate the use of RTF in memo fields, so that I can get round the 64k character limit.
      15. Technology: Read the Google documentation (Google - How to get your website on Google Search) to investigate where I’m going wrong in the (failure to) use META tags to ensure my stuff sorts correctly in the search engines.
      16. Technology: Use generated Javascript to allow multi-level expandable / contractable lists in Notes and Paper Abstracts.
      17. Technology: Very long pages (eg. Concatenated Notes and Book Paper Abstracts) fail to render correctly in Firefox (mostly OK in other browsers). Investigate whether it’s possible to subdivide them.
      18. WebRefs (In Progress): Amend WebRef 'Name' link to #Off-Page_Link_WxxxW style. Also amend Quarterly and Annual task lists to use this reference.
    • Priority: 4
      1. Technology: Add page-hit counters
    • Priority: 5
      1. Documenter: Technical Documenter:-
        1. Investigate possibilities of retailing the documenter.
        2. Enhance to document Macros.
        3. Look at ways of documenting other (MS Access) databases & trial on Northwind.
    • Work-arounds
      1. Books (Work-around): Book Comments: if there are explicit internal links to files in Book Comments, they cannot work both in the BookSummary and BookPaperAbstracts, which are at different directory levels. So, don’t put them in the Comments – only in the Abstract.
      2. Books (Work-around): Books - Referencing of Notes: The "+NnnnN+" method works from the Book Summary, "++nnn++" from Book Abstract, but neither vice-versa.
      3. Books (Work-around): Books by Location: the jump table led to an invalid location. I bodged the data, by deleting an unused location, and didn’t properly investigate.
      4. Books (Work-around): Books to Notes: There’s an issue if a Note changes from Secure to non-Secure, but I bodged the data and didn’t try to fix it.
    • Cancelled Developments
      1. Architecture: Create expandable lists in Abstracts, Notes ("Plus table12" cells? For categorised lists)
      2. Authors: Completely re-engineer Authors processing to use IDs rather than Names:-
        1. CANCELLED: Originally needed because of difficulties transferring special characters in file names. But, this can be achieved by avoiding special characters in Author_Name, and putting them in Author_Name_Display.
        2. Had been:-
          → Authors' pages to be identified by Author_nnnnn, where nnnnn is the (numeric) Author_ID.
          → Directory-structure in thousands: Author_mm.
          → Use Author_ID in all Tables.
          → Needed because of difficulties transferring special characters in file names.
      3. Backups: Copying Errors:
        1. Investigate & fix directory error when backing up ZoomSearch database.
        2. This directory structure was set "not to back-up". Determine why this was ignored.
      4. Books: Create "Books by Subject" and "Books by Title" lists
      5. Books/Papers: Create list of "Identity" papers - and books - to obtain (ie. the "zzz"s)
      6. Books/Papers: Create Second-Level Jump (+ maybe split pages) for Philosophy / Identity Papers / Books Full - similar to Blackberry pages
      7. Books/Papers: Determine more efficient method of updating "Books to Papers", "Papers to Notes" and "Books to Notes" - use archiving
      8. Education: Read "Barnes (Russell), Ed. - Web Designer".
      9. General: Fix "American" date formats in Electronic Resources page
      10. Notes: Create "who's who" of respondents (will just be private notes)
      11. Notes: Create Functor to facilitate addition of Audio Files to Music Page (not sure why raised - see ID=348)
      12. Papers: Remove all large 'Comments' that have been utilised to expand Paper Abstracts (by moving them to Notes13). Cancelled and replaced by simply appending large (> 5k) Comments to Abstracts, so the work-around looks seamless.
      13. Photos: As revealed by Spider: Links failing in NotesPrint_1282_0_P_R.htm. 20 items.
      14. Technology: Create own local webserver
      15. Technology: Increase use of Frames14
      16. Technology: Investigate Wiki-technology (inc. Confluence, Plone CMS & Windows Help)
      17. WebRefs: Add collection of "non-identity" weblinks.
  2. Other Websites: Outstanding Items By Priority:-
    • Priority: 1
      1. Bridge (On-Going): Regular updates to the Hutton Bridge Club (Defunct) Website.
      2. Bridge (On-Going): Regular updates to the Mountnessing Bridge Club (Defunct) Website.
      3. Enigma (On-Going): Termly updates to the Enigma Ensemble Website.
    • Cancelled Developments
      1. Bridge: Create "Small Sites" database for Alaric (if chased)
      2. Bridge: Run Eve Goblets - if asked!


Outstanding Developments by Category
  1. Own Website: Outstanding Items By Category:-
    • Abstracts
      1. Priority 2 (In Progress): Ensure some minimal data on Abstracts for Identity Papers Read
    • Aesthetics
      1. Priority 3: Undertake a trawl through all (categories of) web-page, making aesthetic improvements, and correcting content.
    • Architecture
      1. Priority 1 (In Progress): Compact and Repair Problems
        1. On compacting and repairing my main database I sometimes get the error "The query cannot be completed. Either the size of the query result is larger than the maximum size of a database (2 GB), or there is not enough temporary storage space on the disk to store the query result".
        2. It happens 3 times while the database is re-opening.
        3. There is lots of space, and the database is only 600Mb (and the error started when it was under 500Mb).
        4. This mostly happens after I've run long processes, so I usually close the database, re-open it and then try the compact and repair. Usually this works, but not always. But I then try again and the message disappears.
        5. I strongly suspect that this is MS Access itself re-indexing tables, and blowing up a temporary database, but I can’t find any evidence for this on-line. Or help, other than suggestions to split databases and do other sensible things. Given that the error occurs when the database is re-opening, with no temporary file visible, is very strange.
        6. 17/04/20 - set MaxLocksPerFile to 1,000,000 (from the default 9,500). Sadly, it doesn't seem to have made a difference.
      2. Priority 1 (In Progress): Complete XRef-re-engineering project:-
        1. Ensure all links and link-pages use the new XRef table, and pension off the old tables.
        2. Look into writing out specific object-identifiers, and linking thereto for Citations, rather than paragraph references. An issue is multiple instances of the same object in a document.
        3. Check all link-types still work and fix any errors.
        4. Complete the auto-triggering of regeneration of “associated” link pages.
        5. Fix update bug in Convert_Webrefs.
        6. Fix Bug whereby PaperSummary pages seem to have “Works-” and “Books/Papers-” Citings that refer to the same link-pages.
        7. Document the process!
      3. Priority 1 (On-Going): Review effectiveness of hyperlinking method in the light of PhD and Philosophy of Religion experience.
      4. Priority 1: Where possible, use ID rather than NAME for in-page hyperlinks
      5. Priority 2: Improve flexibility of password-protected areas (ie. multiple areas, with different log-ons).
      6. Priority 3: Add scrolling titles to Lists
      7. Cancelled: Create expandable lists in Abstracts, Notes ("Plus table15" cells? For categorised lists)
    • Authors
      1. Cancelled: Completely re-engineer Authors processing to use IDs rather than Names:-
        1. CANCELLED: Originally needed because of difficulties transferring special characters in file names. But, this can be achieved by avoiding special characters in Author_Name, and putting them in Author_Name_Display.
        2. Had been:-
          → Authors' pages to be identified by Author_nnnnn, where nnnnn is the (numeric) Author_ID.
          → Directory-structure in thousands: Author_mm.
          → Use Author_ID in all Tables.
          → Needed because of difficulties transferring special characters in file names.
    • Backups
      1. Priority 1: Investigate Record-count discrepancies:-
        1. How do website files work as far as counts are concerned?
        2. Why aren't they recorded in Backup_History, nor the fact that the website was backed up?
        3. Different counts depending on whether new or old laptop is backed up. Investigate 63k discrepancy - lower on new laptop.
      2. Priority 1: Review architecture to improve performance; Need to document first
      3. Priority 2: Determine why flag on directories "not to be backed up" gets reset
      4. Priority 2: Investigate historic error messages
      5. Cancelled: Copying Errors:
        1. Investigate & fix directory error when backing up ZoomSearch database.
        2. This directory structure was set "not to back-up". Determine why this was ignored.
    • Books
      1. Priority 1: Further improve the time to regenerate Book Summaries. Now takes about 39 minutes, but should be under 5 minutes!
      2. Work-around: Book Comments: if there are explicit internal links to files in Book Comments, they cannot work both in the BookSummary and BookPaperAbstracts, which are at different directory levels. So, don’t put them in the Comments – only in the Abstract.
      3. Work-around: Books - Referencing of Notes: The "+NnnnN+" method works from the Book Summary, "++nnn++" from Book Abstract, but neither vice-versa.
      4. Work-around: Books by Location: the jump table led to an invalid location. I bodged the data, by deleting an unused location, and didn’t properly investigate.
      5. Work-around: Books to Notes: There’s an issue if a Note changes from Secure to non-Secure, but I bodged the data and didn’t try to fix it.
      6. Cancelled: Create "Books by Subject" and "Books by Title" lists
    • Books/Papers
      1. Priority 1: Investigate whether multiple Subject/Topic/Subtopic usage leads anywhere (ie. are just the first (of 3) actually used). Fix anything amiss.
      2. Priority 1: Reformat the PaperCitings pages:-
        1. Include only useful information on the detail pages; but if there are multiple links from the same object, include them on the same line as 'extra links' as in Authors' Citations (copy the code).
        2. Include counts on the summary page.
        3. Document!
        Do the same for BookCitings
      3. Priority 3: Introduce check that if a Book is flagged as "read" so are its Papers. Manual check completed in March 2018.
      4. Priority 3: Review the effectiveness of the categorised reading lists for both Papers and Books.
      5. Cancelled: Create list of "Identity" papers - and books - to obtain (ie. the "zzz"s)
      6. Cancelled: Create Second-Level Jump (+ maybe split pages) for Philosophy / Identity Papers / Books Full - similar to Blackberry pages
      7. Cancelled: Determine more efficient method of updating "Books to Papers", "Papers to Notes" and "Books to Notes" - use archiving
    • Bridge
      1. Priority 1 (In Progress): Develop auto-reconciliation routines vs EBU results download
      2. Priority 3: Hand-Dealing:
        1. Some hands not showing in consolidated lists
        2. Bidding sometimes missing for SD (maybe connected)
    • Documenter
      1. Priority 1 (On-Going): Investigate the error reports from the Documenter, especially unused variables & queries.
      2. Priority 1 (In Progress): Provide Functional Documentation for Website Generator (using Notes)
      3. Priority 3: Investigate & fix “Query Fragments” issue.
      4. Priority 3: Separate Documenter from the main database & code, then add a parameter so it doesn’t necessarily document itself.
      5. Priority 3: Undertake a trawl through the code for all functions within the generator – making improvements for efficiency and function. Supply rudimentary functional documentation as a spin-off therefrom.
      6. Priority 5: Technical Documenter:-
        1. Investigate possibilities of retailing the documenter.
        2. Enhance to document Macros.
        3. Look at ways of documenting other (MS Access) databases & trial on Northwind.
    • Education
      1. Priority 1: "Sitepoint (Learnable) - Sitepoint Learnable Web Development Courses": Membership cancelled, but plan what to do with the eBooks in my possession.
      2. Priority 1 (In Progress): Read "PC Pro - Computing in the Real World".
      3. Priority 1: Read "White (Ron) & Downs (Timothy Edward) - How Computers Work: The Evolution of Technology".
      4. Priority 2: "Harvard University - CS50 Introduction to Computer Science": Re-start, or maybe just "audit".
      5. Priority 2: "Harvard University - CS50W Web Programming with Python and JavaScript": Re-start, or maybe just "audit".
      6. Priority 2: Bitcoin & Blockchain: Understand better
      7. Priority 2: Bootstrap: Investigate.
      8. Cancelled: Read "Barnes (Russell), Ed. - Web Designer".
    • Facebook
      1. Priority 3: Upgrade my Facebook page ("Facebook - Understand Facebook & Build Personal Facebook Page") using "Abram (Carolyn) - Facebook for Dummies: Fifth Edition" for inspiration / guidance.
    • General
      1. Cancelled: Fix "American" date formats in Electronic Resources page
    • Infrastructure
      1. Priority 1: iCloud for Windows: Re-install & solve 'The upload folder for iCloud Photos is missing' problem. Try on new Laptop.
    • Notes
      1. Priority 1: Add "Note Alternates" to Note pages.
      2. Priority 1: Add option in Auto-Reference Notes to automatically ignore words containing certain strings that include the key-word (eg. ignore 'grace' and 'trace' when indexing 'race')
      3. Priority 1: Add option in Auto-Reference Notes to only confirm new items (leaving previously-flagged items untouched)
      4. Priority 1: Allow the option to concatenate Notes in the Printed version (ie. linearly embed them essay-style), rather than treating the hyperlinks as footnotes – but still keep the hyperlink & cross-referencing in place.
        1. For use as "disclaimers" - eg. for "Plug Notes".
        2. For Thesis / essays: the difficulty here is the need for linking passages to make the text run smoothly.
      5. Priority 1: As part of the Cross-Referencing project, check out the consistent treatment of Note 87510, which should be universally ignored. Recently, links to it appeared on Book-Summaries, Book_Paper_Abstracts and Note_Book_Links, as a Note referencing a Book. The critical item was a row on the Note_Book_Links table.
      6. Priority 1: Determine why very long printable notes (eg. Level 3+ for Note 17011) are being truncated. Probably suppress them in any case, as they take far too long to load.
      7. Priority 1: Fix bugs in multi-level footnoting in Printable Notes – the referencing is going wrong.
      8. Priority 1: Investigate Note_Links: Section references seem to be incorrect
      9. Priority 1: Printable Notes: fix the bug whereby the “private” flag is round the wrong way.
      10. Priority 1: Split Aeon Page16 into multiple sub-pages (either by topic or by priority)
      11. Priority 1: Suppress the publication of the Printable versions of Temp Notes
      12. Priority 2: Add "Specific", "Contextual" & "General" Notes as an optional footer to all Notes. I think this is important – part of the difficulty in understanding some philosophers is knowing what their background assumptions are, as this influences what they take to be “obvious” or “a given”.
      13. Priority 2: Bug: "++ NP ++" links to previously linked note or to (non-)Note 0. Example17!
      14. Priority 2: Check (in use) that the optional "don't print" feature for specific footnotes doesn't print other footnotes further down the chain. Probably OK.
      15. Priority 2: Enable reproduction of archived “Printed Notes”.
      16. Priority 2: Improve Printable notes processing for "Temp" Notes (ie. produce a "_T" (& include all "_T"s), but leave standard prints free of "Temps".
      17. Priority 2: Investigate Notes Archiving - see if could re-create re-formatted if required from saved historical versions (but not fixed re directories)
      18. Priority 2: Reading Lists: Fix duplications:-
        1. Items "cited" and "categorised" (sometimes seem to) appear twice.
        2. Books and "single papers" of that Book both appear.
      19. Priority 3: Fix problem with broken bespoke links to Printed Notes from Archived Notes.
      20. Priority 3: Improve flexibility of reading lists attached to printable version of Notes (different sort orders, priority items only, etc).
      21. Priority 3: Improve reading-lists from Notes (ie. firstly PID, then all starting with topic from Philosophy Papers Full)
      22. Cancelled: Create "who's who" of respondents (will just be private notes)
      23. Cancelled: Create Functor to facilitate addition of Audio Files to Music Page (not sure why raised - see ID=348)
    • Papers
      1. Priority 1: The monthly regeneration process for Paper Abstracts still takes just over 5 hours. Problem is with Cross_Reference_Deletions and Cross_Reference_Additions. Cannot be fixed until the cross-referencing project is fully complete and documented.
      2. Priority 2: When "+PnnnP+" reference used in an Object, allow "#Reference" style to be more specific where in the Paper Abstract the reference is.
      3. Cancelled: Remove all large 'Comments' that have been utilised to expand Paper Abstracts (by moving them to Notes22). Cancelled and replaced by simply appending large (> 5k) Comments to Abstracts, so the work-around looks seamless.
    • Photos
      1. Priority 1: Develop software & procedure to make adding more content to the photos pages easier to undertake.
      2. Priority 1: Timeline software: Add photos for Holidays & Family History
      3. Cancelled: As revealed by Spider: Links failing in NotesPrint_1282_0_P_R.htm. 20 items.
    • Process
      1. Priority 1: Determine why Recalculation & Changed Book/Papers produce unneeded regeneration.
    • Spider
      1. Priority 1 (On-Going): Analyse the results of the data collection exercise and design a plan of campaign to fix broken Internal links and prevent recurrence.
        1. Correct the code so the problems discovered by the Spider don’t recur.
        2. Delete 'orphan pages' that are never linked to, ie. Use the Spider to prune redundant pages23 automatically where possible.
        3. Fix the historical data where errors are uncovered by the Spider. An easier task now the site has a full-regen function.
      2. Priority 1: The size of the main database bloats to over 1.6Gb during the spider run, so is approaching the 2Gb limit.
        1. Use Check_Database_Size, with a parameter, to monitor the size – output a message along the those reporting the compact / repair of the Slave database).
        2. Put a checks in to STOP if over 1.8Gb.
        3. Determine a solution as the limit is pushed. Some tables are “local” for performance reasons and are later copied to the Slave … maybe move them?
      3. Priority 1 (In Progress): The Spider was generating WebRefs. Procedurally, this ought not to have been possible.
        1. The major problem turned out to be because unprocessed24 URLs got added to the end of the last WebLinks_Tester_Brief page, which then got Spidered. I've stopped this happening, so hopefully the problem will not recur. The fix was made in 18Q2.
        2. However, 4 other creations appeared - dated 18/05/18 - from the run of 10/07/18. The creation date was from the previous spider run, but the IDs show that they were produced in the latest run.
        I've re-opened the case!
    • Status
      1. Priority 1 (In Progress): Quarterly Project Reports: Correct Functor_08. The Project Planned YTD % keeps having to be bodged!
      2. Priority 3: Check how "YTD Planned %" is calculated - seems incorrect early in the Quarter if the plan varies during the year.
    • Technology
      1. Priority 1 (In Progress): Look into Sistrix Smart25. Errors and warnings itemised are:-
        1. Duplicate content: seems to be variants on theotodman.com
        2. Title Tags: Empty, too long, identical
        3. Page Not Found
        4. Filesize in excess of 1Mb
        5. Meta-Description: Empty
        6. Few words on Page
        7. H1: Not used, used multiple times per page, identical across pages
        8. Pictures: Alt attribute missing
      2. Priority 2: Increase use of CSS Style Sheets
      3. Priority 3: Investigate the use of RTF in memo fields, so that I can get round the 64k character limit.
      4. Priority 3: Read the Google documentation (Google - How to get your website on Google Search) to investigate where I’m going wrong in the (failure to) use META tags to ensure my stuff sorts correctly in the search engines.
      5. Priority 3: Use generated Javascript to allow multi-level expandable / contractable lists in Notes and Paper Abstracts.
      6. Priority 3: Very long pages (eg. Concatenated Notes and Book Paper Abstracts) fail to render correctly in Firefox (mostly OK in other browsers). Investigate whether it’s possible to subdivide them.
      7. Priority 4: Add page-hit counters
      8. Cancelled: Create own local webserver
      9. Cancelled: Increase use of Frames26
      10. Cancelled: Investigate Wiki-technology (inc. Confluence, Plone CMS & Windows Help)
    • WebRefs
      1. Priority 1: Documentation & Bug-fixes: Phase 2
        1. Re-document the procedures in the light of recent changes.
        2. Resolve issues generated / revealed by the spider.
        3. Investigate - and fix where possible - broken links.
      2. Priority 1: Improve WebRefs checker (Webrefs_Update) further to check for Error 403 "Forbidden". This will often involve finding way of checking pdfs where the returned page is in fact HTML or XML (see DevLog Ref 379).
      3. Priority 1: Investigate defunct items. Populate Defunct_Explanation in WebRefs_Table and include in relevant WebLinks_Tester reports. Consider use of FairUse (Link (Fair Use)) for documents no longer available that I'd downloaded.
      4. Priority 1: Reformat WebLinks_Tester.htm, WebLinks_Tester_Map.htm, WebLinks_Tester_Full.htm & WebLinks_Tester_Full_Map.htm
        1. Clarify 'truncated': Display, not link
        2. Allow more space for 'link returned', 'issue' and 'display text'
        3. The 'As Above" lines waste space. Only for Notes Archive? Consolidate onto single second line.
      5. Priority 1: Reformat WebLinks_Tester_Brief: Allow more space for 'link returned', 'issue' and 'display text'
      6. Priority 2 (In Progress): Complete investigation and correction of broken “External” Links.
      7. Priority 3 (In Progress): Amend WebRef 'Name' link to #Off-Page_Link_WxxxW style. Also amend Quarterly and Annual task lists to use this reference.
      8. Cancelled: Add collection of "non-identity" weblinks.
  2. Other Websites: Outstanding Items By Category:-
    • Bridge
      1. Cancelled: Create "Small Sites" database for Alaric (if chased)
      2. Priority 1 (On-Going): Regular updates to the Hutton Bridge Club (Defunct) Website.
      3. Priority 1 (On-Going): Regular updates to the Mountnessing Bridge Club (Defunct) Website.
      4. Cancelled: Run Eve Goblets - if asked!
    • Enigma
      1. Priority 1 (On-Going): Termly updates to the Enigma Ensemble Website.


In-Page Footnotes

Footnotes 6, 23: Footnotes 7, 24: Footnotes 8, 25: Footnotes 12, 15: Footnotes 13, 22: Footnotes 14, 26:

Live Version of this Archived Note

Date Length Title
14/04/2026 04:35:02 62292 Website - Outstanding Developments (2026 - April)

Table of 12 Earlier Versions of this Note (of 17)

Date Length Title
19/01/2020 23:41:17 34901 Website - Outstanding Developments (2019 - December)
10/10/2019 23:58:34 32512 Website - Outstanding Developments (2019 - September)
14/07/2019 20:29:46 31406 Website - Outstanding Developments (2019 - June)
05/04/2019 10:36:29 31280 Website - Outstanding Developments (2019 - March)
06/01/2019 23:36:58 31355 Website - Outstanding Developments (2018 - December)
10/10/2018 16:43:41 32099 Website - Outstanding Developments (2018 - September)
06/07/2018 18:56:10 26267 Website - Outstanding Developments (2018 - June)
05/04/2018 10:48:00 27406 Website - Outstanding Developments (2018 - March)
10/04/2017 23:38:24 14855 Website - Outstanding Developments (2017 - March)
14/10/2016 22:14:53 14554 Website - Outstanding Developments (2016 - September)
07/01/2016 00:59:02 13451 Website - Outstanding Developments (2015 - December)
07/10/2015 00:27:22 13159 Website - Outstanding Developments (2015 - September)

Table of 12 Later Versions of this Note (of 21)

Date Length Title
30/04/2023 01:06:14 43872 Website - Outstanding Developments (2023 - March)
10/01/2023 23:35:31 43511 Website - Outstanding Developments (2022 - December)
10/10/2022 22:32:10 42884 Website - Outstanding Developments (2022 - September)
03/07/2022 01:29:17 41656 Website - Outstanding Developments (2022 - June)
11/04/2022 00:01:26 42763 Website - Outstanding Developments (2022 - March)
03/01/2022 23:58:34 42576 Website - Outstanding Developments (2021 - December)
01/10/2021 13:17:46 42773 Website - Outstanding Developments (2021 - September)
02/07/2021 20:32:38 42771 Website - Outstanding Developments (2021 - June)
03/04/2021 19:58:05 40927 Website - Outstanding Developments (2021 - March)
04/01/2021 19:40:48 41389 Website - Outstanding Developments (2020 - December)
02/01/2021 14:29:46 41389 Website - Outstanding Developments (2020 - December)
04/10/2020 00:27:22 43568 Website - Outstanding Developments (2020 - September)


This version updated Reference for this Topic Parent Topic
03/07/2020 22:09:07 981 (Website - Outstanding Developments (2020 - June)) Status: Web-Tools (2026 - March)


Summary of Notes Links from this Page

Aeon Papers (13/05/20) (4) CT Introduction (2) Website - Progress to Date (2020 - June) Website Generator Documentation - Control Page  

To access information, click on one of the links in the table above (if any).



Summary of Note Links to this Page

Status: Web-Tools (2020 - June), 2 Website - Progress to Date (2020 - June), 2, 3, 4, 5, 6, 7 Website Generator Documentation - Control Page Website Generator Documentation - Functors Website: Maintenance Dashboard, 2
Website: Maintenance Dashboard (01 October 2020)        

To access information, click on one of the links in the table above (if any).



Text Colour Conventions

  1. Blue: Text by me; © Theo Todman, 2026



© Theo Todman, June 2007 - April 2026.Please address any comments on this page to theo@theotodman.com.File output:
Website Maintenance Dashboard
Return to Top of this PageReturn to Theo Todman's Philosophy PageReturn to Theo Todman's Home Page