Theo Todman's Web Page - Notes Pages

Status Reports

Website - Outstanding Developments (2023 - September)

(Work In Progress: output at 27/09/2023 10:09:34)

Previous VersionsNote ReferencesNote Citations

Rationale for this Document


  1. Own Website: Outstanding Items By Priority:-
    • Priority: 1
      1. Architecture
        • Complete XRef-re-engineering project:-
          1. Ensure all links and link-pages use the new XRef table, and pension off the old tables where appropriate.
          2. Check all link-types still work and fix any errors.
          3. Complete the auto-triggering of regeneration of “associated” link pages.
          4. Fix Bug whereby PaperSummary pages seem to have “Works-” and “Books/Papers-” Citings that refer to the same link-pages.
          5. Complete Documenting3 the process!
          → In Progress
        • Document4, repair & update my Website site-map
          → In Progress
        • Enable use of Snippets for long Notes and Abstracts
        • Review effectiveness of hyperlinking method in the light of PhD and Philosophy of Religion experience.
          → On-Going
        • Where possible, use ID rather than NAME for in-page hyperlinks
      2. Authors
        • Import Author Narratives from Aeon (and other sources) into the Authors table
      3. Backups
        • Determine why flag on directories "not to be backed up" gets reset
        • Document and enable regular running of the de-duplication function ('pruning') of the backup disk. Keep a full record of deleted duplicates.
          → In Progress
        • Investigate historic error messages
        • Investigate Record-count discrepancies:-
          1. How do website files work as far as counts are concerned?
          2. Why aren't they recorded in Backup_History, nor the fact that the website was backed up?
          3. Different counts depending on whether new or old laptop is backed up. Investigate 63k discrepancy - lower on new laptop.
        • Review architecture to improve performance; Need to document5 first
      4. Books/Papers
        • For Books and Papers - add link pages - analogous to:-
          → BooksToNotes_
          → BookCitings_
          → PapersToNotes_
          → PaperCitings_
          linked to from:-
          → BookSummaries_
          → PaperSummary_
          and (maybe) from:-
          → BookPaperAbstracts_
          → Abstract_
          But, the links are FROM the Book / Paper, rather than TO
          For Books, ensure that all the links from all the Book's Papers are also included
        • Investigate whether multiple Subject/Topic/Subtopic usage leads anywhere (ie. are just the first (of 3) actually used). Fix anything amiss.
        • Reformat the BookCitings and PaperCitings pages:-
          1. Detail PaperCitings Pages: Include only useful information on the detail pages; but if there are multiple links from the same object, include them on the same line as 'extra links' as in BookCitings (copy the code: or, better, combine the two subs).
          2. Summary (Author Letter) pages: Include counts (as in Authors' Citations).
          3. Ensure uses the Cross_Reference table.
          4. Document6!
      5. Bridge
        • Correct NGS Recalculation: Incorporate 3-year limit
      6. Chess
        • Convert Chess Consolidated Results page to ELO Grading
      7. Documenter
        • Investigate the error reports from the Documenter, especially unused variables & queries.
          → On-Going
        • Provide Functional Documentation for Website Generator (using Notes)
          → In Progress
      8. Education
      9. Infrastructure
        • iCloud for Windows: Re-install & solve 'The upload folder for iCloud Photos is missing' problem. Try on new Laptop.
        • Investigate Visual Studio Code
        • Migrate from Chrome to Bitwarden for password management
        • Move from My Photo Stream to iCloud by 26th July 2023
      10. Notes
        • Add "Note Alternates" to Note pages.
        • Allow the option to concatenate Notes in the Printed version (ie. linearly embed them essay-style), rather than treating the hyperlinks as footnotes – but still keep the hyperlink & cross-referencing in place.
          1. For use as "disclaimers" - eg. for "Plug Notes".
          2. For Thesis / essays: the difficulty here is the need for linking passages to make the text run smoothly.
        • As part of the Cross-Referencing project, check out the consistent treatment of Note 8757, which should be universally ignored. Recently, links to it appeared on web pages Book_Summary, BookPaperAbstracts and BooksToNotes, as a Note referencing a Book. The critical item was a row on the Note_Book_Links table.
        • Bug: "++ NP ++" links to previously linked note or Note 0 and causes type mismatch in Reference_Notes for embedded Notes in Papers. Example8!
        • Determine why all my Status Reports from September 2021 are missing from Notes_Archive. Seek to recover them from backups.
        • Develop a method to create Papers for rows in Aeon_Files that have an associated Identity_Note_ID but no Paper_ID.
        • Develop method for (manually) deleting otiose Archived Notes: ie. ensure links work for remaining Notes!
        • Document and correct processing for Note References & Reading List9.
        • Enhance PID Note, Book & Paper Usage10 to include a section listing works cited in my Thesis but not read
        • Enhance comparative Ling database - Replace numerals by words in Vocabulary and Dialogues
          → In Progress
        • Investigate Note_Links: Section references seem to be incorrect
        • PID Thesis References - De-duplicate / suppress and / or change sort order / aggregation for non-anthology book chapters
        • Printable Notes: fix the bug whereby the “private” flag is round the wrong way.
      11. Papers
        • Split PDFs Available on Local Website11 page into alphabetical sub-pages
        • The monthly regeneration process for Paper Abstracts is still taking too long. Monitor! Last run: 1.28 hours on 22/09/2023.
      12. Photos
        • Timeline software12: Add photos for Bakers' Coxes Farm Development Phase III
        • Timeline software13: Add photos for Henry's Biography
        • Timeline software14: Add photos for Holidays & Family History
        • Develop software & procedure to make adding more content to the photos pages easier to undertake.
      13. Process
        • Determine why Recalculation & Changed Book/Papers produce unneeded regeneration.
        • Provide 'Quick' option for Recalculation (cmdRecalculate_Click) - exclude unnecessary items on request
      14. Spider
        • Analyse the results of the data collection exercise and design a plan of campaign to fix broken Internal links and prevent recurrence.
          1. Correct the code so the problems discovered by the Spider don’t recur.
          2. Delete 'orphan pages' that are never linked to, ie. Use the Spider to prune redundant pages16 automatically where possible.
          3. Fix the historical data where errors are uncovered by the Spider. An easier task now the site has a full-regen function.
          → On-Going
        • As revealed by Spider: Consolidated Site-Hits Test Webpage. Mountnessing\index.htm Link. Should be .shtml.
        • Failed 'Printable Note' links not picked up by Spider: Especially in Blog
        • Investigate reduction in size of Web_Generator_Performance database that holds Raw_Links.
          1. Suppress MsgBox for 'Near to 2Gb' database size check (just use Debug).
          2. One-off deletion of rather useless links: EMail, TheosStyle.css, TT_ICO.png, #Top, ...
          3. Remove code that generates these links, and check them.
          4. Investigate removal of website 'root' (C:\Theo's Files\Websites\Theo's Website\) from Raw_Link and Full_Link. This would save 200Mb, but needs careful checking - especially against the Directory_Structure and related tables and code.
          5. If the above 'root' change is to go ahead - one-off updates + code changes required.
        • Use Edge rather than Internet Explorer for External Links Spider
      15. Technology
        • Change URL for Page names to something meaningful: For Notes, Papers and Books. Needs to be short!
        • Convert site to HTTPS
        • Look into Sistrix Smart17. Errors and warnings itemised are:-
          1. Duplicate content: seems to be variants on theotodman.com
          2. Title Tags: Empty, too long, identical
          3. Page Not Found
          4. Filesize in excess of 1Mb
          5. Meta-Description: Empty
          6. Few words on Page
          7. H1: Not used, used multiple times per page, identical across pages
          8. Pictures: Alt attribute missing
          → In Progress
      16. WebRefs
        • Documentation & Bug-fixes: Phase 2
          1. Re-document the procedures in the light of recent changes.
          2. Resolve issues generated / revealed by the spider.
          3. Investigate - and fix where possible - broken links.
        • Find a way of recording Missing / Unknown Webrefs (eg. Webrefs 8395 and 8342 in Archived Notes 1292 and 1317) other than debug.print: create table, then suppress message for known problems
        • Investigate items flagged as defunct. Populate Defunct_Explanation in WebRefs_Table. Consider use of FairUse (Link (Fair Use)) for documents no longer available that I'd downloaded.
          → On-Going
        • Investigate WebRefs with Issue = 'URL Translated OK': does the translation really work? How?
    • Priority: 2
      1. Abstracts
        • Ensure some minimal data on Abstracts for Identity Papers Read
          → In Progress
      2. Architecture
        • Improve flexibility of password-protected areas (ie. multiple areas, with different log-ons).
      3. Books
        • Further improve the time to regenerate Book Summaries. Took about 12 minutes on 22/09/2023, but should be under 5 minutes!
      4. Bridge
        • Develop auto-reconciliation routines vs EBU results download
          → In Progress
      5. Education
      6. Notes
        • Add "Specific", "Contextual" & "General" Notes as an optional footer to all Notes. I think this is important – part of the difficulty in understanding some philosophers is knowing what their background assumptions are, as this influences what they take to be “obvious” or “a given”.
        • As revealed by Spider: NotesPrint from Secure_Jen fails for Notes_Jump links. Need to fix the processing of "../"-style links to go back to root and back. Example: Note 51315.
        • Check (in use) that the optional "don't print" feature for specific footnotes doesn't print other footnotes further down the chain. Probably OK.
        • Determine why very long printable notes (eg. Level 3+ for Note 17018) are being truncated. Probably suppress them in any case, as they take far too long to load.
        • Enable reproduction of archived “Printed Notes”.
        • Fix bugs in multi-level footnoting in Printable Notes – the referencing is going wrong.
        • Improve Printable notes processing for "Temp" Notes (ie. produce a "_T" (& include all "_T"s), but leave standard prints free of "Temps".
        • Investigate Notes Archiving - see if could re-create re-formatted if required from saved historical versions (but not fixed re directories)
        • Reading Lists: Fix duplications:-
          1. Items "cited" and "categorised" (sometimes seem to) appear twice.
          2. Books and "single papers" of that Book both appear.
        • Suppress the publication of the Printable versions of Temp Notes
        • Upgrade Auto_Reference_Notes to reference Sub-Notes: Currently only affects one note - Somerset Maugham - so not yet urgent
        • Very large printable Notes: eg. for Status: Summary19. Too large to be useful, and to transfer. Suppress for now.
      7. Papers
        • When "+PnnnP+" reference used in an Object, allow "#Reference" style to be more specific where in the Paper Abstract the reference is.
      8. Technology
        • Increase use of CSS Style Sheets
    • Priority: 3
      1. Aesthetics
        • Undertake a trawl through all (categories of) web-page, making aesthetic improvements, and correcting content.
      2. Architecture
        • Add scrolling titles to Lists
      3. Books/Papers
        • Introduce check that if a Book is flagged as "read" so are its Papers. Manual check completed in March 2018.
        • Review the effectiveness of the categorised reading lists for both Papers and Books.
      4. Bridge
        • Hand-Dealing:
          1. Some hands not showing in consolidated lists
          2. Bidding sometimes missing for SD (maybe connected)
      5. Documenter
        • Investigate & fix “Query Fragments” issue.
        • Separate Documenter from the main database & code, then add a parameter so it doesn’t necessarily document itself.
        • Undertake a trawl through the code for all functions within the generator – making improvements for efficiency and function. Supply rudimentary functional documentation as a spin-off therefrom.
      6. Facebook
      7. Notes
        • Fix problem with broken bespoke links to Printed Notes from Archived Notes.
        • Improve flexibility of reading lists attached to printable version of Notes (different sort orders, priority items only, etc).
        • Improve reading-lists from Notes (ie. firstly PID, then all starting with topic from Philosophy Papers Full)
      8. Status
        • Check how "YTD Planned %" is calculated - seems incorrect early in the Quarter if the plan varies during the year.
      9. Technology
        • Investigate the use of RTF in memo fields, so that I can get round the 64k character limit.
        • Read the Google documentation (Google - How to get your website on Google Search) to investigate where I’m going wrong in the (failure to) use META tags to ensure my stuff sorts correctly in the search engines.
        • Use generated Javascript to allow multi-level expandable / contractable lists in Notes and Paper Abstracts.
        • Very long pages (eg. Concatenated Notes and Book Paper Abstracts) fail to render correctly in Firefox (mostly OK in other browsers). Investigate whether it’s possible to subdivide them.
    • Priority: 4
      1. Technology
        • Add page-hit counters
    • Priority: 5
      1. Documenter
        • Technical Documenter:-
          1. Investigate possibilities of retailing the documenter.
          2. Enhance to document Macros.
          3. Look at ways of documenting other (MS Access) databases & trial on Northwind.
    • Work-arounds
      1. Books
        • Book Comments: if there are explicit internal links to files in Book Comments, they cannot work both in the BookSummary and BookPaperAbstracts, which are at different directory levels. So, don’t put them in the Comments – only in the Abstract.
        • Books - Referencing of Notes: The "+NnnnN+" method works from the Book Summary, "++nnn++" from Book Abstract, but neither vice-versa.
        • Books by Location: the jump table led to an invalid location. I bodged the data, by deleting an unused location, and didn’t properly investigate.
        • Books to Notes: There’s an issue if a Note changes from Secure to non-Secure, but I bodged the data and didn’t try to fix it.
    • Cancelled Developments
      1. Architecture
        • Create expandable lists in Abstracts, Notes ("Plus table22" cells? For categorised lists)
      2. Authors
        • Completely re-engineer Authors processing to use IDs rather than Names:-
          1. CANCELLED: Originally needed because of difficulties transferring special characters in file names. But, this can be achieved by avoiding special characters in Author_Name, and putting them in Author_Name_Display.
          2. Had been:-
            → Authors' pages to be identified by Author_nnnnn, where nnnnn is the (numeric) Author_ID.
            → Directory-structure in thousands: Author_mm.
            → Use Author_ID in all Tables.
            → Needed because of difficulties transferring special characters in file names.
      3. Backups
        • Copying Errors:
          1. Investigate & fix directory error when backing up ZoomSearch database.
          2. This directory structure was set "not to back-up". Determine why this was ignored.
      4. Books
        • Create "Books by Subject" and "Books by Title" lists
      5. Books/Papers
      6. Education
      7. General
        • Fix "American" date formats in Electronic Resources page
      8. Notes
        • Create "who's who" of respondents (will just be private notes)
        • Create Functor to facilitate addition of Audio Files to Music Page (not sure why raised - see ID=348)
      9. Papers
        • Remove all large 'Comments' that have been utilised to expand Paper Abstracts (by moving them to Notes23). Cancelled and replaced by simply appending large (> 5k) Comments to Abstracts, so the work-around looks seamless.
      10. Photos
        • As revealed by Spider: Links failing in NotesPrint_1282_0_P_R.htm. 20 items.
      11. Technology
        • Create own local webserver
        • Increase use of Frames24
        • Investigate Wiki-technology (inc. Confluence, Plone CMS & Windows Help)
      12. WebRefs
        • Add collection of "non-identity" weblinks.
        • Complete investigation and correction of broken “External” Links.
        • The Spider was generating WebRefs. Procedurally, this ought not to have been possible.
          1. The major problem turned out to be because unprocessed25 URLs got added to the end of the last WebLinks_Tester_Brief page, which then got Spidered. I've stopped this happening, so hopefully the problem will not recur. The fix was made in 18Q2.
          2. However, 4 other creations appeared - dated 18/05/18 - from the run of 10/07/18. The creation date was from the previous spider run, but the IDs show that they were produced in the latest run.
          3. I've re-opened the case! But now Spider_Ctrl outputs the message 'Check Webrefs_To_Be_Added_By_Spider_Detail and run Webrefs_Add if necessary'.
          4. The August 2020 run produced a list of 163 items. I think these are all down to fixes undertaken following a full WebRefs check run. I need to check and find out why the lists appear.
          5. Maybe they come from the 'WebRef Missing' page on WebLinks_Tester, which arises as a result of running Map_WebRefs, which regenerates the WebRef_Maps table, via Map_WebRefs_Mapper, after I've fixed the links on Webrefs_Table. There are 146 such items as of end August 2020, but they had all disappeared by a re-run of early September 2020.
          6. I assume it's some sort of timeing issue, so I'm cancelling the change.
  2. Other Websites: Outstanding Items By Priority:-


Outstanding Developments by Category
  1. Own Website: Outstanding Items By Category:-
    1. Abstracts
      • Priority: 2
        • Ensure some minimal data on Abstracts for Identity Papers Read
          → In Progress
    2. Aesthetics
      • Priority: 3
        • Undertake a trawl through all (categories of) web-page, making aesthetic improvements, and correcting content.
    3. Architecture
      • Priority: 1
        • Complete XRef-re-engineering project:-
          1. Ensure all links and link-pages use the new XRef table, and pension off the old tables where appropriate.
          2. Check all link-types still work and fix any errors.
          3. Complete the auto-triggering of regeneration of “associated” link pages.
          4. Fix Bug whereby PaperSummary pages seem to have “Works-” and “Books/Papers-” Citings that refer to the same link-pages.
          5. Complete Documenting20 the process!
          → In Progress
        • Document21, repair & update my Website site-map
          → In Progress
        • Enable use of Snippets for long Notes and Abstracts
        • Review effectiveness of hyperlinking method in the light of PhD and Philosophy of Religion experience.
          → On-Going
        • Where possible, use ID rather than NAME for in-page hyperlinks
      • Priority: 2
        • Improve flexibility of password-protected areas (ie. multiple areas, with different log-ons).
      • Priority: 3
        • Add scrolling titles to Lists
      • Cancelled Developments
        • Create expandable lists in Abstracts, Notes ("Plus table28" cells? For categorised lists)
    4. Authors
      • Priority: 1
        • Import Author Narratives from Aeon (and other sources) into the Authors table
      • Cancelled Developments
        • Completely re-engineer Authors processing to use IDs rather than Names:-
          1. CANCELLED: Originally needed because of difficulties transferring special characters in file names. But, this can be achieved by avoiding special characters in Author_Name, and putting them in Author_Name_Display.
          2. Had been:-
            → Authors' pages to be identified by Author_nnnnn, where nnnnn is the (numeric) Author_ID.
            → Directory-structure in thousands: Author_mm.
            → Use Author_ID in all Tables.
            → Needed because of difficulties transferring special characters in file names.
    5. Backups
      • Priority: 1
        • Determine why flag on directories "not to be backed up" gets reset
        • Document and enable regular running of the de-duplication function ('pruning') of the backup disk. Keep a full record of deleted duplicates.
          → In Progress
        • Investigate historic error messages
        • Investigate Record-count discrepancies:-
          1. How do website files work as far as counts are concerned?
          2. Why aren't they recorded in Backup_History, nor the fact that the website was backed up?
          3. Different counts depending on whether new or old laptop is backed up. Investigate 63k discrepancy - lower on new laptop.
        • Review architecture to improve performance; Need to document26 first
      • Cancelled Developments
        • Copying Errors:
          1. Investigate & fix directory error when backing up ZoomSearch database.
          2. This directory structure was set "not to back-up". Determine why this was ignored.
    6. Books
      • Priority: 2
        • Further improve the time to regenerate Book Summaries. Took about 12 minutes on 22/09/2023, but should be under 5 minutes!
      • Work-arounds
        • Book Comments: if there are explicit internal links to files in Book Comments, they cannot work both in the BookSummary and BookPaperAbstracts, which are at different directory levels. So, don’t put them in the Comments – only in the Abstract.
        • Books - Referencing of Notes: The "+NnnnN+" method works from the Book Summary, "++nnn++" from Book Abstract, but neither vice-versa.
        • Books by Location: the jump table led to an invalid location. I bodged the data, by deleting an unused location, and didn’t properly investigate.
        • Books to Notes: There’s an issue if a Note changes from Secure to non-Secure, but I bodged the data and didn’t try to fix it.
      • Cancelled Developments
        • Create "Books by Subject" and "Books by Title" lists
    7. Books/Papers
      • Priority: 1
        • For Books and Papers - add link pages - analogous to:-
          → BooksToNotes_
          → BookCitings_
          → PapersToNotes_
          → PaperCitings_
          linked to from:-
          → BookSummaries_
          → PaperSummary_
          and (maybe) from:-
          → BookPaperAbstracts_
          → Abstract_
          But, the links are FROM the Book / Paper, rather than TO
          For Books, ensure that all the links from all the Book's Papers are also included
        • Investigate whether multiple Subject/Topic/Subtopic usage leads anywhere (ie. are just the first (of 3) actually used). Fix anything amiss.
        • Reformat the BookCitings and PaperCitings pages:-
          1. Detail PaperCitings Pages: Include only useful information on the detail pages; but if there are multiple links from the same object, include them on the same line as 'extra links' as in BookCitings (copy the code: or, better, combine the two subs).
          2. Summary (Author Letter) pages: Include counts (as in Authors' Citations).
          3. Ensure uses the Cross_Reference table.
          4. Document27!
      • Priority: 3
        • Introduce check that if a Book is flagged as "read" so are its Papers. Manual check completed in March 2018.
        • Review the effectiveness of the categorised reading lists for both Papers and Books.
      • Cancelled Developments
    8. Bridge
      • Priority: 1
        • Correct NGS Recalculation: Incorporate 3-year limit
      • Priority: 2
        • Develop auto-reconciliation routines vs EBU results download
          → In Progress
      • Priority: 3
        • Hand-Dealing:
          1. Some hands not showing in consolidated lists
          2. Bidding sometimes missing for SD (maybe connected)
    9. Chess
      • Priority: 1
        • Convert Chess Consolidated Results page to ELO Grading
    10. Documenter
      • Priority: 1
        • Investigate the error reports from the Documenter, especially unused variables & queries.
          → On-Going
        • Provide Functional Documentation for Website Generator (using Notes)
          → In Progress
      • Priority: 3
        • Investigate & fix “Query Fragments” issue.
        • Separate Documenter from the main database & code, then add a parameter so it doesn’t necessarily document itself.
        • Undertake a trawl through the code for all functions within the generator – making improvements for efficiency and function. Supply rudimentary functional documentation as a spin-off therefrom.
      • Priority: 5
        • Technical Documenter:-
          1. Investigate possibilities of retailing the documenter.
          2. Enhance to document Macros.
          3. Look at ways of documenting other (MS Access) databases & trial on Northwind.
    11. Education
    12. Facebook
    13. General
      • Cancelled Developments
        • Fix "American" date formats in Electronic Resources page
    14. Infrastructure
      • Priority: 1
        • iCloud for Windows: Re-install & solve 'The upload folder for iCloud Photos is missing' problem. Try on new Laptop.
        • Investigate Visual Studio Code
        • Migrate from Chrome to Bitwarden for password management
        • Move from My Photo Stream to iCloud by 26th July 2023
    15. Notes
      • Priority: 1
        • Add "Note Alternates" to Note pages.
        • Allow the option to concatenate Notes in the Printed version (ie. linearly embed them essay-style), rather than treating the hyperlinks as footnotes – but still keep the hyperlink & cross-referencing in place.
          1. For use as "disclaimers" - eg. for "Plug Notes".
          2. For Thesis / essays: the difficulty here is the need for linking passages to make the text run smoothly.
        • As part of the Cross-Referencing project, check out the consistent treatment of Note 87529, which should be universally ignored. Recently, links to it appeared on web pages Book_Summary, BookPaperAbstracts and BooksToNotes, as a Note referencing a Book. The critical item was a row on the Note_Book_Links table.
        • Bug: "++ NP ++" links to previously linked note or Note 0 and causes type mismatch in Reference_Notes for embedded Notes in Papers. Example30!
        • Determine why all my Status Reports from September 2021 are missing from Notes_Archive. Seek to recover them from backups.
        • Develop a method to create Papers for rows in Aeon_Files that have an associated Identity_Note_ID but no Paper_ID.
        • Develop method for (manually) deleting otiose Archived Notes: ie. ensure links work for remaining Notes!
        • Document and correct processing for Note References & Reading List31.
        • Enhance PID Note, Book & Paper Usage32 to include a section listing works cited in my Thesis but not read
        • Enhance comparative Ling database - Replace numerals by words in Vocabulary and Dialogues
          → In Progress
        • Investigate Note_Links: Section references seem to be incorrect
        • PID Thesis References - De-duplicate / suppress and / or change sort order / aggregation for non-anthology book chapters
        • Printable Notes: fix the bug whereby the “private” flag is round the wrong way.
      • Priority: 2
        • Add "Specific", "Contextual" & "General" Notes as an optional footer to all Notes. I think this is important – part of the difficulty in understanding some philosophers is knowing what their background assumptions are, as this influences what they take to be “obvious” or “a given”.
        • As revealed by Spider: NotesPrint from Secure_Jen fails for Notes_Jump links. Need to fix the processing of "../"-style links to go back to root and back. Example: Note 51333.
        • Check (in use) that the optional "don't print" feature for specific footnotes doesn't print other footnotes further down the chain. Probably OK.
        • Determine why very long printable notes (eg. Level 3+ for Note 17034) are being truncated. Probably suppress them in any case, as they take far too long to load.
        • Enable reproduction of archived “Printed Notes”.
        • Fix bugs in multi-level footnoting in Printable Notes – the referencing is going wrong.
        • Improve Printable notes processing for "Temp" Notes (ie. produce a "_T" (& include all "_T"s), but leave standard prints free of "Temps".
        • Investigate Notes Archiving - see if could re-create re-formatted if required from saved historical versions (but not fixed re directories)
        • Reading Lists: Fix duplications:-
          1. Items "cited" and "categorised" (sometimes seem to) appear twice.
          2. Books and "single papers" of that Book both appear.
        • Suppress the publication of the Printable versions of Temp Notes
        • Upgrade Auto_Reference_Notes to reference Sub-Notes: Currently only affects one note - Somerset Maugham - so not yet urgent
        • Very large printable Notes: eg. for Status: Summary35. Too large to be useful, and to transfer. Suppress for now.
      • Priority: 3
        • Fix problem with broken bespoke links to Printed Notes from Archived Notes.
        • Improve flexibility of reading lists attached to printable version of Notes (different sort orders, priority items only, etc).
        • Improve reading-lists from Notes (ie. firstly PID, then all starting with topic from Philosophy Papers Full)
      • Cancelled Developments
        • Create "who's who" of respondents (will just be private notes)
        • Create Functor to facilitate addition of Audio Files to Music Page (not sure why raised - see ID=348)
    16. Papers
      • Priority: 1
        • Split PDFs Available on Local Website36 page into alphabetical sub-pages
        • The monthly regeneration process for Paper Abstracts is still taking too long. Monitor! Last run: 1.28 hours on 22/09/2023.
      • Priority: 2
        • When "+PnnnP+" reference used in an Object, allow "#Reference" style to be more specific where in the Paper Abstract the reference is.
      • Cancelled Developments
        • Remove all large 'Comments' that have been utilised to expand Paper Abstracts (by moving them to Notes41). Cancelled and replaced by simply appending large (> 5k) Comments to Abstracts, so the work-around looks seamless.
    17. Photos
      • Priority: 1
        • Timeline software37: Add photos for Bakers' Coxes Farm Development Phase III
        • Timeline software38: Add photos for Henry's Biography
        • Timeline software39: Add photos for Holidays & Family History
        • Develop software & procedure to make adding more content to the photos pages easier to undertake.
      • Cancelled Developments
        • As revealed by Spider: Links failing in NotesPrint_1282_0_P_R.htm. 20 items.
    18. Process
      • Priority: 1
        • Determine why Recalculation & Changed Book/Papers produce unneeded regeneration.
        • Provide 'Quick' option for Recalculation (cmdRecalculate_Click) - exclude unnecessary items on request
    19. Spider
      • Priority: 1
        • Analyse the results of the data collection exercise and design a plan of campaign to fix broken Internal links and prevent recurrence.
          1. Correct the code so the problems discovered by the Spider don’t recur.
          2. Delete 'orphan pages' that are never linked to, ie. Use the Spider to prune redundant pages45 automatically where possible.
          3. Fix the historical data where errors are uncovered by the Spider. An easier task now the site has a full-regen function.
          → On-Going
        • As revealed by Spider: Consolidated Site-Hits Test Webpage. Mountnessing\index.htm Link. Should be .shtml.
        • Failed 'Printable Note' links not picked up by Spider: Especially in Blog
        • Investigate reduction in size of Web_Generator_Performance database that holds Raw_Links.
          1. Suppress MsgBox for 'Near to 2Gb' database size check (just use Debug).
          2. One-off deletion of rather useless links: EMail, TheosStyle.css, TT_ICO.png, #Top, ...
          3. Remove code that generates these links, and check them.
          4. Investigate removal of website 'root' (C:\Theo's Files\Websites\Theo's Website\) from Raw_Link and Full_Link. This would save 200Mb, but needs careful checking - especially against the Directory_Structure and related tables and code.
          5. If the above 'root' change is to go ahead - one-off updates + code changes required.
        • Use Edge rather than Internet Explorer for External Links Spider
    20. Status
      • Priority: 3
        • Check how "YTD Planned %" is calculated - seems incorrect early in the Quarter if the plan varies during the year.
    21. Technology
      • Priority: 1
        • Change URL for Page names to something meaningful: For Notes, Papers and Books. Needs to be short!
        • Convert site to HTTPS
        • Look into Sistrix Smart46. Errors and warnings itemised are:-
          1. Duplicate content: seems to be variants on theotodman.com
          2. Title Tags: Empty, too long, identical
          3. Page Not Found
          4. Filesize in excess of 1Mb
          5. Meta-Description: Empty
          6. Few words on Page
          7. H1: Not used, used multiple times per page, identical across pages
          8. Pictures: Alt attribute missing
          → In Progress
      • Priority: 2
        • Increase use of CSS Style Sheets
      • Priority: 3
        • Investigate the use of RTF in memo fields, so that I can get round the 64k character limit.
        • Read the Google documentation (Google - How to get your website on Google Search) to investigate where I’m going wrong in the (failure to) use META tags to ensure my stuff sorts correctly in the search engines.
        • Use generated Javascript to allow multi-level expandable / contractable lists in Notes and Paper Abstracts.
        • Very long pages (eg. Concatenated Notes and Book Paper Abstracts) fail to render correctly in Firefox (mostly OK in other browsers). Investigate whether it’s possible to subdivide them.
      • Priority: 4
        • Add page-hit counters
      • Cancelled Developments
        • Create own local webserver
        • Increase use of Frames47
        • Investigate Wiki-technology (inc. Confluence, Plone CMS & Windows Help)
    22. WebRefs
      • Priority: 1
        • Documentation & Bug-fixes: Phase 2
          1. Re-document the procedures in the light of recent changes.
          2. Resolve issues generated / revealed by the spider.
          3. Investigate - and fix where possible - broken links.
        • Find a way of recording Missing / Unknown Webrefs (eg. Webrefs 8395 and 8342 in Archived Notes 1292 and 1317) other than debug.print: create table, then suppress message for known problems
        • Investigate items flagged as defunct. Populate Defunct_Explanation in WebRefs_Table. Consider use of FairUse (Link (Fair Use)) for documents no longer available that I'd downloaded.
          → On-Going
        • Investigate WebRefs with Issue = 'URL Translated OK': does the translation really work? How?
      • Cancelled Developments
        • Add collection of "non-identity" weblinks.
        • Complete investigation and correction of broken “External” Links.
        • The Spider was generating WebRefs. Procedurally, this ought not to have been possible.
          1. The major problem turned out to be because unprocessed48 URLs got added to the end of the last WebLinks_Tester_Brief page, which then got Spidered. I've stopped this happening, so hopefully the problem will not recur. The fix was made in 18Q2.
          2. However, 4 other creations appeared - dated 18/05/18 - from the run of 10/07/18. The creation date was from the previous spider run, but the IDs show that they were produced in the latest run.
          3. I've re-opened the case! But now Spider_Ctrl outputs the message 'Check Webrefs_To_Be_Added_By_Spider_Detail and run Webrefs_Add if necessary'.
          4. The August 2020 run produced a list of 163 items. I think these are all down to fixes undertaken following a full WebRefs check run. I need to check and find out why the lists appear.
          5. Maybe they come from the 'WebRef Missing' page on WebLinks_Tester, which arises as a result of running Map_WebRefs, which regenerates the WebRef_Maps table, via Map_WebRefs_Mapper, after I've fixed the links on Webrefs_Table. There are 146 such items as of end August 2020, but they had all disappeared by a re-run of early September 2020.
          6. I assume it's some sort of timeing issue, so I'm cancelling the change.
  2. Other Websites: Outstanding Items By Category:-
    1. Bridge
      • Cancelled Developments
        • Create "Small Sites" database for Alaric (if chased)
      • Priority: 1
        • Read and thoroughly understand the documentation on:-
          → EBUScore
          → Bridgemate II
          → On-Going
        • Regular updates to the Mountnessing Bridge Club Website.
          → On-Going
      • Cancelled Developments
      • Priority: 1
      • Cancelled Developments
        • Run Eve Goblets - if asked!
    2. Enigma


In-Page Footnotes:

Footnotes 16, 45: Footnotes 17, 46: Footnotes 22, 28: Footnotes 23, 41: Footnotes 24, 47: Footnotes 25, 48:

Table of the Previous 12 Versions of this Note: (of 31)

Date Length Title
06/07/2023 00:43:12 44030 Website - Outstanding Developments (2023 - June)
30/04/2023 01:06:14 43872 Website - Outstanding Developments (2023 - March)
10/01/2023 23:35:31 43511 Website - Outstanding Developments (2022 - December)
10/10/2022 22:32:10 42884 Website - Outstanding Developments (2022 - September)
03/07/2022 01:29:17 41656 Website - Outstanding Developments (2022 - June)
11/04/2022 00:01:26 42763 Website - Outstanding Developments (2022 - March)
03/01/2022 23:58:34 42576 Website - Outstanding Developments (2021 - December)
01/10/2021 13:17:46 42773 Website - Outstanding Developments (2021 - September)
02/07/2021 20:32:38 42771 Website - Outstanding Developments (2021 - June)
03/04/2021 19:58:05 40927 Website - Outstanding Developments (2021 - March)
04/01/2021 19:40:48 41389 Website - Outstanding Developments (2020 - December)
02/01/2021 14:29:46 41389 Website - Outstanding Developments (2020 - December)


Note last updated Reference for this Topic Parent Topic
27/09/2023 10:09:36 981 (Website - Outstanding Developments (2023 - September)) Status: Web-Tools (2023 - June)

Summary of Notes Referenced by This Note

CT Introduction Jen_070928 (Introductory) PDFs Available on Local Website PID Note, Book & Paper Usage Status: Summary (2023 - June)
Test Note - Auto-XRef Website - Progress to Date (2023 - September) Website Generator Documentation - Citations Website Generator Documentation - Control Page Website Generator Documentation - Cross-Referencing
Website Generator Documentation - Note References & Reading List Website Generator Documentation - Site Map Website Generator Documentation - Spider & System Backups Website Generator Documentation - Timelines (Photos & Blog)  

To access information, click on one of the links in the table above.



Summary of Notes Citing This Note

Status: Web-Tools (2023 - June), 2 Theo Todman's Website Maintainance History Website - Progress to Date (2023 - September), 2, 3, 4, 5, 6, 7, 8, 9 Website Generator Documentation - Control Page Website Generator Documentation - Functors, 2, 3, 4, 5, 6
Website: Maintenance Dashboard        

To access information, click on one of the links in the table above.



Text Colour Conventions

  1. Blue: Text by me; © Theo Todman, 2023



© Theo Todman, June 2007 - Sept 2023.Please address any comments on this page to theo@theotodman.com.File output:
Website Maintenance Dashboard
Return to Top of this PageReturn to Theo Todman's Philosophy PageReturn to Theo Todman's Home Page