Theo Todman's Web Page - Notes Pages


Status Reports

Status: Web-Tools (2018 - September)

(Text as at 10/10/2018 16:43:41)

(For earlier versions of this Note, see the table at the end)


Rationale for this Project


Summary of Progress during July - September 2018
  1. I spent 141 hours in 3Q18 on this Project, or related work (643 hours YTD, where for "YTD" - Year to Date - I mean the (academic) year that commenced in October 2017). That's 90% of the planned effort (93% YTD). Overall, 24% of my Project effort in the Quarter was directed towards this project (making 27% YTD) - as against 31% planned (27% YTD).
  2. Again, I made no progress at all on the course put out by Harvard - "Harvard University - CS50 Introduction to Computer Science". I still intend to make a serious attempt to complete it sometime (I will need to re-start). However, I decided to precede it with the follow-on course Harvard CS50's Web Programming with Python and JavaScript which is more immediately relevant. I made a start, but then other things took over towards the end of the month.
  3. I’d been on course to exceed budget, but decisions on other projects – in particular Music and Chess – got in the way towards the end of the quarter, so I only achieved 90% of plan in the end.
  4. However, I did manage to spend almost 140 hours developing my own site and did a lot of useful work.
  5. Completed items included:-
    • Architecture
      1. Added 'TT' shortcut icon on all Webpage browser tabs
    • Authors
      1. Authors Narrative: enable footnotes.
      2. As revealed by Spider: 'Extra' Links to Notes from Citations List have the wrong directory (clumped in 1,000's like Papers rather than 100's). 7 items. Problem with AddCitations_List, so not just an issue for Authors.
    • Books
      1. As revealed by Spider: BookCitings. 405 items. Fixed problem with CreateBookCitingsWebPages not checking for change of Book during 'Repeats' processing.
    • Books/Papers
      1. Paper & Book Abstracts - Make 'Disclaimer' more prominent & show 'Paper Statistics' rather than 'Paper Summaries'
    • Bridge
      1. Reformated + Fixed Hand-dealing pages to CSS standards
    • Documenter
      1. Created Functor using Form_Documentation_Links to automatically add control-links to documentation Notes.
      2. Fixed Bug where a variable has the same name as a procedure, and is thereby confused with one. Produced a warning query (Variable_Code_Name_Clashes) for manual correction.
    • Footnotes
      1. Enabled the re-use of Footnotes in the same Note12. They appeared multiple times, now just once. Fixed for:-
        1. Notes (OutputNotesWebPage)
        2. Printable Notes (NoteForPrinting), and
        3. Archived Notes (OutputNotesWebPage_Archived)
        All of which use Notes_Text_Format and the Note_Footnotes table. Also,
        1. Book & Paper Abstracts & Comments used to use an array in Reference_Footnotes, but changed to use a new table13 Abstract_Footnotes.
    • Notes
      1. Created auto-regen of all Note Link (Note_nnn_Link) Pages
      2. Automatic Key-word Hyperlinking to Notes Project: Phase 2
        1. Added links based on Book & Paper Titles
        2. Added ***Read***-marker to Lists
        3. Allowed links to be ignored (rather than suppressed) during approval process
        4. Skip links to Status Reports, etc.
      3. As revealed by Spider: Notes_List_Control links fail for Supervisions. 58 items.
      4. As revealed by Spider: Links to Notes_xxx_Links, from Abstracts (94 items), Notes (25 … corrected manually), NotesPrint (1916). Fixed by +LL+ functor implementation.
      5. As revealed by Spider: Bridge Status Report14 Achived Notes - sundry links failing. Live Note OK. 70 items.
      6. As revealed by Spider: Languages Status Report15 Achived Notes - links to Dissertation failing. Live Note OK. 43 items.
      7. As revealed by Spider: Religion Status Report16 Achived Notes - sundry links failing. Live Note OK. 59 items.
      8. Created new '+LL+' Functor for links to Note_Link pages; fixed associated Notes.
      9. Blog: Created Functor to generate Blog from Blog.
    • Photos
      1. Fix Bug: photos in Abstracts with embedded Notes - eg. "Grossman (Lev), Kurzweil (Ray) - 2045: The Year Man Becomes Immortal" - not displaying
      2. As revealed by Spider: Fixed ImageRef to work for both embedded ('SRC') & linked images on the same page - eg. Carthusians17. 12 items.
    • Status
      1. Status: Summary - Actual versus Plan18 between quarters says "previous quarter"; should be "current quarter"
  6. Full details for 18Q3 are given below:-
Website (Total Hours = 139)
  1. Website - Bridge Development
  2. Website - Development (Total Hours = 97)
    • Author Name Format options (Surname, First-Name) (0.5 hours)
    • Automatic Key-word Hyperlinking to Notes Project: Add links based on Book & Paper Titles (1.5 hours)
    • Automatic Key-word Hyperlinking to Notes Project: Add Read-marker to Lists (1 hour)
    • Automatic Key-word Hyperlinking to Notes Project: Allow links to be ignored (1 hour)
    • Automatic Key-word Hyperlinking to Notes Project: Automate full regeneration (6.25 hours)
    • Automatic Key-word Hyperlinking to Notes Project: Bug for Suppressed Links in Book-Paper Abstracts (1 hour)
    • Automatic Key-word Hyperlinking to Notes Project: Refinement of 'outstanding' counts (0.5 hours)
    • Automatic Key-word Hyperlinking to Notes Project: Refinement of title re Exclusions (1 hour)
    • Automatic Key-word Hyperlinking to Notes Project: Skip links to Status Reports, etc. (0.5 hours)
    • Technology: Added TT shortcut icon (1 hour)
    • Technology: Added 'TT' shortcut icon (0.25 hours)
    • Technology: Look into Sistrix Smart (2 hours)
    • Website - Generator - Allow Footnotes for Author Abstracts (1 hour)
    • Website - Generator - Allowed links to both embedded ('SRC') & linked Images on the same page (1.75 hours)
    • Website - Generator - BookCitings Links failing (2.75 hours)
    • Website - Generator - Bridge - Reformat + Fix Hand-dealing pages to CSS standards (4.75 hours)
    • Website - Generator - Create Functor for adding code links to Website Functional Documentation (2 hours)
    • Website - Generator - Create Functor to generate Blog (4 hours)
    • Website - Generator - Create new '+LL+' Functor for links to Note_Link pages (5 hours)
    • Website - Generator - Documenter Bug-fixes: Confusion of Variables with Procedure Names (0.75 hours)
    • Website - Generator - General: Tidy up Site - delete un-updated pages (3.5 hours)
    • Website - Generator - Improve efficiency of Quarterly + YTD Task List Generation (0.75 hours)
    • Website - Generator - Links from Notes_List_Control failing for Supervisions (0.5 hours)
    • Website - Generator - Links from old Status Reports failing (4.25 hours)
    • Website - Generator - Links to Images in embedded Notes in Abstracts failing (0.75 hours)
    • Website - Generator - Maintain consolidated Development Log (3.75 hours)
    • Website - Generator - Paper & Book Abstracts - Clarify Disclaimer & 'Summaries' (2 hours)
    • Website - Generator - Problem with AddCitations_List and directory for links to 'Extra' Notes (0.5 hours)
    • Website - Generator - Re-Document Front Screen (5 hours)
    • Website - Generator - Remove duplicate footnotes (7.5 hours)
    • Website - Generator - Status: Summary - Actual versus Plan; Say 'Current' Quarter if current quarter (0.75 hours)
    • Website - Generator - Stop Test Note generating Book & Paper Links (0.5 hours)
    • Website - Generator - Web Spider - Check out & correct missing links (8.25 hours)
    • Website - Generator - Web Spider - Documentation & Diagnostics (9 hours)
    • Website - Generator - Web Spider - Investigate Run-time (0.25 hours)
    • Website - Generator - WebRefs - Add Test Page Regen to Maintenance Dashboard (2.25 hours)
    • Website - Generator - WebRefs - Check out Quarterly Detail Report - Paper Links (0.75 hours)
    • Website - Generator - WebRefs - Investigation & Correction of Errored URLs (7.25 hours)
    • Website - Generator - WebRefs - Run periodic full check (0.25 hours)
    • Website - Generator - WebRefs - Spurious entries generated by Spider (0.75 hours)
      → See "Software Development - Website - Development"
  3. Website - Education (Total Hours = 16.25)
  4. Website - Infrastructure (Total Hours = 6.75)
    • Check out theo.todman@cantab.net email account (0.25 hours)
    • iCloud Photos directory problem after Windows 10 release - turned off iCloud (1.25 hours)
    • Investigating repairing unreadable DVDs (0.25 hours)
    • Julie's Laptop Support - Including Windows 10 Bugs & Upgrades (0.25 hours)
    • Microsoft Windows 10 / MS Office - Releases & Bugs (0.5 hours)
    • Microsoft Windows 10 / MS Office - Releases, Bugs & Periodic Re-boots (2.25 hours)
    • PC Backups / OneDrive (1 hour)
    • Printer Toner + Paper (0.25 hours)
    • Review Webalizer stats & methodology documentation (0.25 hours)
    • Website - Namesco Email problems (0.5 hours)
      → See "Software Development - Website - Development"
  5. Website - Maintenance (Total Hours = 16.75)
    • 18Q2 Status Reports (4.25 hours)
    • Website - Generator - General: Tidy up Site - delete un-updated pages (2.25 hours)
    • Website - Generator - WebRefs - Manual URL Checks (0.5 hours)
    • Website - Periodic Full Regeneration (6.5 hours)
    • Website - Run Web Spider (2.25 hours)
    • Website - ZoomSearch database refresh (1 hour)
      → See "Software Development - Website - Development"

Website Others (Total Hours = 1.75)
  1. Website Others - Bernie's Website Development
  2. Website Others - Enigma Ensemble
    • Enigma Ensemble Website - Creation, Admin & Maintenance (1 hour)


Plans for the Near Future

I’ve retained the planned weekly effort on this project at 12 hours. While there’s still a lot on the “priority list”, my intention for the coming academic year is to focus on updating my technical competence. The Plan below is taken automatically from the Priority 1 items on my Development Log, as published in my Outstanding Developments19 Report.
  1. Own Website: Priority 1 Items By Category:-
    • Architecture
      1. As revealed by Spider: Old links in unregenerated pages. 8 Items.
      2. Complete XRef-re-engineering project:-
        1. Ensure all links and link-pages use the new XRef table, and pension off the old tables.
        2. Check all link-types still work and fix any errors.
        3. Complete the auto-triggering of regeneration of “associated” link pages.
        4. Fix update bug in Convert_Webrefs.
        5. Fix Bug whereby PaperSummary pages seem to have “Works-” and “Books/Papers-” Citings that refer to the same link-pages.
      3. Review effectiveness of hyperlinking method in the light of PhD and Philosophy of Religion experience.
      4. Where possible, use ID rather than NAME for in-page hyperlinks
    • Authors
      1. As revealed by Spider: Philosophers_Index_List_OA.htm. Author Names Scrambled. 133 items.
      2. As revealed by Spider: Sundry broken Links where author name corrected. 93 items.
    • Backups
      1. Review architecture to improve performance; Need to document first
    • Books/Papers
      1. Investigate whether multiple Subject/Topic/Subtopic usage leads anywhere (ie. are just the first (of 3) actually used). Fix anything amiss.
    • Documenter
      1. Provide Functional Documentation for Website Generator (using Notes)
    • Education
      1. Continue with Harvard CS50's Web Programming with Python and JavaScript: either complete it, or check it'll still run in 2019.
      2. Investigate Bootstrap.
      3. Plan what to do with "Sitepoint (Learnable) - Sitepoint Learnable Web Development Courses" and the eBooks in my possession.
      4. Read "PC Pro - Computing in the Real World".
      5. Read "Barnes (Russell), Ed. - Web Designer".
      6. Re-start "Harvard University - CS50 Introduction to Computer Science". Maybe just "audit".
      7. Understand Bitcoin & Blockchain better
    • Infrastructure
      1. Re-install iCloud: solve 'The upload folder for iCloud Photos is missing' problem
    • Notes
      1. Add "Note Alternates" to Note pages.
      2. Allow the option to concatenate Notes in the Printed version (ie. linearly embed them essay-style), rather than treating the hyperlinks as footnotes – but still keep the hyperlink & cross-referencing in place.
        1. For use as "disclaimers" - eg. for "Plug Notes".
        2. For Thesis / essays: the difficulty here is the need for linking passages to make the text run smoothly.
      3. As revealed by Spider: #Reference links: fail for Printable Notes. 24 items.
      4. As revealed by Spider: Consciousness Status Report20 Achived Notes - sundry links failing. Live Note OK. 46 items. 24 items outstanding.
      5. As revealed by Spider: Blog21 Achived Notes - sundry links to Printable Notes. Live Note OK. 110 items. 100 items outstanding.
      6. As revealed by Spider: Links to sundry 'static' pages failing. 26 items. 20 items outstanding.
      7. As revealed by Spider: Old links from Archive Notes to (non-existent) Archived Printable Notes. 42 items.
      8. As revealed by Spider: Status Reports - Achived Notes - sundry links failing. Live Notes fixed.
        1. Website: Maintenance Dashboard22. 14 items.
        2. Personal Identity Status Report23. 11 items.
        3. Summary Status Report24. 4 items.
        4. Actual Detail Summary Report25. 6 items.
        5. Chess Status Report26. 12 items.
        6. Etc.
      9. As revealed by Spider: Sundry links fail for Supervisions. 31 items.
      10. Created auto-regen of all Note Link (Note_nnn_Link) Pages
      11. Investigate Note_Links: Section references seem to be incorrect
      12. Printable Notes: fix the bug whereby the “private” flag is round the wrong way.
      13. Suppress the publication of the Printable versions of Temp Notes
    • Photos
      1. Add photos of Tom - Create Timeline software
      2. Develop software & procedure to make adding more content to the photos pages easier to undertake.
    • Process
      1. As revealed by Spider: Sundry uncategorised. Refs failing. 24 items.
      2. Determine why Recalculation & Changed Book/Papers produce unneeded regeneration.
    • Spider
      1. Analyse the results of the data collection exercise and design a plan of campaign to fix broken Internal links and prevent recurrence.
        1. Correct the code so the problems discovered by the Spider don’t recur.
        2. Delete 'orphan pages' that are never linked to, ie. Use the Spider to prune redundant pages27 automatically where possible.
        3. Fix the historical data where errors are uncovered by the Spider. An easier task now the site has a full-regen function.
      2. Determine why Full_Link_Up_Levels_Gen takes so long - approximately 3 hours. May need to re-architect.
      3. The Spider was generating WebRefs. Procedurally, this ought not to have been possible.
        1. The major problem turned out to be because unprocessed28 URLs got added to the end of the last WebLinks_Tester_Brief page, which then got Spidered. I've stopped this happening, so hopefully the problem will not recur. The fix was made in 18Q2.
        2. However, 4 other creations appeared - dated 18/05/18 - from the run of 10/07/18. The creation date was from the previous spider run, but the IDs show that they were produced in the latest run.
        I've re-opened the case!
    • Technology
      1. Look into Sistrix Smart29. Errors and warnings itemised are:-
        1. Duplicate content: seems to be theotodman.com and Link (Defunct)
        2. Title Tags: Empty, too long, identical
        3. Page Not Found
        4. Filesize in excess of 1Mb
        5. Meta-Description: Empty
        6. Few words on Page
        7. H1: Not used, used multiple times per page, identical across pages
        8. Pictures: Alt attribute missing
    • WebRefs
      1. As revealed by Spider: WebLinks_Tester_Full_Map.htm (etc). Refs failing. 116 items.
      2. As revealed by Spider: WebLinks_Tester_Map_3.htm (etc). Refs failing. 21 items.
      3. Documentation & Bug-fixes: Phase 2
        1. Re-document the procedures in the light of recent changes.
        2. Resolve issues generated / revealed by the spider.
        3. Investigate - and fix where possible - broken links.
  2. Other Websites: Priority 1 Items By Category:-

Summary of Progress to Date

This is hived off to various separate documents, which have now been harmonising and / or consolidated:-
  1. Summary of Progress to Date30.
  2. Outstanding Developments31,
  3. Functional Documentation32,
  4. A summary of time expended across the years developing my website33 is at "Software Development - Website - Development".



In-Page Footnotes:

Footnote 4: Footnote 5: Footnote 7: Footnote 9: Footnote 10: Footnote 11: Footnote 12: Footnote 13: Footnote 27: Footnote 28: Footnote 29: Footnote 33:


Printable Version:



Table of the Previous 12 Versions of this Note: (of 70)

Date Length Title
06/07/2018 18:56:10 16773 Status: Web-Tools (2018 - June)
05/04/2018 10:48:00 16588 Status: Web-Tools (2018 - March)
05/01/2018 00:11:31 13295 Status: Web-Tools (2017 - December)
09/10/2017 23:25:26 11848 Status: Web-Tools (2017 - September)
20/07/2017 14:34:05 11297 Status: Web-Tools (2017 - June)
10/04/2017 23:38:24 11470 Status: Web-Tools (2017 - March)
14/01/2017 20:18:14 13578 Status: Web-Tools (2016 - December)
14/10/2016 22:14:53 14567 Status: Web-Tools (2016 - September)
21/07/2016 16:12:00 13206 Status: Web-Tools (2016 - June)
05/04/2016 23:19:41 15377 Status: Web-Tools (2016 - March)
07/01/2016 00:59:02 15186 Status: Web-Tools (2015 - December)
07/10/2015 00:27:22 15018 Status: Web-Tools (2015 - September)



Note last updated Reference for this Topic Parent Topic
10/10/2018 16:43:41 520 (Status: Web-Tools (2018 - September)) Status: Summary (2018 - September)

Summary of Note Links from this Page

Carthusians - Main Text Internet Technology and Philosophy Research - Internet Technology Research - Proposal Status: Actual Detail Summary (2007 - 2019)
Status: Bridge (2018 - September) Status: Chess (2018 - September) Status: Consciousness Studies (2018 - September) Status: Languages (2018 - September) Status: Personal Identity (2018 - September)
Status: Philosophy of Religion (2018 - September) Status: Summary - Actual versus Plan (2018 - December) Status: Summary (2018 - September) Theo Todman's Blog Theo Todman's Websites Maintained
Website - Outstanding Developments Website - Progress to Date Website Generator Documentation - Control Page Website: Maintenance Dashboard  

To access information, click on one of the links in the table above.




Summary of Note Links to this Page

Internet Technology and Philosophy King's Maths Questions Simon - T1S1T1 Status: Consciousness Studies (2018 - September) Status: Priority Task List (2018: October)
Status: Summary (2018 - September), 2 Status: Summary Task List (2018: October - December) Status: Summary Task List (YTD: 18Q4 - 18Q4) Theo Todman's Philosophy Page Theo Todman's Website Maintainance History
Website - Progress to Date, 2, 3, 4, 5        

To access information, click on one of the links in the table above.




Authors, Books & Papers Citing this Note

Author Title Medium Extra Links Read?
Software Development Website - Development Paper Low Quality Abstract    



Text Colour Conventions

  1. Black: Printable Text by me; © Theo Todman, 2018
  2. Blue: Text by me; © Theo Todman, 2018




© Theo Todman, June 2007 - Dec 2018.Please address any comments on this page to theo@theotodman.com.File output:
Website Maintenance Dashboard
Return to Top of this PageReturn to Theo Todman's Philosophy PageReturn to Theo Todman's Home Page