Theo Todman's Web Page - Notes Pages
Status: Web-Tools (2015 - December)
(Text as at 07/01/2016 00:59:02)
(For other versions of this Note, see the tables at the end)
Rationale for this Project
- This Project was alluded to briefly in a footnote on research methodology in my original Research Proposal1 under the head Research - Internet Technology2. When last at Birkbeck, I wrote a more extensive paper3 defending the Project and describing its rationale. Now that my PhD is in suspense, I have decided to take this Project further. There’s a lot to do: still quite a few items on the “wish list”. It is fairly critical as an enabler for my research, so I need to get a move on as I want it all out of the way before I re-start4 formal research.
- For documentation on my website (currently password protected) follow the links below:-
- Functional5 Documentation6.
- Technical7 Documentation .
- I established the Hutton Bridge Club Website (Web Link) in 4Q11 using the standard Bridgewebs service, but with a couple of competitions using my own routines. I’ve retained supporting these despite handing the Website on.
- As of 1Q15, I have taken over the support and development of the Essex Contract Bridge Association (ECBA) website (Web Link), which also uses Bridgewebs, but is very much larger. I have written a lot of code to make this job less tedious.
- Over the last few years, I’ve been collecting data on bridge activity in the area (needed for a project to set up a new consolidated club) – by “scraping” data off web pages, consolidating it into a database and modelling it in various ways – and have booked this time to this project as it enhances (or at least maintains) my IT skills in this area. I’m now using this data to generate websites for small clubs (Web Link).
- I’ve created a new website for the First Class Bridge Academy (Web Link).
- About 10 years ago, I created a website for Dr. Sophie Botros (Web Link), one of my supervisors at Birkbeck. I’ve recently taken it back on and spruced it up a bit, though it requires more work.
- Finally, I’ve created a small website for a music group Julie and I attend – the Enigma Ensemble (Web Link).
- I did consider returning to work part-time as an MS Access/Excel developer, with a spin-off into website generation, but have done nothing about it so far.
Summary of Progress during October – December 2015
- This project retained its prominence, though not as excessively so as last Quarter, absorbing over 1/3 of my project time, though a slight majority of this was not for my own website.
- A repeat disappointment was that I didn’t pursue my web-training with Sitepoint, despite having – in anticipation – extended my membership for another couple of years.
- During 4Q15 I expended 244 hours on this project (244 hours YTD, where for “YTD” – Year to Date – I mean the academic year that commenced in October 2015). That’s 103% of planned effort, 103% YTD. Overall, 38% of my project effort in the Quarter was directed towards this Project (making 38% YTD) – as against 35% planned (35% YTD).
- While again somewhat more than half the time booked to this project was expended on the behalf of third parties, I did make quite a lot of progress on my own site. Most of the detail is available in the task lists below, but a few highlights were:-
- Time recording system (academic) year-end roll-over.
- Upgraded to Office 2013 with little difficulty.
- Enhanced my backup system to prune items backed up multiple times (eg. if they moved directory).
- Neatened up the linkage headers in Book & Paper Abstracts.
- Segregated the code-archive data, which was bloating the generator database.
- Segregated the Bridge website generators from those for my own website. They now live in separate databases and have their own documenters.
- Created a consolidated processor to enable overnight regeneration of the whole website.
- Converted the “static” pages in my website to Note format (so they can change and retain history).
- Allegedly created a new monthly report – summary by project9.
- Finally cracked the Spider for external links, and used it to check the 3,000-odd links from my website. Some tidying up outstanding.
- Tidy away of redundant pages.
- Further work on XRef-re-engineering, but auto-regen is still outstanding (but less urgent as the full site-regen is now easier).
- Commissioned a new laptop for Naomi, and learnt a lot about upgrading from Windows 8.1 to 10.
- Correspondence with Marc Chawner about his “Bridge Doctor” Excel application – useful spin-offs for Butler processing reconciliation, and (it turned out) the Spider.
- Commissioned Bernie’s new website and transferred the domain name.
- Lots of routine website maintenance for the ECBA, Bernie & the “small clubs”.
- Updated the Enigma Ensemble website calendar for the new term and tried – but failed – to get its priority in Google Search increased.
- Further details are given below:-
Website (Total Hours = 113)
- Website - Development (Total Hours = 84.5)
- Website - Generator - Add link to Home Page from Printable Notes (0.5 hours)
- Website - Generator - Backup Pruning System (10 hours)
- Website - Generator - Bug - Unchanged Notes re-archiving (Webrefs Issue) (2.25 hours)
- Website - Generator - Bug? Books-to-Papers former solitons (0.75 hours)
- Website - Generator - Consolidate links from BookPaper Abstract pages (1.5 hours)
- Website - Generator - Consolidate links from Paper Abstract pages (1.5 hours)
- Website - Generator - Convert "Static" pages to Notes (20.25 hours)
- Website - Generator - Documenter Segregation & Enhancement (3.25 hours)
- Website - Generator - Full Website Regen Processor (11.5 hours)
- Website - Generator - Hot Spot Processing (0.25 hours)
- Website - Generator - Inactive Note Groups Jump Tables Regen (0.75 hours)
- Website - Generator - Monthly Reporting - New Summary Report by Project (2.25 hours)
- Website - Generator - Spider External Links (15.25 hours)
- Website - Generator - Time-Recording: Year-End Roll-over (4.75 hours)
- Website - Generator - Update Private Note (1 hour)
- Website - Generator - Xref re-engineering (4.5 hours)
- Website - Tidy up of redundant pages (4.25 hours)
→ See "Software Development - Website - Development"
- Website - Education (Total Hours = 1.25)
- Website - Infrastructure (Total Hours = 16.5)
- Cleaning Laptop Keyboard (0.25 hours)
- Commision email@example.com (0.5 hours)
- Fix Julie's PC (1 hour)
- GIMP installation & familiarisation (0.5 hours)
- Julie's New Laptop (0.25 hours)
- Microsoft Windows 10 - Releases & Bugs (0.75 hours)
- Naomi's new laptop (9.75 hours)
- Outlook replacement - Spoof? (1 hour)
- PC Backups / OneDrive (0.75 hours)
- Upgrade to Office 2013 (1.5 hours)
- Windows 10 problems (0.25 hours)
→ See "Software Development - Website - Development"
- Website - Maintenance (Total Hours = 10.75)
Website Others (Total Hours = 130.5)
- Website Others - Bernie's Website Development
- Website Others - ECBA Development (Total Hours = 8.25)
- Website Others - ECBA Maintenance (Total Hours = 58.5)
- Admin - ECBA Website - Eve Goblets (2.5 hours)
- Bridge - Butler IMPs - Cross-check algorithms (3.5 hours)
- Bridge - Butler IMPs - Data Output (2 hours)
- Bridge - Butler IMPs - Reconciliation and use of Bridgewebs pairs (3.5 hours)
- Bridge - Butler IMPs - Teams of 8 investigation (5 hours)
- Bridge - ECBA Website - Interfacing Issues (2 hours)
- Bridge - ECBA Website - Routine Maintenance (40 hours)
→ See "Admin - ECBA Website - Admin & Maintenance"
- Website Others - ECBA Membership - Development
- Website Others - Enigma Ensemble
- Website Others - Hutton DBC Development (Total Hours = 2)
- Website Others - Joint Project Data Analysis (Total Hours = 11)
- Bridge - Joint Project - Data Modelling - "First time winnners" (3.5 hours)
- Bridge - Joint Project - Data Modelling - Bernie BridgeWebs Scoring (3 hours)
- Bridge - Joint Project - Data Modelling - BridgeWebs Scoring with two winners (0.5 hours)
- Bridge - Joint Project - Data Modelling - Easier links to home page (0.75 hours)
- Bridge - Joint Project - Data Modelling - LP averages: account for sessions not offering LPs (0.75 hours)
- Bridge - Joint Project - Data Modelling - Variant Parsing for Bernie's Butler Pairs (0.75 hours)
- Bridge - Joint Project - Data Modelling - Year-end processing Refinements (1.75 hours)
- Website Others - Joint Project Data Collection (Total Hours = 23.75)
- Bridge - Joint Project - Data Collection & "Mini Website" output (17.75 hours)
- Bridge - Joint Project - Discussions with Marc Chawner re "Bridge Doctor" (6 hours)
→ See "Admin - Bridge - Joint Project"
Plans for the Near Future
Now the large amount of effort on other people’s websites is declining somewhat, I’ve reduced the planned weekly effort on this project to 15 hours. Given that activity on this project for my own site is high at the moment, and to avoid too long a straggle of items on this report, I’ve created a document10 listing outstanding items, together with those completed since the document was created. As a result, only the more important11 items likely to be addressed shortly appear here.
- General Developments:
- Undertake a trawl through the code for all functions within the generator – making improvements for efficiency and function.
- Investigate the error reports from the Documenter, especially unused variables & queries.
- Supply rudimentary functional documentation as a spin-off from the above.
- Undertake a trawl through all (categories of) web-page, making aesthetic improvements, and correcting content.
- Look into Optimizr12.
- Specific Developments:
- Ensure FN referencing within Notes and referencing between Abstracts and Notes works for archived Notes.
- Read the Google documentation (Web Link) to investigate where I’m going wrong in the (failure to) use META tags to ensure my stuff sorts correctly in the search engines.
- Technical Documenter:-
- Separate from the main code, then add a parameter so it doesn’t necessarily document itself.
- Investigate & fix “Query Fragments” issue.
- Enhance to document Macros.
- Look at ways of documenting other (MS Access) databases & trial on Northwind.
- Investigate possibilities of retailing the documenter.
- Complete XRef-re-engineering project:-
- Ensure all links and link-pages use the new XRef table, and pension off the old tables.
- Check all link-types still work and fix any errors.
- Complete the auto-triggering of regeneration of “associated” link pages.
- Fix update bug in Convert_Webrefs.
- Bug: PaperSummary pages seem to have “Works-” and “Books/Papers-“ Citings that refer to the same link-pages.
- Add more content to the photos pages.
- Enable reproduction of archived “Printed Notes”.
- Fix problem with bespoke links to Printed Notes from Archived Notes (revealed by the Spider).
- Solve the problem of the size limitation for Notes (eg. by allowing their concatenation).
- Subsequently, remove all large “Comments” that have been utilised to expand Paper abstracts (by moving them to Notes).
- Utilise my Web Spider – in particular use the external links pages to (manually or automatically) correct broken links from within the body of the site.
- Allow direct Note-links in Footnotes (as well as the “Click here for note” style).
- Fix bugs in multi-level footnoting in Printable Notes – the referencing is going wrong.
- Bridge Websites:
- ECBA website (Web Link):-
- Routine maintenance (no small task).
- Joint Project / Small clubs Websites (Web Link, "Admin - Bridge - Joint Project"):
- Continue data collection & modelling.
- Continue to maintain & “market” websites for small clubs (Web Link).
- Bernie’s Website (Web Link):
- Set up competitions for 2016.
- Routine maintenance.
- Other initiatives:
- Plan an update of Sophie Botros’s Website ("Admin - Sophie Botros Website - Creation, Admin & Maintenance", Web Link).
- Maintain the Enigma Ensemble website (Web Link) as necessary.
- Upgrade my Facebook page ("Facebook - Understand Facebook & Build Personal Facebook Page") using "Abram (Carolyn) - Facebook for Dummies: Fifth Edition" for inspiration / guidance.
- Continue with "Sitepoint (Learnable) - Sitepoint Learnable Web Development Courses":-
- Complete, "Allsopp (John) - Learn HTML5", and
- Restart, and complete, "Weakley (Russ) - Getting Started with CSS".
- Read "PC Pro - Computing in the Real World".
Summary of Progress to Date
This is hived off to a separate13 document14. A summary of time expended across the years developing my website15 is at "Software Development - Website - Development".
In-Page FootnotesFootnote 4:
Footnote 5: This is very tedious to produce and consequently is both incomplete and out of date.
- Well, I’ve missed the boat, so will need to continue with both projects in parallel.
- This was always likely to be necessary, as new features will always arise in use. It’s a prototype methodology, after all.
Footnote 9: What was this – did it already exist?
- This is much more fun, as it’s a purely technical task.
- I’ve written a vastly-improved general-purpose technical documenter for MS Access.
Footnote 11: This list has, however, got too long!
- For Optimizr, see Web Link. A quick look doesn’t show it to be an obvious scam, but I need to double-check.
- An unsolicited analysis of my site turned up, listing a large number of “problems” that I think I know about, but which are in the queue to address.
- I suspect that this software will try to get me to buy something – maybe to fix the problems – but because I use a generator it’ll be no use.
- But I do need to address the problems validly itemised.
Footnote 15: As distinct from developing other peoples’ websites – time which is also recorded against this project, but not against this task.
- This document requires significant updating as it hasn’t been touched since December 2010.
- It may also be largely superseded by other documents – eg. the Outstanding Developments (Click here for Note) and Functional Documentation (Click here for Note).
- But it may provide a different “take” on what I’ve done. Maybe higher level.
Live Version of this Archived Note
Table of 12 Earlier Versions of this Note (of 59)
Table of the 5 Later Versions of this Note
|This version updated
||Reference for this Topic
||520 (Status: Web-Tools (2015 - December))
||Status: Summary (2017 - June)|
Summary of Notes Links from this Page
To access information, click on one of the links in the table above (if any).
Summary of Note Links to this Page
To access information, click on one of the links in the table above (if any).
Text Colour Conventions
- Blue: Text by me; © Theo Todman, 2017