Brexit Stolen Votes

berklix.com logo

berklix.org logo

No Cookies logo

flag_uk_de_icon_v.gif

BSD-PIE icon

BSD icon

Gnu icon

Linux icon

Eyes

Disclaimer

IBU

Consol

CTMs for FreeBSD

This is http://ctm.berklix.org
( & http://www.berklix.org/ctm/
& http://www.berklix.com/~jhs/ctm/ )

Pointed to by FreeBSD man ctm

by Julian Stacey

Index

Corrections Pending Integration @ 2019-09-14:
  • Although CTM's etymology from first authour was "Cvs Tree Mirror" that now misleads, per my http://www.berklix.org/ctm/#what "Code Through Mail" might best summarise it at 2018-12
  • CTM is now a means of delivering tree updates (Similar result to to rdist6 & rsync & mirror, though those rely on different functionality: end to end live pull using ports some firewalls etc may block, whereas CTM just pushes with SMTP, unlikely blocked)
  • Most trees we deliver with CTM are src-* releases, + 1 ports, + 1 SVN, but surely CTM could just as readily deliver a GIT tree as an SVN, as its already done for CVS too ?
  • Admittedly if freebsd moves to GIT, we'd need to tweak the server scripts to do GIT export instead of svn export.
  • My http://www.berklix.org/ctm/#why "Why Use CTM for Delivery Instead of SVN ?" may also misleading, accidentaly reinforcing the wrong impression that CTM is just an alterantive to SVN. Its not. I'll fix it.

Stop Press / Latest

  • Discussion Mail Lists Carry Latest Info
  • NEW ADDITIONAL SERVICE: At 2019-08-16 04:00+0200
  • 2019 August Outage, Status At 2019-08-16 04:00+0200 : On freebsd.org: all fixed now as far as we know except ctm-src-cur still delayed by moderation, & many others not checked if moderated.
    • OK: ctm-src-11-fast, ctm-src-12, ctm-src-12-fast, ctm-src-cur-fast, ctm-svn-cur-fast, ctm-ports-cur.
    • Unchecked, likely OK: ctm-src-4, ctm-src-4-fast, ctm-src-5, ctm-src-5-fast, ctm-src-6, ctm-src-6-fast, ctm-src-7, ctm-src-7-fast, ctm-src-8, ctm-src-8-fast, ctm-src-9, ctm-src-9-fast, ctm-src-10, ctm-src-10-fast, ctm-src-11, ctm-src-11-fast, ctm-src-cur, ctm-svn-cur.
    • The delta generator host died.
    • Generation moved to ctm.berklix.org (which already had ftp archives).
    • Last backup of generator build scripts was old,
    • Generator build scripts were re-updated,
    • Generator trees built &
    • Deltas generation started.
    • Briefly deltas were received on lists ,
    • When ctm-src-12 generation started, it sent with From: owner-ctm-src-12[-fast]@berklix.org , which was confusingly similar to mailman standard alias ctm-src-12[-fast]-owner@ , so for ctm-src-12 it was changed to From: freebsd-ctm-gen@berklix
    • Then although ctm.berklix.org was mailing deltas (other than ctm-src-12) to lists on freebsd.org, after a bit, nothing further appeared on lists
    • Guessed that mail header From: address did not match what @freebsd.org lists allowed.
    • Guessed something had happened the freebsd.org end;
    • The CTMownermail values in the Mail List Config Files that generate the From: for the other lists, had not changed, so those non ctm-src-12 lists should have continued working;
    • Learnt how to specify the From: field,
    • The question was: what address had been previously used ? Various guesses failed experimenting with old addresses including elements cauchy, library, etc. .
    • Gave up guessing, subscribed a new From address freebsd-ctm-gen@berklix to all ctm lists.
    • Guessed it would be by default moderated.
    • Asked postmaster@freebsd to un-moderate that address on all ctm lists. Some or most were unmoderated but at least one was not, as this was seen for
      ctm-src-cur:
      • Created on ctm.berklix.org UTC: Aug 12 14:08 src-cur.14144.gz
      • Outgoing tap to jhs-test@:
        • Date: Mon, 12 Aug 2019 14:08:02 GMT
        • From: freebsd-ctm-gen@berklix
        • To: ctm-ctm-src-cur@berklix
        • Subject: ctm-mail src-cur.14144.gz 1/1
      • Moderated:
        • Subject: Your message to ctm-ctm-src-cur awaits moderator approval
        • From: ctm-ctm-src-cur-owner@freebsd
        • Date: Mon, 12 Aug 2019 14:08:24 +0000
        • To: freebsd-ctm-gen@berklix
        • Your mail to 'ctm-ctm-src-cur' with the subject ctm-mail src-cur.14144.gz 1/1
        • Is being held until the list moderator can review it for approval.
      • Received from list on jhs@ host UTC: Aug 12 14:10 src-cur.14144.gz
    • ctm-svn-cur: the tap on ctm.berklix.org mail outgoing showed it ignoring the directive set CTMownermail freebsd-ctm-gen@berklix in ctm.berklix.org/~sms/library/ctm/ctm_generation/ctm_conf.svn-cur copy here: http://www.berklix.com/~jhs/src/bsd/fixes/freebsd/ports/gen/misc/ctm/files/ctm.berklix.org/ctm_conf.svn-cur so freebsd.org rejects those
      Another script was fixed .
    • Unchecked: A test was run on all lists, to ensure all have been unmoderated (as some of the old lists rarely carry traffic, so cannot be observed, but might someday receive a delta we want passed).
      Content was produced by this
      #!/bin/csh
      foreach i ( `cat tests_lists.txt` )
      echo "To: $i" > tests.now
      cat tests_body.txt >> tests.now
      sendmail -i -t < tests.now
      echo Done $i
      sleep 3
      end
      
      
      None of those test have arrived back from any lists, so we don't know if all lists have been un-moderated.
    • 2019-09-23 Removed tap to jhs-test@ from ctm-src-cur & ctm-src-cur-fast

To Do:

Why Use CTM for Delivery Instead of SVN ?

  • ( CTM can also deliver you an SVN tree, so you can still use SVN locally.)
  • If you have a slow net connection aka limited bandwidth, or intermittent connectivity eg rarely reliably in one place long enough to complete an SVN update of whole trees. Or expensive data rates eg mobile tariffs.
  • If your corporate/ institutional firewall blocks you, but allows mail.
  • The patches are compressed, saving time & data transfer charges.
  • Imagine you'r travelling/ on holiday, you don't fancy paying heavy data charges tethering via your mobile phone, so stroll into a coffee shop with WLAN, or visit somewhere with an incomprehensible maybe foreign language documented fire walled WLAN, or if lucky encounter a town centre open WLAN (there's a few in central Munich), but you have nowhere to sit, no power socket, & you want it all downloaded as fast as possible, not blocked on unknown ports, no thinking on the hoof required, combined with mail pick up you know won't be blocked: CTM has it all rolled up ready for you. You don't even have to stand with no seat, consuming battery, applying all the deltas. CTM deltas can be applied later where you do have a seat & power supply.
  • Imagine you'r in an airport departure lounge, with WLAN, but may be called any time. So you just want those deltas downloaded Fast. You can apply them later, perhaps even on the plane/ train/ hotel with no net.
  • A unique reproducible trees with eg /usr/svn/.ctm_status, additional to the .svn status
  • Pre extracted trees for all versions of src & ports as well as SVN tree available via CTM delivery, so you can do local SVN searches, exports etc.
  • Suggestion: You may want to subscribe a different mail address for CTM delta reception, so you can first specify eg fetchmail fetches your human mail.)
  • Errors or Omissions ? Mail page author and/ or list ctm-users@freebsd

What Is CTM ?

Functions Of ctm.berklix.org ftp://ctm.berklix.org , http://ctm.berklix.org

  • Started by providing Deltas with public ftp access, (When freebsd.org decided to cease to host the master deltas sent from the generator site.
    (& thus we also lost all out mirror sites).
  • A set of CTM Generator Build Scripts & trees, ready to generate deltas were copied in case anything failed at Missouri build site.
  • ctm-src-12 mail list created on ctm.berlix.org
  • 2019, The missouri master host died & production moved to ctm.berlix.org

Traffic Load

  • Please do not overload ftp://ctm.berklix.org. There are no mirrors. If you want to offer a public mirror, please do, please contact contact host master or ctm-users@.
  • Please avoid heavy traffic during work days & business hours in Germany (winter time zone +01:00, summer +02:00). Time now At 2019-08 it's a lightly loaded host, but that may change, & I dont want to annoy the host.
  • There is no point regularly ftp'ing latest deltas from here, as a purpose of CTM is to provide Push technology, so you should be receiving distribution updates by ctm-* mail lists. If you want to regular fetch (which is Pull technology, not push) then you should not be using CTM, but be using SVN or Rsync direct form a freebsd.org mirror, nor from berklix.org
    Just use berklix.org ftp archives if you fail to receive a delta via ctm_rmail.

URLs

Full List of Delta Mail Lists & FTP Archives on freebsd.org & ctm.berklix.org:

Sites & People

Corrections

Errors, Omissions, URLs dead, missing, or wrong ? Credits missing ? Please mail page author and/ or list ctm-users@freebsd

Brexit Stolen Votes Berklix.Net Computer Associates Domains Apache: Web Server FreeBSD: Operating System