Rob Reynolds over at Xplana has posted this useful piece that helps frame some of the issues an institution should factor in when considering looking at an open source solution to course management systems, proposes a rating scheme based on these factors and rates many of the currently available options. While I might differ on a few small points (OCW is not a CMS!!) I think I would also end up suggesting the same four products that show up in his 2 top 3 lists (CHEF, LON-CAPA, Moodle, FLE3) are the most likely contenders.
There are a few things I think we at edutools can learn for the factors he highlights as important (we allow reviews by features, but don’t tie features to these kinds of factors in any strong manner). That said, one lesson I think we’ve learned is that you end up getting way to much clumping in the middle on a 5 point scale (mean on this was 21 with highest score 24 and lowest 17). But I’m probably getting nitpicky as it is getting to the end of the day – SWL