Doug Warner

Present: David Boswell, (davidwboswell), Doug Warner (silfreed), Gerry Murphy (gjm), Chris Neale (cdn-work), Brian King (kinger), Eric Jung (ericjung)

Discussion was held publically in #mozdev

Discussed developer priorities

• a little Drupal work (theming fixes, install profile fixes)
• Thanksgiving theme
• replaced mirror content
• going to start putting news on front page from mozdev.org blog feed
• would like to serve files directly from mozdev.org if the content on the mirrors is outdated
• will be redirecting users to their closest mirror soon
• gjm picked next Monday @ 10:00 UTC for the BZ 3.0 upgrade

Discussed sysadmin priorities

• mailman is working without problems now
• one of the list admins set the bounce address to the list admin address, causing a very large bounce queue to grow
• mailman devs created a patch for this and it was applied to our servers
• the bounced mail problem has been going on since May 5, 2007
• outgoing queue in mailman was increased from 1 process to 4 processes; postfix outbound smtp clients has been increased 50%
• held message nags are still causing most of the daily email lag to lists
• still tweaking rewrite rules on vebzom.org

Mirror outage

• content was accidentally deleted when stage was synced with production
• Doug needed to fix up the mirror sync script because it wasn't maintained in CVS
• the CVS tree still needs synced from production to staging; gjm will take care of that

Vebzom.org downtime

• TWS rebooted the server without plugging a monitor in, so we don't know if anything was visible on the console
• gjm was unable to find anything in logs
• no ideas about what the problem was, unfortunately

MySQL Backups

• setting up a replication server on vebzom.org is one option; would increase traffic to vebzom.org, but would totally elimninate the locking issue
• splitting out bugzilla tables into its own database will speed up the dump of the tigris database and clean up the database at the same time
• gjm an silfreed will coordinate on splitting the tigris db and updating code

Present: David Boswell, (davidwboswell), Doug Warner (silfreed), Michael Dosser (tanker), Gerry Murphy (gjm), Chris Neale (cdn-work), Brian King (kinger)

Discussion was held publically in #mozdev

Discussed developer priorities

• download counters enabled; projects can use downloads() function again
• D.MD.o now shows size of download files
• mycroft doesn't use mirror system; we might want to try to help them get moved over
• several projects have requested and started using drupal
• integrating blog into main site will be happening soon
• Chris reminded me that Thanksgiving is next week so I'll probably work on that theme soon

Discussed sysadmin priorities

• httpd.conf cleanup - cleaning up aliases, using virtualhosts, cleaning up rewrite rules, combining HTTP and HTTPS servers
• apache cleanup will need tested by project owners, but that will probably bring up the old content on stage again
• syncing production and stage is probably possible if we exclude logs
• stage and production will be synced tomorrow, so Doug will get his stuff backed up today
• mailman has been configured to perform actions through HTTPS
• Gerry is still researching mailman slowness problems
• bugzilla 3.0 is ready to deploy; we'll wait until after the sync so that POs can test w/ recent content

Present: Doug Warner (silfreed), Michael Dosser (tanker), Gerry Murphy (gjm)

Discussion was held publically in #mozdev

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Chris Neale (cdn-work)

Discussion was held publically in #mozdev

Discussed developer priorities

• admin tool for managing mirrors is going well, despite some setbacks last week learning some javascript
• mirror management should be finished up today, then will start towards download counters and mirror redirection using IPs
• could we integrate download counters into top-50 page? Probably; we would want some type of summarization so the top-50 page wouldn't be hogged up by a couple projects - something like "most downloads for last 30 days"
• other mirror projects include secure installs, cleaning up mirrors.mozdev.org content, and providing downloads from some "master" site for new content
• after mirror work is complete Doug will look into using Drupal for project categorization

Skipped sysadmin priorities

Skipped mailing list update

Drupal email working?

• yes; there was a problem with the subscription module that it wouldn't send emails for content changes to a page you were subscribed to
• no requests for Drupal yet
• the plan is to keep using it for www as a showcase for what it can do
• Doug pointed out that the drupal sites can easily be dropped and recreated so projects can play with it and have things reset later

http/https alert problems tomorrow with the halloween theme?

• this is typically only a problem for pages at https://www.mozdev.org that are related to a specific tool (ie, not bugs, drupal, mailman)
• ignore the problem for now, try to work on it for Thanksgiving

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Eric Jung (ericjung)

Discussion was held publically in #mozdev

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Michael Dosser (tanker), Chris Neale (cdn-work), Eric Jung (ericjung)

Discussion was held publically in #mozdev

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Michael Dosser (tanker), Eric Jung (ericjung)

Discussion was held publically in #mozdev

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Michael Dosser (tanker), Chris Neale (cdn-work)

Discussion was held publically in #mozdev

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Michael Dosser (tanker), Chris Neale (cdn-work), Brian King (kinger_away)

Discussion was held publically in #mozdev

Present: David Boswell (davidwboswell), Doug Warner (silfreed),
Michael Dosser (tanker), Eric Jung (ericjung), Chris Neale (cdn-work)

Discussion was held publically in #mozdev

Discussed developer priorities (drupal testing, linking to drupal, rollout...)

• Publish tool is working again

Discussed sysadmin priorities (stats, mirror improvements, mailman defaults...)

• top50.pl page is fixed; Doug should be able to work on the front-end page
  now

Requests from users

clean out project's (pagemark) repository:

Mic cleared the web directory during the meeting

Doug will restore the templates

wrong MIME types on mirrors:

no response from mirror admins

Doug is going to find some better contacts for the mirrors

the mirrors should probably be suspended/removed from rotation if they
don't reply soon

Doug has been looking into Bouncer; will probably test it out soon

Handling user requests through bugzilla

• Delayed until BZ 3.0 upgrade

Turning off wordpress (review categories found)

• The following categories were found:
  

  Mozdev:

  Development

  Status

  Projects:

  Announcements

  Features

  Status Updates

• should be safe to remove now

Turning off other tools

What to do about protected directory issues?

• cvsweb upgrade will remove the directory from the list
• work-around is to disable guest checkouts for projects that request it with the knowledge that it's a temporary workaround until cvs can be patched to disable guest checkouts of the protected directory.
• David and Doug will work together to email the project owners who have asked about the problem directly.

Should we block entire projects to protect mozdev sql structure (www/www, hovercraft)?

• No; it goes against the open-source ideaologies.

Promoting/Integrating McCoy for secure installs and updates?

• Link to the tool from templates.
• Help out with documentation where possible.

Move up priority of bugzilla 3.0 upgrade?

• Mic has done this on vebzom.org once before; upgrade should be easy.
• No one opposed to increasing the priority.
• Chris notes that BZ 3.0 will need some theme adjustments.

Mic noted that strg.at will be hiring another sysadmin soon; that will hopefully free up some sysadmin time for mozdev.

Drupal update

• project owner response has been fairly lack-luster.
• need to work on how to link from projects.
• need to work on rollout proceedure.

Present: David Boswell (davidwboswell), Doug Warner (silfreed),
Michael Dosser (tanker), Eric Jung (ericjung), Chris Neale (cdn-work)

Discussion was held publically in #mozdev

Discussed developer priorities (drupal testing, linking to drupal, rollout...)

• Drupal testing went well with the initial bug reporters. Next is to open
  up testing to the general project owners list.
• Trying to figure out how to build the project nav; I need some way of
  determining whether Drupal is enabled for a project to show the blog/wiki/forum
  links.
• Worked on several project list bugs.

Discussed sysadmin priorities (stats, mirror improvements, mailman defaults...)

• Top-50 page stats gathering is almost ready - Mic has had some problems
  making the script both fast and accurate.
• pagemark project is cleaned; still need to clean up web files.
• Should we disable the Amazon server to save costs? Stats are currently
  served from there, so that would be difficult.

Requests from users

• remove attachment from bugzilla: looks to already be removed; no one is
  sure who did it.
• clean out project's repository: cvs is cleaned; web still needs done.
• wrong MIME types on mirrors: Doug will follow up with mirror admins.
• Tracking user requests: Doug will look into Bugzilla email integration
  with the possibliltiy of adding a "support request" component to the mozdev
  product.

Present: David Boswell (davidwboswell), Doug Warner (silfreed),
Michael Dosser (tanker)

Discussion was held publically in #mozdev

Discussed current developer projects and upcoming projects:

• Performance problems don't seem to be related to Drupal or staging server;
  possibly connectivity issues, but haven't been able to prove that yet.
• Top-50 page work is stalled right now on fixes with the data

Discussed systems projects:

• working on the top-50 xml feed w.r.t. comments posted in the bug
• automation of copying web logs for processing didn't work; looking into it

Project Owners requests

• remove attachment from bugzilla
• clean out project repository
• Mic will be looking into these

Custom code storage

• Where should we store code that is created for mozdev.org (either sysadmin,
  web code, or other)?
• Hovercraft project was created to create an installable version of mozdev.org,
  but hasn't been maintained so it's difficult to integrate into that project.
• Create new project that devs/admins can share: custom.mozdev.org.

Present: David Boswell (davidwboswell), Doug Warner (silfreed),
Chris Neale (cdn-work), Michael Dosser (tanker)

Discussion was held publically in #mozdev

Discussed current developer projects and upcoming projects:

• fixed new projects showing up on active list
• drupal testing went well; fixed bugs that were reported
• release staging copy to Project Owners?
  • Doug is worried that performance would deter any real evalutations
  • Doug will look into performance problems on vebzom since the hardware isn't that much older
  • ask bug reporters to test and give comments

Discussed systems projects:

• Can't show only a portion of munin stats without running another munin instance
• All munin stats can probably be made public, so the above won't be a problem.
• Mic wrote a script to make the top 50 projects available as XML feed.
  • Doug will work to make a web page and RSS feed of the XML feed
• new munin modules are setup; mysql, hard drive temperature. New ones that would be interesting: bugzilla, mailman
• awstats finished processing web stats this morning; web stats for the past year are now available
• TODO: keep adding new munin modules, make munin stats public, looking at the mirror situation
• do we needto review backups?
  • currently done by osuosl via rsync
  • would like to rsync the entire /mozdev partition to make new setup faster
  • OSUOSL can't host more machines, so a backup machine is still on hold
  • FreeBSD 7.0 will support Xen (due in the fall) - this would open up Amazon EC2 as an option
  • can be postponed for now

Birthday planning:

• David will post to PO list and Chris will setup his designs on Sept 1st
• designs will rotate automatically, with Sept 19th still talk-like-a-pirate day
• David: Chris, should we hire a designer to redesign mozdev.org? Chris: "Um"
• things to redesign: logo / font / layout / [colours] / information architecture / Usability

Present: David Boswell (davidwboswell), Chris Neale (cdn-work), Brian King (kinger), Myk Melez (myk), Michael Dosser (tanker), Eric Jung (ericjung)

Discussion was held publically in #mozdev

Discussed current developer projects and upcoming projects:

• bug#13381 is complete; need to fix bug w/ new projects on active list
• drupal installation profile is mostly completes - this handles setting up default module configuration, roles, permissions, etc. A couple things left to tweak here.
• drupal mozdev auth module - already working; handles authenticating users from mozdev CVS credentials.
• Left to do before testing: finish up install profile, testing authentication module, themeing.
• Hopefully should have something that can be tested this week.

Discussed systems projects:

• asked for pete from twshosting to setup new A record for stats.mozdev.org so we have a prettier url; new domain is setup now :
  http://stats.mozdev.org/cgi-bin/awstats.pl?config=mozdev.org
• stats up to Feb 2007 are currently processed
• Eric: should we start another VM to get the stats finished sooner?
  Michael: no, I don't think this is necessary
  Eric: why we don't run more than one VM to process the data... if it's
  taking 3 weeks to process the data, taht is too long IMHO.
  David: it sounds like the stats will be done in a few more days
  Michael: this is just for updating the history ... it will take only
  minutes if we can switch to daily processing once the history is done
  Michael: i guess it's below one hour for processing a daily stat
• setup munin for general system stats (including postfix stats)
  http://stats.mozdev.org/munin

Roadmap updates:

• top-50 page - Mic will write perl script to pull data from awstats
  • this page could probably be moved up
• commit notification
  • we'd have to do this work again when we implement svn, hg, etc
  • rss feed is an option to consider
  • leave it where it is
• project setup automation
  • admin issue; put on public roadmap?
  • high priority; lots is manual right now by David and Pete and long delays in project setup are possible (up to a week)
  • move into 2nd priority group somewhere
  • unclear whether bonsai/lxr or svn is more important and where this should fit in - Eric and David will work on a survey

Birthday in September (7 yrs old)

• Chris is working on banners
• revamp the mozdev store?
• mostly just a reminder to start thinking about ways to celebrate

Doug let everyone know that he can contact him to get chanop on #mozdev

• we should register #mozdev-admin and set default modes/invites

Present: David Boswell (davidwboswell), Doug Warner (silfreed), Michael Dosser (tanker), Eric Jung (ericjung)
Discussion was held publically in #mozdev
Discussed current developer projects and upcoming projects:

• Doug is fixing a minor bug with the active project list, then the "unstarted project list" bug is completed
• Doug setup the project stats page this morning
• David will announce the new lists and stats page after Doug has closed those bugs
• We'll hold off on the other associated project list bugs until after drupal (bug#17520: automate new project announcements, bug#7021: project categorization)
• Doug will be focusing on drupal for now and then next on the roadmap is lxr and bonsai
• Doug will possibly check in with Mic to see if Bouncer (http://wiki.mozilla.org/Bouncer) will help with mirror management

Discussed systems projects:

• Web stats are being processed; it's been running for 48 hours now and has 2 out of 18 months processed
  • June/July 2006 is processed
  • the rest of the historical data is being processed
  • Looking into getting postfix stats using Munin
  • interested in getting a prettier domain setup (stats.mozdev.org) but DNS access currently goes through twshosting; transferring to osuosl would be better
  • Leave stats on Amazon EC2? Still can't make the determination based on cost - not enough data
• the md5hashcheck project needs deleted; research will need to be done as to how to do that
  • cvs, mailing list, newsgroup, web pages are affected
  • possibly just chmod 700 on CVS (and web) directory
• discussed moving some of the mirror improvement work from Mic to Doug
• Eric requested that Mic delete the mail lists for Swarm project; completed

Discussed deleting spam server-side, and all participants were opposed server-side deletion of spam due to the problem of false-positives.

• Doug threw out the idea of not scanning mail from localhost to prevent mail list messages from being double-scanned; Mic wasn't sure if it's possible but will keep it in mind.