Closed Bug 646888 Opened 15 years ago Closed 11 years ago

move narro from a VM to a hosting cluster

Categories

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Product:
Infrastructure & Operations Graveyard
Component:
WebOps: Other
Platform:
All
Other
Type:
task
Priority:
Not set
Severity:
minor

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: dietrich, Assigned: jd)

References

Details

(Whiteboard: [kanban:https://kanbanize.com/ctrl_board/4/74] )

Attachments

(1 file)

Changes to vagrant narro configuration
1.79 KB, patch
Details | Diff | Splinter Review
Arky said there are a lot of connection errors when trying to do workshops with Narro in the countries that he's active in.
mrz - is this something we have existing infrastructure for?
Assignee: server-ops → mrz
This came out of an out-of-band discussion. We're using Voxel out of .sg right now. I don't know enough about narro.mozilla.org - could be cached with Zeus out there?
What is narro.mozilla.org? That doesn't exist as far as I can tell.
mrz I correct URL is https://l10n.mozilla.org/narro/
mrz the correct URL is https://l10n.mozilla.org/narro/
Sorry! I updated bug summary with the correct URL.
Summary: mirror narro.mozilla.org in .sg to aid l10n activities in the region → mirror l10n.mozilla.org/narro in .sg to aid l10n activities in the region
If that site can be cached, we can do it. It's out of Amsterdam right now.
Back to server-ops to implement.
Assignee: mrz → server-ops
Assignee: server-ops → shyam
Any updates on this bug?
I don't think we have anything active out of SG at the moment. Give me a while to get in touch with people and see how we can do this. Also, what are the countries you're having a problem with this in?
Vietnam, Cambodia, at least recently. Arky- any others?
(In reply to comment #11) > Vietnam, Cambodia, at least recently. Arky- any others? Gen/Arky, can you guys elaborate some more, give us some more details? Are you seeing timeouts? Errors? If so, can we have those error messages? Also, Dietrich mentioned when the bug was filed that it was connection errors, screenshots/logs or some more details will also help IT figure out what's going on. FYI, l10n.mozilla.org right now runs off a single VM. It wasn't meant to be "live" on that VM, but it has been that way for a while now. I cc'ed Laura on this bug because she's involved in getting l10.m.o to a "production" ready app, which means it'll have its own dedicated hardware etc.
Unfortunately there no errors except the pages takes forever to load. Ajax requests also fail with connection timeouts. This creates problems with users are trying to translate a set of texts.
(In reply to comment #12) > FYI, l10n.mozilla.org right now runs off a single VM. It wasn't meant to be > "live" on that VM, but it has been that way for a while now. I cc'ed Laura on > this bug because she's involved in getting l10.m.o to a "production" ready app, > which means it'll have its own dedicated hardware etc. That's https://l10n-stage-sj.mozilla.org/ that's the single VM. I have no idea what box l10n.mozilla.org runs on right now.
Assignee: shyam → reed
Component: Server Operations → Localization Server
QA Contact: mrz → l10n-server
narro is a community-maintained project, using the AMS-based hardware. The admin of that install is Alexandru, who's already pretty burdened with that and his other mozilla tasks. Duplicating that install is something I'd not through on his lap. Not that there's purposed hardware for such a task that I'd know of. Also, narro is slow independent of network proximity, not sure how much infrastructure work can fix. http://code.google.com/p/narro/issues/detail?id=173 is filed. I'm resolving this WONTFIX. We're not going to mirror narro, or any other of the current stuff on the l10n community server. If you really want to, you could try to get a community-maintained and -hosted independent narro install in asia. Can't speak for manpower or infra help from mozilla's side.
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → WONTFIX
Hi Axel, I understand why you are marking this WONTFIX, but the fact of the matter is that Mozilla needs an online l10n tool that works in _all_ the places where we have l10n communities. I realize that the Narro performance issue is a separate bug but I do want to voice my concern that this not be the final discussion on Narro's performance and availability. If we agree that Narro is a key service for Mozilla's l10n community, who manages it is not the central issue. That it on the "community server" also should not matter. We need a solution here, not discussions about what is "community-maintained" or not, or what is "community-hosted" or not. That is not going to help us grow our l10n community.
comments 13 and 14 imply a couple of investigations (and possible solutions) that don't seem to involve Alexandru. 1) put l10n.mozilla.org on a beefer box. and 2) investigate network issues between SE Asia and the data center(s) where l10n.mozilla.org could be hosted. seems like we should still persue those investigations. espcially #1. its been a couple of years since that server was brought up and its probably due for an upgrade. maybe that's the first thing to try here. arky, probably still need more details on network issues you see from Vietnam and Cambodia. entering ping l10n.mozilla.org from systems where you are seeing the slow downs might give us the first clues about how slow things are between you and the server.
I've only been involved with a few locales, but Narro has been instrumental in getting real progress made. In SE Asia this has absolutely been the case. We should be working wholeheartedly towards making things even easier. If Narro is slow, let's fix Narro. If it's network issues, let's fix those, per Chris's suggestion in comment #17.
Status: RESOLVED → REOPENED
Resolution: WONTFIX → ---
Actually, mtr reports are preferred for such debugging. Specifically, the output of the following command would be extremely helpful: mtr -r l10n.mozilla.org
Please file individual bugs on individual issues? Morphing this bug from "mirror" to "find out where the thing is and what it is" to another two things isn't helping. PS: Gen, I disagree that we need "one" solution. I am very sure that going down that route is a disservice to those mentors that build on top of pootle, for example. Or other folks that run separate instances of any webtool.
Status: REOPENED → RESOLVED
Closed: 14 years ago → 14 years ago
Resolution: --- → WONTFIX
Here is the mtr from my home network. Will the result from other countries as well. $ mtr -r l10n.mozilla.org HOST: DarkHorse.local Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 0.0% 10 1.9 1.9 1.7 2.4 0.2 2.|-- 118.70.0.241 0.0% 10 30.3 27.9 26.5 31.1 1.7 3.|-- 118.70.1.1 0.0% 10 26.5 30.6 26.0 68.5 13.3 4.|-- 118.70.0.17 0.0% 10 30.1 27.4 26.7 30.1 1.0 5.|-- 210.245.1.45 0.0% 10 27.8 27.3 26.6 27.8 0.4 6.|-- 210.245.1.34 0.0% 10 27.2 31.6 26.4 74.1 14.9 7.|-- 210.245.1.57 0.0% 10 117.5 38.0 26.8 117.5 28.1 8.|-- pos1-2.cr02.hkg04.pccwbtn 20.0% 10 46.2 46.2 45.4 47.9 0.8 9.|-- TenGE12-4.br01.lax05.pccw 0.0% 10 201.3 203.6 200.9 221.0 6.2 10.|-- TenGigabitEthernet8-1.120 0.0% 10 205.5 256.8 201.4 344.4 57.0 11.|-- MOZILLA.GigabitEthernet9- 0.0% 10 417.2 353.2 344.5 417.2 22.5 12.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0
I'm going to reopen this bug to investigate one possible area that might be behind some of the problems. In talking with Alex at the balkans meet up last weekend he indicated that at around midnight CET a process kicks off to import data from HG and that is a pretty resource intensive process. If the system gets tied up doing this import it could be starving out connections/responsiveness. The particular timing of midnight CET might correspond to times when localizers are active in SE Asia. We should investigate this a bit more to see if there are investigations and fixes that might be done to study the resources used during the import and optimize the import if possible.
Status: RESOLVED → REOPENED
Resolution: WONTFIX → ---
At 8:30 AM CEST Amsterdam, Netherlands local time. We are timeouts during a Malay translation session. DarkHorse:~ arky$ mtr -r https://l10n.mozilla.org/narro HOST: DarkHorse.local Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 0.0% 10 2.0 6.6 1.7 23.4 7.3 2.|-- 118.70.0.241 50.0% 10 31.2 37.8 31.2 52.5 9.4 3.|-- 118.70.1.13 40.0% 10 30.1 66.4 30.1 167.8 57.8 4.|-- 118.70.0.17 50.0% 10 33.5 45.7 30.8 70.9 18.4 5.|-- 210.245.1.45 40.0% 10 31.5 38.4 31.5 60.1 10.9 6.|-- 210.245.1.10 40.0% 10 31.2 36.6 31.2 46.8 6.1 7.|-- 210.245.1.57 40.0% 10 31.0 34.8 30.6 45.0 5.8 8.|-- 80.156.161.9 40.0% 10 440.3 442.4 439.0 447.6 3.2 9.|-- 80.150.170.126 50.0% 10 193.6 194.5 193.2 197.4 1.7 10.|-- xe-4-1.r00.chwahk02.hk.bb 40.0% 10 195.8 285.2 195.8 352.3 70.1 11.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 DarkHorse:~ arky$ mtr -r https://l10n.mozilla.org/narro HOST: DarkHorse.local Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 0.0% 10 2.0 6.3 1.6 35.3 10.7 2.|-- 118.70.0.241 70.0% 10 31.5 32.5 31.5 33.5 1.0 3.|-- 118.70.1.13 30.0% 10 32.8 36.4 30.6 68.5 14.2 4.|-- 118.70.0.17 40.0% 10 30.6 36.2 30.6 59.1 11.2 5.|-- 210.245.1.45 30.0% 10 31.6 35.0 31.0 55.4 9.0 6.|-- 210.245.1.10 30.0% 10 36.8 35.2 31.1 50.4 7.0 7.|-- 210.245.1.57 30.0% 10 32.4 33.1 31.1 41.2 3.6 8.|-- 80.156.161.9 30.0% 10 438.9 442.0 438.9 448.7 3.4 9.|-- 80.150.170.126 60.0% 10 195.0 200.9 194.2 218.4 11.7 10.|-- xe-4-1.r00.chwahk02.hk.bb 90.0% 10 195.5 195.5 195.5 195.5 0.0 11.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 DarkHorse:~ arky$ mtr -r l10n.mozilla.org HOST: DarkHorse.local Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 0.0% 10 1.9 2.0 1.9 2.3 0.1 2.|-- 118.70.0.241 0.0% 10 32.3 31.7 31.1 32.3 0.4 3.|-- 118.70.1.1 0.0% 10 31.0 31.2 30.7 32.4 0.5 4.|-- 118.70.0.33 0.0% 10 31.2 38.4 30.8 70.3 15.1 5.|-- 210.245.1.49 0.0% 10 31.9 50.4 31.4 212.8 57.1 6.|-- 210.245.1.34 0.0% 10 32.6 51.0 32.5 206.3 54.6 7.|-- 210.245.1.57 0.0% 10 31.7 37.7 31.1 75.9 14.3 8.|-- 80.156.161.9 20.0% 10 439.6 442.8 438.5 453.9 5.1 9.|-- lax-sb2-i.LAX.US.NET.DTAG 0.0% 10 438.1 442.0 437.9 456.1 7.1 10.|-- 80.156.162.26 10.0% 10 352.9 355.5 352.8 363.6 4.5 11.|-- MOZILLA.GigabitEthernet9- 20.0% 10 491.6 491.3 490.7 492.3 0.6 12.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 DarkHorse:~ arky$ mtr -r l10n.mozilla.org HOST: DarkHorse.local Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 10.0% 10 88.7 12.7 1.7 88.7 28.6 2.|-- 118.70.0.241 50.0% 10 35.3 33.4 31.3 35.8 2.1 3.|-- 118.70.1.1 50.0% 10 31.2 31.4 30.6 32.1 0.6 4.|-- 118.70.0.33 50.0% 10 35.6 32.4 31.0 35.6 1.8 5.|-- 210.245.1.49 50.0% 10 31.5 31.8 31.5 32.5 0.5 6.|-- 210.245.1.34 50.0% 10 33.0 33.0 32.6 33.2 0.2 7.|-- 210.245.1.57 50.0% 10 31.1 31.7 30.9 33.3 1.0 8.|-- 80.156.161.9 70.0% 10 441.3 440.8 440.4 441.3 0.4 9.|-- lax-sb2-i.LAX.US.NET.DTAG 70.0% 10 440.5 439.0 438.0 440.5 1.3 10.|-- 80.156.162.26 60.0% 10 352.8 355.2 352.8 360.7 3.7 11.|-- MOZILLA.GigabitEthernet9- 60.0% 10 494.6 493.6 491.2 496.8 2.6 12.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 We are trying to use Narro for Vietnamese, Malay, Khmer and Burmese translations
looking at top right now, the load touches 0.7 a few times, but nothing that'd stand out
Thanks Pike, will get metrics from Malayasia, Laos and others countries as well.
One response from ... Hi, thanks for the system (narro) but it seems to be very slow and unresponsive on saving. https://groups.google.com/group/mozilla.community.malaysia/browse_thread/thread/f2ffbaacc7197092#
There's one thing that's showing action in the logs, and that's mysql-slow.log. So I suspect that all mysql connections are happily munging on a few queries that take half a minute, and the people that actually want to edit can't get no. Why this seems to be a bigger problem for folks in Asia, no idea. Maybe there's more sprint-like editing there, or folks in europe just go elsewhere while it's just slow (used to better tubes). Or if there's really something that makes slow tubes fail more easily, I don't know enough about the details of tubes.
Alexandru is not on this bug. I propose we add him so he can see if it is mysql that is the bottleneck or not.
Well, it was not even a sprint. It was the malay team lead and me.
From my side (Canada) I got used to the slow downs (perhaps you guys are hitting worst ones than mine since you work on different times). Sometimes I let a tab be saving for a while and close it at some point. By that time it actual saved the result but the page always showed as still working.
Spoke Corey Shields at the All Hands, adding him to this bug.
spoke with arky, first step here to improving narro is going to be moving it out of the VM and into a cluster. Assigning this out to be done. If there are continuing problems beyond that we will look into global caching (which as mrz pointed above will come out of Amsterdam for the next few months, hopefully from .sg after that)
Assignee: reed → server-ops
Status: REOPENED → NEW
Component: Localization Server → Server Operations
QA Contact: l10n-server → cshields
Summary: mirror l10n.mozilla.org/narro in .sg to aid l10n activities in the region → move narro from a VM to a hosting cluster
let's try this on the generic cluster in phx
Assignee: server-ops → jcrowe
I am working to get this set up on the generic cluster which is running RHEL6 and PHP 5.3. There is an issue as it seems that the narro code will not run on php version higher than 5.2 and 5.3 is on the servers. This is the narro issue: http://code.google.com/p/narro/issues/detail?id=177&colspec=ID%20Priority%20Type%20Page%20Status%20Complexity%20Owner%20Summary&start=100 Anyone here able to provide a fix or suggestions?
(In reply to Jason Crowe [:jd] from comment #35) > I am working to get this set up on the generic cluster which is running > RHEL6 and PHP 5.3. > > There is an issue as it seems that the narro code will not run on php > version higher than 5.2 and 5.3 is on the servers. > > This is the narro issue: > > http://code.google.com/p/narro/issues/ > detail?id=177&colspec=ID%20Priority%20Type%20Page%20Status%20Complexity%20Own > er%20Summary&start=100 > > Anyone here able to provide a fix or suggestions? Jason, if you don't get this sorted out I'll try and solve it later this week. It's not immediately obvious to me.
Alexandru comment "The framework doesn't support php 5.3, try a lower version, 5.2." Source: http://groups.google.com/group/narro-project/browse_thread/thread/22f7cdbd5b95c13d?pli=1
We've been down that road before. It isn't possible to put PHP5.2 or lower on RHEL6. Either the app needs to live on RHEL5 (so not this cluster) and forever be unsupported (meaning we shouldn't support it), or it needs to be patched to work with PHP5.3.
Qcode framework needs to upgraded to support PHP 5.3, The upstream issue is here. http://code.google.com/p/narro/issues/detail?id=177
More data: http://www.qcodo.com/ seems to support 5.3, from what I can tell. Narro uses a fork of qcodo, qcube, http://qcu.be/. I have no idea which version, the code doesn't seem to tell. The funny part is (funny in a mozilla sense) that qcube was forked because qcodo was stale, and is itself rather stale today, reading current discussions in the forum, while qcodo seems to have traction again. It's really hard to tell what we're using and why, I guess. PS: The only stacks that I found refer to includes/qcodo, so they're from old sources, that doesn't exist no more in today's narro source.
Alexandru, are you ok to upgrade to the newer version of qcodo? If you need help give me a ping in IRC.
(In reply to arky from comment #37) > Alexandru comment "The framework doesn't support php 5.3, try a lower > version, 5.2." We can't do this... If the code is not being maintained to support a recent version of php I am concerned about its ability to pass an infrasec review before we are able to go live with it. Yet, as I understand it there are no alternatives to narro for this need?
(In reply to Corey Shields [:cshields] from comment #42) > (In reply to arky from comment #37) > > Alexandru comment "The framework doesn't support php 5.3, try a lower > > version, 5.2." > > We can't do this... > > If the code is not being maintained to support a recent version of php I am > concerned about its ability to pass an infrasec review before we are able to > go live with it. > > Yet, as I understand it there are no alternatives to narro for this need? We'll need to get it running on PHP 5.3 before we can deploy. If Alexandru doesn't have time somebody from Webtools can pick this up
Checked out the narro from hg source and installed in on my ubuntu natty netbook running PHP 5.3.5. And I able to register a user account and browse to user preferences.
I stand corrected.Narro indeed ships with "QCubed Development Framework 2.0.2 Development Release (QCubed 2.0.2)" Framework testpage here: http://<narro>/includes/qcubed/assets/_core/php/_devtools/start_page.php
The current default version, 2.0 can run under php 5.3, that's what I'm using for developing it. I'm not maintaining 0.9.4 anymore. If you need any help installing 2.0 considering that it's still in development, let me know.
(In reply to Alexandru Szasz from comment #46) > The current default version, 2.0 can run under php 5.3, that's what I'm > using for developing it. I'm not maintaining 0.9.4 anymore. > > If you need any help installing 2.0 considering that it's still in > development, let me know. Or if it's possible it would probably be easier if I would do the installation + solve any eventual bugs and when finished you can do a review on security and performance. Just having Narro for translation doesn't do it. Right now, on lmo I have Narro and - build processes to generate the en-US folder with translation files - build processes to build xpi files for testing on every project export - compare locales with output rewritten so that it has links to the place where a translation can be fixed in one click - link to the dashboard with exact messages about errors and warnings (From compare locales) - commit to mercurial from Narro with a pretty non-standard way of doing it, and that is the user needs to upload the private ssh key to commit which is what I could do with what I had So in short, what I did is just an automation of processes that allows me as a translator to actually just translate. At this moment the only thing that I have to do extra outside Narro is to do a signoff on the dashboard.
Component: Server Operations → Server Operations: Web Operations
I'm really interested in the automation. Is it documented somewhere?
(In reply to Laura Thomson :laura from comment #48) > I'm really interested in the automation. Is it documented somewhere? I posted the process on Narro's blog http://narro-project.blogspot.com/2011/09/how-did-i-almost-automate-mozillas.html
Corey, Laura. Any updates?
For the record I'm working on setting up a virtual machine using vagrant. As a result I should have all the dependencies listed.
(In reply to Alexandru Szasz from comment #51) > For the record I'm working on setting up a virtual machine using vagrant. As > a result I should have all the dependencies listed. I wrote a Vagrantfile for Narro, details here: http://narro-project.blogspot.com/2011/10/vagrant-file-for-development-version-of.html This is enough to get Narro running. I'll still work on some reported issues and I'll need to convert the current scripts that clone a repository, get the localizable files, run compare locales, build xpi packages to plugins so that they can be administered through the web interface. After the changes, updating the files by overwritting them and running a database update script and/or php script should apply them.
Thank you Alexandru. Started testing the vagrant file.Might failed with the following errors. $ vagrant provision [default] VM is not currently running. Please bring it up to run this command. arky@Arky-Think:~/dev/narro-vagrant$ vagrant up [default] VM already created. Booting if its not already running... [default] Preparing host only network... [default] Clearing any previously set forwarded ports... [default] Forwarding ports... [default] -- ssh: 22 => 2222 (adapter 1) [default] -- web: 80 => 33800 (adapter 1) [default] Cleaning previously set shared folders... [default] Creating shared folders metadata... [default] Running any VM customizations... [default] Booting VM... [default] Waiting for VM to boot. This can take a few minutes. [default] VM booted and ready for use! [default] Enabling host only network... [default] Mounting shared folders... [default] -- v-root: /vagrant [default] -- manifests: /tmp/vagrant-puppet/manifests [default] Running provisioner: Vagrant::Provisioners::Puppet... [default] Running Puppet with narro.pp... [default] stdin: is not a tty [default] warning: Could not retrieve fact fqdn [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/apt-get update]/returns: executed successfully [default] [default] err: /Stage[main]/Narro/Package[libapache2-mod-php5]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install libapache2-mod-php5' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap php5-common ssl-cert Suggested packages: apache2-doc apache2-suexec apache2-suexec-custom php-pear php5-suhosin The following NEW packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap php5-common ssl-cert 0 upgraded, 11 newly installed, 0 to remove and 15 not upgraded. Need to get 6731kB of archives. After this operation, 19.0MB of additional disk space will be used. WARNING: The following packages cannot be authenticated! libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap apache2.2-bin apache2-utils apache2.2-common apache2-mpm-prefork php5-common libapache2-mod-php5 E: There are problems and -y was used without --force-yes [default] [default] notice: /Stage[main]/Narro/Package[mercurial]/ensure: ensure changed 'purged' to 'present' [default] err: /Stage[main]/Narro/Package[apache2]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install apache2' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: apache2-mpm-worker apache2-utils apache2.2-bin apache2.2-common libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap ssl-cert Suggested packages: apache2-doc apache2-suexec apache2-suexec-custom The following NEW packages will be installed: apache2 apache2-mpm-worker apache2-utils apache2.2-bin apache2.2-common libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap ssl-cert 0 upgraded, 10 newly installed, 0 to remove and 15 not upgraded. Need to get 3351kB of archives. After this operation, 10.3MB of additional disk space will be used. WARNING: The following packages cannot be authenticated! libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap apache2.2-bin apache2-utils apache2.2-common apache2-mpm-worker apache2 E: There are problems and -y was used without --force-yes [default] [default] err: /Stage[main]/Narro/Package[php5-cli]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install php5-cli' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: php5-common Suggested packages: php-pear php5-suhosin The following NEW packages will be installed: php5-cli php5-common 0 upgraded, 2 newly installed, 0 to remove and 15 not upgraded. Need to get 3363kB of archives. After this operation, 8610kB of additional disk space will be used. WARNING: The following packages cannot be authenticated! php5-common php5-cli E: There are problems and -y was used without --force-yes [default] [default] err: /Stage[main]/Narro/Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro]/returns: change from notrun to 0 failed: /usr/bin/hg clone http://code.google.com/p/narro /var/www/narro returned 255 instead of one of [0] at /tmp/vagrant-puppet/manifests/narro.pp:112 [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale/en-US/narro.po]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] [default] warning: /Stage[main]/Narro/File[/var/www/narro/narro/locale/en-US/narro.po]: Skipping because of failed dependencies [default] [default] err: /Stage[main]/Narro/Package[mysql-server]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install mysql-server' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: libdbd-mysql-perl libdbi-perl libhtml-template-perl libmysqlclient16 libnet-daemon-perl libplrpc-perl mysql-client-5.1 mysql-client-core-5.1 mysql-common mysql-server-5.1 mysql-server-core-5.1 Suggested packages: dbishell libipc-sharedcache-perl tinyca mailx The following NEW packages will be installed: libdbd-mysql-perl libdbi-perl libhtml-template-perl libmysqlclient16 libnet-daemon-perl libplrpc-perl mysql-client-5.1 mysql-client-core-5.1 mysql-common mysql-server mysql-server-5.1 mysql-server-core-5.1 0 upgraded, 12 newly installed, 0 to remove and 15 not upgraded. Need to get 23.3MB of archives. After this operation, 54.8MB of additional disk space will be used. WARNING: The following packages cannot be authenticated! mysql-common libmysqlclient16 mysql-client-core-5.1 mysql-client-5.1 mysql-server-core-5.1 mysql-server-5.1 mysql-server E: There are problems and -y was used without --force-yes [default] [default] notice: /Stage[main]/Narro/Service[mysql]: Dependency Package[mysql-server] has failures: true [default] warning: /Stage[main]/Narro/Service[mysql]: Skipping because of failed dependencies [default] [default] err: /Stage[main]/Narro/Package[php5-pspell]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install php5-pspell' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common aspell aspell-en dictionaries-common libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libaspell15 php5-common ssl-cert Suggested packages: apache2-doc apache2-suexec apache2-suexec-custom aspell-doc spellutils ispell emacsen-common jed-extra php-pear php5-suhosin The following NEW packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common aspell aspell-en dictionaries-common libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libaspell15 php5-common php5-pspell ssl-cert 0 upgraded, 16 newly installed, 0 to remove and 15 not upgraded. Need to get 7993kB of archives. After this operation, 24.3MB of additional disk space will be used. WARNING: The following packages cannot be authenticated! libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap apache2.2-bin apache2-utils apache2.2-common apache2-mpm-prefork php5-common libapache2-mod-php5 php5-pspell E: There are problems and -y was used without --force-yes [default] [default] err: /Stage[main]/Narro/Package[php5-mysql]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install php5-mysql' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libmysqlclient16 mysql-common php5-common ssl-cert Suggested packages: apache2-doc apache2-suexec apache2-suexec-custom php-pear php5-suhosin The following NEW packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libmysqlclient16 mysql-common php5-common php5-mysql ssl-cert 0 upgraded, 14 newly installed, 0 to remove and 15 not upgraded. Need to get 8828kB of archives. After this operation, 23.7MB of additional disk space will be used. WARNING: The following packages cannot be authenticated! libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap apache2.2-bin apache2-utils apache2.2-common apache2-mpm-prefork php5-common libapache2-mod-php5 mysql-common libmysqlclient16 php5-mysql E: There are problems and -y was used without --force-yes [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root < /vagrant/files/narro_db.sql]: Dependency Package[mysql-server] has failures: true [default] [default] warning: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root < /vagrant/files/narro_db.sql]: Skipping because of failed dependencies [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root -D narro < /var/www/narro/narro/narro.sql]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root -D narro < /var/www/narro/narro/narro.sql]: Dependency Package[mysql-server] has failures: true [default] [default] warning: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root -D narro < /var/www/narro/narro/narro.sql]: Skipping because of failed dependencies [default] err: /Stage[main]/Narro/Package[php5-gd]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install php5-gd' returned 100: Reading package lists... Building dependency tree... Reading state information... The following extra packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common fontconfig-config libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libfontconfig1 libgd2-xpm libjpeg62 libt1-5 libxpm4 php5-common ssl-cert ttf-dejavu-core Suggested packages: apache2-doc apache2-suexec apache2-suexec-custom php-pear libgd-tools php5-suhosin The following NEW packages will be installed: apache2-mpm-prefork apache2-utils apache2.2-bin apache2.2-common fontconfig-config libapache2-mod-php5 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap libfontconfig1 libgd2-xpm libjpeg62 libt1-5 libxpm4 php5-common php5-gd ssl-cert ttf-dejavu-core 0 upgraded, 19 newly installed, 0 to remove and 15 not upgraded. Need to get 9002kB of archives. After this operation, 24.0MB of additional disk space will be used. WARNING: The following packages cannot be authenticated! libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap apache2.2-bin apache2-utils apache2.2-common apache2-mpm-prefork php5-common libapache2-mod-php5 php5-gd E: There are problems and -y was used without --force-yes [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/configuration/configuration.narro.inc.php]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] warning: /Stage[main]/Narro/File[/var/www/narro/narro/configuration/configuration.narro.inc.php]: Skipping because of failed dependencies [default] notice: /Stage[main]/Narro/Service[apache2]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] [default] notice: /Stage[main]/Narro/Service[apache2]: Dependency Package[apache2] has failures: true [default] [default] warning: /Stage[main]/Narro/Service[apache2]: Skipping because of failed dependencies [default] [default] notice: /Stage[main]/Narro/File[/var/narro_data]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] notice: /Stage[main]/Narro/File[/var/narro_data]: Dependency Package[apache2] has failures: true [default] [default] warning: /Stage[main]/Narro/File[/var/narro_data]: Skipping because of failed dependencies [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale]: Dependency Package[apache2] has failures: true warning: /Stage[main]/Narro/File[/var/www/narro/narro/locale]: Skipping because of failed dependencies [default] notice: /Stage[main]/Narro/Exec[/usr/bin/php /var/www/narro/narro/assets/php/install.php]: Dependency Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro] has failures: true [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/php /var/www/narro/narro/assets/php/install.php]: Dependency Package[apache2] has failures: true [default] [default] warning: /Stage[main]/Narro/Exec[/usr/bin/php /var/www/narro/narro/assets/php/install.php]: Skipping because of failed dependencies [default] [default] notice: Finished catalog run in 86.06 seconds
Second try: Hope this message help you debug the problem. vagrant provision [default] Running provisioner: Vagrant::Provisioners::Puppet... [default] Running Puppet with narro.pp... [default] stdin: is not a tty [default] warning: Could not retrieve fact fqdn [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/apt-get update]/returns: executed successfully [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/hg clone http://code.google.com/p/narro /var/www/narro]/returns: executed successfully [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale/en-US/narro.po]/owner: owner changed 'root' to 'vagrant' [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale/en-US/narro.po]/group: group changed 'root' to 'vagrant' [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale/en-US/narro.po]/mode: mode changed '644' to '666' [default] [default] err: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root < /vagrant/files/narro_db.sql]/returns: change from notrun to 0 failed: /usr/bin/mysql -u root < /vagrant/files/narro_db.sql returned 1 instead of one of [0] at /tmp/vagrant-puppet/manifests/narro.pp:112 [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root -D narro < /var/www/narro/narro/narro.sql]: Dependency Exec[/usr/bin/mysql -u root < /vagrant/files/narro_db.sql] has failures: true [default] [default] warning: /Stage[main]/Narro/Exec[/usr/bin/mysql -u root -D narro < /var/www/narro/narro/narro.sql]: Skipping because of failed dependencies [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/configuration/configuration.narro.inc.php]/content: content changed '{md5}ef8efb26b84d046066e58c017d5d3388' to '{md5}0354333f567329988459cc515fefecdb' [default] [default] notice: /Stage[main]/Narro/Service[apache2]: Triggered 'refresh' from 1 events [default] [default] notice: /Stage[main]/Narro/File[/var/narro_data]/ensure: created [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale]/owner: owner changed 'root' to 'vagrant' [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale]/group: group changed 'root' to 'vagrant' [default] [default] notice: /Stage[main]/Narro/File[/var/www/narro/narro/locale]/mode: mode changed '755' to '777' [default] [default] notice: /Stage[main]/Narro/Exec[/usr/bin/php /var/www/narro/narro/assets/php/install.php]/returns: executed successfully [default] [default] notice: Finished catalog run in 76.08 seconds
Thanks it works after commenting out the network address.
Thanks, applied the patch in http://code.google.com/p/narro/source/detail?r=10f33b4ffd50fd553c62f71089b22c8362dd3b0d&repo=vagrant . I'll prepare a second file that imports an existing database.
Corey Shields and Laura Thomson I think we are ready for you now. You can deploy narro onto the cluster now. Thanks :)
Hey Laura, Please let me know me if the Narro VM is ready to deploy on the cluster.
Hey Laura, Please let us know if the Narro VM is ready to be deployed on the cluster.
I have this site mostly working in a dev environment. The issue seems to be related to session handling and is getting beyond me. You can view the site here: https://narro-dev.allizom.org/ and if you try to view roles or register a user there will be the error. You can see an example here: https://narro-dev.allizom.org/data/error_logs/2011-10-18-15-04-46-115.html If someone can tell me how to fix this, I would appreciate it.
Is the zlib installed? php -m | grep zlib Please tell me what you have running in the dev environment (distribution and version) so I can try to reproduce this.
Alexandru, # php -m | grep zlib zlib # php --version PHP 5.3.3 the os is rhel6 please let me know if you need any additional information.
Hi Jason, I tried reproducing the problem on Centos 6 and rhel6 with no luck so I'm just gonna poke at the possible problem. The form states are stored on disk, serialized, compressed, then uncompressed and unserialized on the next request. Please try updating the code from Mercurial, see if the problem is there after the update. If yes, try setting define ('__COMPRESS_FORM_STATES__', false); in configuration/configuration.narro.inc.php and see if the problem is there after this.
Alexandru, I made sure that I have the most recent code from Mercurial. I added that define, but the problem persists. Is it possible that I am missing a module? Any more ideas? Thanks
Are you sure you updated the code? https://narro-dev.allizom.org/login.php?l=ro shows an old version compared to https://l10n.mozilla.org/narro/login.php?l=xx-XX
I see version 2.0 on both sites and # hg status M narro/configuration/configuration.narro.inc.php # hg identify 07785a58c043+ tip Am I missing something?
Yes, the login page is different between the two. Note that you're pulling from the default branch, where I'm still changing things for version 2. So it will say version 2 until all the bugs are fixed for this unreleased version. http://code.google.com/p/narro/issues/list?q=label:Version-2 Also, if you could send me a zip with all the html files from the error logs directory that would help. Maybe send them on through email, they might contain sensitive information.
Okay, so I have the site updated now and am still getting the error. I am sending you the error logs via email. Please let me know what I should do next.
(In reply to Jason Crowe [:jd] from comment #68) > Okay, so I have the site updated now and am still getting the error. I am > sending you the error logs via email. Please let me know what I should do > next. Haven't received the log files yet. I did some changes though, by default the form states are binary encoded, because apparently some platforms have a problem compressing serialized data (that contains the null character). Make sure after you update from Mercurial, the last two lines in the configuration file look like this: // Problems with form states? Try flipping these values define ('__COMPRESS_FORM_STATES__', true); define ('__ENCODE_FORM_STATES__', true);
Perhaps it would be good for Alexandru to have access to the https://narro-dev.allizom.org/ instance so that he can debug and help with the installation.
Alexandru, I pulled the latest from Mercurial. I am getting a database error now without any page load. I notice that there is no 'real_name' field in the 'narro_user' table. Is there a database update or migration file I need or should I just add this field (and if so what type etc). Error page here: https://narro-dev.allizom.org/data/error_logs/2011-10-24-09-25-52-545.html I tried to resend the tar file but got a bounce message. Do you have a different email address I can try?
Alexandru, Looking again at the bounce message it is because of the attachment not the email address. My guess is because the error pages are in php. host aspmx.l.google.com[74.125.65.26] said: 552-5.7.0 Our system detected an illegal attachment on your message. There is nothing really useful in them anyhow. There are all exactly the same. Let me know if you think you really need them and I will try to figure out another way.
(In reply to Jason Crowe [:jd] from comment #71) > Alexandru, > > I pulled the latest from Mercurial. I am getting a database error now > without any page load. I notice that there is no 'real_name' field in the > 'narro_user' table. Is there a database update or migration file I need or > should I just add this field (and if so what type etc). Error page here: > > https://narro-dev.allizom.org/data/error_logs/2011-10-24-09-25-52-545.html > > I tried to resend the tar file but got a bounce message. Do you have a > different email address I can try? Not sure when you did the first pull, these are the db modifications : ALTER TABLE `narro_context` ADD `text_command_key` CHAR( 1 ) CHARACTER SET utf8 COLLATE utf8_general_ci NULL AFTER `text_access_key`; ALTER TABLE `narro_context_info` ADD `suggestion_command_key` CHAR( 1 ) CHARACTER SET utf8 COLLATE utf8_general_ci NULL AFTER `suggestion_access_key`; ALTER TABLE `narro_file` ADD UNIQUE `file_path` ( `file_path` , `project_id` ) ; ALTER TABLE `narro_file` ADD INDEX ( `active` ) ; CREATE TABLE IF NOT EXISTS `narro_log` ( `log_id` int(10) unsigned NOT NULL AUTO_INCREMENT, `language_id` int(10) unsigned DEFAULT NULL, `project_id` int(10) unsigned DEFAULT NULL, `user_id` int(10) unsigned DEFAULT NULL, `message` text NOT NULL, `priority` smallint(6) NOT NULL, `date` datetime NOT NULL, PRIMARY KEY (`log_id`), KEY `language_id` (`language_id`,`project_id`), KEY `project_id` (`project_id`), KEY `user_id` (`user_id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 AUTO_INCREMENT=1 ; ALTER TABLE `narro_log` ADD CONSTRAINT `narro_log_ibfk_3` FOREIGN KEY (`user_id`) REFERENCES `narro_user` (`user_id`) ON DELETE CASCADE ON UPDATE CASCADE, ADD CONSTRAINT `narro_log_ibfk_1` FOREIGN KEY (`language_id`) REFERENCES `narro_language` (`language_id`) ON DELETE CASCADE ON UPDATE CASCADE, ADD CONSTRAINT `narro_log_ibfk_2` FOREIGN KEY (`project_id`) REFERENCES `narro_project` (`project_id`) ON DELETE CASCADE ON UPDATE CASCADE; ALTER TABLE `narro_suggestion` DROP FOREIGN KEY `narro_suggestion_ibfk_9` ; ALTER TABLE `narro_suggestion` ADD CONSTRAINT `narro_suggestion_ibfk_9` FOREIGN KEY (`language_id` ) REFERENCES `narro_language` (`language_id` ) ON DELETE CASCADE ON UPDATE CASCADE; ALTER TABLE `narro_context_info` DROP FOREIGN KEY `narro_context_info_ibfk_18` ; ALTER TABLE `narro_context_info` ADD CONSTRAINT `narro_context_info_ibfk_18` FOREIGN KEY (`language_id` ) REFERENCES `narro_language` (`language_id` ) ON DELETE CASCADE ON UPDATE CASCADE; ALTER TABLE `narro_text_comment` DROP FOREIGN KEY `narro_text_comment_ibfk_11` ; ALTER TABLE `narro_text_comment` ADD FOREIGN KEY ( `language_id` ) REFERENCES `narro_language` ( `language_id` ) ON DELETE CASCADE ON UPDATE CASCADE ; ALTER TABLE `narro_user_role` DROP FOREIGN KEY `narro_user_role_ibfk_6` ; ALTER TABLE `narro_user_role` ADD FOREIGN KEY ( `role_id` ) REFERENCES `narro_role` ( `role_id` ) ON DELETE CASCADE ON UPDATE CASCADE ; ALTER TABLE `narro_user_role` DROP FOREIGN KEY `narro_user_role_ibfk_7` ; ALTER TABLE `narro_user_role` ADD FOREIGN KEY ( `project_id` ) REFERENCES `narro_project` ( `project_id` ) ON DELETE CASCADE ON UPDATE CASCADE ; ALTER TABLE `narro_user_role` DROP FOREIGN KEY `narro_user_role_ibfk_8` ; ALTER TABLE `narro_user_role` ADD FOREIGN KEY ( `language_id` ) REFERENCES `narro_language` ( `language_id` ) ON DELETE CASCADE ON UPDATE CASCADE ; DROP TABLE `narro_suggestion_comment`; ALTER TABLE `narro_user` ADD `real_name` VARCHAR( 255 ) NULL AFTER `email` ; ALTER TABLE `narro_user` ADD UNIQUE ( `real_name` ); UPDATE narro_user SET real_name=username; Ignore any errors, you might have some run already.
Alexandru, I was getting a number of no-go errors when trying to apply that. Since there is really nothing in this database yet I just dropped it and started fresh with the current narro.sql file from Mercurial. I am now getting the following error. I tried several times but it will not move past this point. ERROR 1025 (HY000) at line 747: Error on rename of './narro_dev_allizom_org/narro_user_role' to './narro_dev_allizom_org/#sql2-709b-26439e' (errno: 152) In the file I have that line is: ALTER TABLE `narro_user_role` DROP FOREIGN KEY `narro_user_role_ibfk_6` ; If I run again without first dropping that table I get this error: ERROR 1005 (HY000) at line 720: Can't create table 'narro_dev_allizom_org.#sql-709b_263eef' (errno: 121) That line is: ALTER TABLE `narro_log` When I 'show create table narro_user_role;' there is no foreign key 'narro_user_role_ibfk_6`' I commented out line 747 and got: ERROR 1025 (HY000) at line 753: Error on rename of './narro_dev_allizom_org/narro_user_role' to './narro_dev_allizom_org/#sql2-709b-26543e' (errno: 152) I commented line 753 and got: ERROR 1025 (HY000) at line 759: Error on rename of './narro_dev_allizom_org/narro_user_role' to './narro_dev_allizom_org/#sql2-709b-267551' (errno: 152) Finally I commented line 759 and the database loaded. Now the site is working much the same as it was. The main projects page loads, however when I try to create a user or login I get a pop-up saying: > It seems that you left the page open for a while and the session expired. > You will be redirected to the project list after you close this dialogue. > If you get this message repeatedly, please report the problem to the administrator. This seems to be much the same error I was getting previously.
Any SQL query that just altered foreign key can be ignored in this phase. Please do an update from Mercurial. I added some error logging on some parts where the deserialization of formstates could fail. After getting some errors, please attach here the entries from the table narro_log that could be relevant.
I updated and will paste errors below. I am curious if you can add a line to the end of 'configuration.narro.inc.php' to include a file like 'configuration-local.narro.inc.php' or something like that (I don't care what the name is) but do not create this file in Mercurial. The issue is that Mercurial will not let me ignore the config file because it is already included (stupid if you ask me but no one is :) so every time I update from the repository, if there are any changes to the conf file it borks and I have to manually merge/fix the conf file. Really what I am trying to accomplish is to be able to put a few things (database connector mainly) in this local file, place this local file in my '.hgignore' file to solve this manual merge issue. This will also help when we finally get things working and move to our dev -> stage -> production set-up. Here are the errors: 1 | 1 | NULL | 0 | Tried to load the form state 09c153f92efff0133a31499626e42a7a but the file /data/www/narro-dev.allizom.org/narro/configuration/../data/formstate/qformstate_l1dcub7lcdl74sm30rv65bg893_09c153f92efff0133a31499626e42a7a.gz does not exist on the disk | 3 | 2011-10-25 10:38:11 | | 2 | 1 | NULL | 0 | Loading the form state 09c153f92efff0133a31499626e42a7a through QFileFormStateHandler::Load() returned an empty result | 3 | 2011-10-25 10:38:13 | Something I noticed between the error and what exists in that directory. I have several files in that 'formstate' directory but two of them are parts of the name of the file in the error. You can see the first file having the first part of the name and the second file having the second part of the name. I do not know if this is relevant, but it is odd that the names line up exactly in this way: -rw-rw-rw- 1 apache apache 8051 Oct 25 10:38 qformstate_l1dcub7lcdl74sm30rv65bg893_cac6b962f8c060e7eb015feef9fee853.gz -rw-rw-rw- 1 apache apache 8028 Oct 25 10:38 qformstate_p2pjkievohlngqp4o7voccdfv3_09c153f92efff0133a31499626e42a7a.gz So the error is correct in that the file does not exist. I only was looking in this directory to ensure that it is writeable by Apache and that Apache is making files there.
Status: NEW → ASSIGNED
The problem is that every time I click, a new session is created, so it has nothing to do with formstates directly; that's just a consequence because the formstate is session dependent. Can you post the settings for the session module, e.g. the ones mentioned here: http://www.php.net/manual/en/session.configuration.php ? Note that some systems have separate php.ini files for cli and apache, I need the settings for apache. I added some code to check that, you can do a pull update. Regarding to the config file, I'm aware of the problem, I'll think of a solution to that.
Here are the session variables that are set. All others are defaults. Also I pulled a new version from Mercurial and pushed it to the web servers. session.save_handler = files session.save_path = "/var/lib/php/session" session.use_cookies = 1 session.use_only_cookies = 1 session.name = PHPSESSID session.auto_start = 0 session.cookie_lifetime = 0 session.cookie_path = / session.cookie_domain = session.cookie_httponly = session.serialize_handler = php session.gc_probability = 1 session.gc_divisor = 1000 session.gc_maxlifetime = 1440 session.bug_compat_42 = Off session.bug_compat_warn = Off session.referer_check = session.entropy_length = 0 session.entropy_file = session.cache_limiter = nocache session.cache_expire = 180 session.use_trans_sid = 0 session.hash_function = 0 session.hash_bits_per_character = 5
The session cookie path is invalid (it's set to /..). Please adjust configuration.narro.inc.php as follows: define ('__HTTP_URL__', 'https://narro-dev.allizom.org'); define ('__DOCROOT__', '/enter/here/the/full/path/to/where/narro-dev.allizom.org/is/served/from'); define ('__VIRTUAL_DIRECTORY__', ''); define ('__SUBDIRECTORY__', ''); After this, the cookie path will be / and sessions and form states should work. Meanwhile I'll work on a patch to detect this.
This seems to have fixed the problems. Please test the site and let me know if you have any issues. The next step will be to get things working in our dev -> stage -> prod setup. Usually we have the dev site automatically update itself every 15min so you can work without waiting on us to pull updates. I have the base script built to do this, however we will need to address the local config file issue first. Once we have the local config file, I will get the dev -> stage -> prod stuff set up and then we can pass this over to the security folks for a code review. Once that is done we can discuss the actual cut-over/content migration to this new site/hardware.
Hi Jason, copy the current configuration.narro.inc.php file to configuration.narro.local.inc.php . Do a hg pull -u -C to update configuration.narro.inc.php. If the configuration.narro.local.inc.php is present in the same directory it will be loaded instead of configuration.narro.inc.php.
I made the config file location adjustment and it works. Thanks for that. Now, I created a copy of the site in a new location 'narro.allizom.org' which will be the staging site. Everything seems to be working. You can feel free to look things over to be sure. I will open a bug with the security folks to see what (if anything) they will want to review before we go live with this site. If they want to do a full review we can expect that to take at least a week as they are quite busy.
Can you add the administrator role please? It would be interesting to experiment a bit. https://narro.allizom.org/user_role.php?l=ro&u=2 Language Any, Project Any, Administrator -> Add
This is done. Cheers
Hey, Can anyone give us a update about the status of this bug. Last heard we were waiting for security review of the Narro instance. Cheers --arky
Arky & Alex, The security folks need some questions answered. the questions are from https://wiki.mozilla.org/WebAppSec/Security_Review_Request if you care to look at them all. I can answer most of them but need some input on a few of them. Can one of you please answer the following questions about this application? 4. Where would you like the bugs filed in bugzilla? Please specify the product, component and if anyone specific should be copied on the bugs. 6. Please describe if this app will be connecting to any internal or external services or if it is able to interact with the OS. 8. What is the worst case scenario that could happen with this system, data or connected systems? (This is used to help understand the criticality of this server.) 9. Does this website contain an administration page? If so, have the admin page blockers (listed here https://wiki.mozilla.org/WebAppSec/Secure_Coding_Guidelines#Admin_Login_Pages) all been addressed? 10. This review will be scheduled amongst other requested reviews. What is the urgency or needed completion date of this review? I will pass this information along as soon as I receive it. Thanks
Hi Jason, I need a permission on any language and any project, right now I have none https://narro.allizom.org/user_role.php?l=ro&u=2 Language Any, Project Any, Administrator -> Add Need to create different roles for the security review, or if you'll do that, that's fine too.
Alexandru, I see you have these permissions on the dev site. I added these permissions to your user on the staging site. Also I created the requested users on the staging site and updated the other ticket. Feel free to change things and update that ticket if you do not like what I have done.
Added another bug report requesting Narro staging server instance. https://bugzilla.mozilla.org/show_bug.cgi?id=705523
Any update on this deployment
:jd; any progress here? If you are blocked needing info, can you let us know what info you need?
John, I have no information. I am waiting on the security review in bug 698770.
We're coming up on a year that this bug is open. I'm not sure what's the problem but we really need action here. Can someone please cc me on that bug 698770?
Summary: looks like infrasec ran out of time in 2011 - will comment further in the other bug.
What is the status? I don't have access to bug 698770. Can anyone add me please?
(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #96) > What is the status? > I don't have access to bug 698770. Can anyone add me please? Armen, I added you to the cc list. Regards
Thanks a lot Jason.
Looks like we are close to finishing the security review now (https://bugzilla.mozilla.org/show_bug.cgi?id=698770#c55). Please advise on the next steps.
arky, As I understand it we will need to deploy a copy of the code from the stage environment over to the production servers. Once this is done we will need to cut over DNS to the new location. I do not know what (if any) data needs to be imported into the new production environment prior to launch, someone will need to let me know (Alex ?). Also I will need to know what the current production site is called (what is its URL / URI) and who administers the DNS for that domain. If there are any additional steps required someone will need to tell me what they are. Please let me know if I can provide any further information.
The easiest way would be to copy database + files. The configuration file will most likely need to be updated: the new url and database access details. If you don't copy the files, than they will be downloaded over the internet again, so they could be restored, but it would take longer than copying the actual files. There is a cronjob that should be set: 0 19 * * * apache /usr/bin/php /home/alexxed/alexxed/narro-hg/narro/scripts/import_all.php --user 1 --import-unchanged-files --no-suggestions Path needs to be changed. This runs an import for all active projects and languages. It may take hours, so don't set it more often than daily.
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
Whiteboard: [kanban:https://kanbanize.com/ctrl_board/4/74]
I think it is good idea to close all Narro related bugs as WONTFIX.
Agreed. Thanks to everyone for the work they've put into this, but WONTFIX.
Status: ASSIGNED → RESOLVED
Closed: 14 years ago → 11 years ago
Resolution: --- → WONTFIX
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: